Ghent University Academic Bibliography

Advanced

Efficient adaptive-shape partitioning of video

Kenneth Vermeirsch, Jan De Cock, Stijn Notebaert UGent, Peter Lambert UGent, Joeri Barbarien, Adrian Munteanu and Rik Van de Walle UGent (2012) MULTIMEDIA TOOLS AND APPLICATIONS. 56(3). p.385-417
abstract
While many recent international video coding standards, especially H.264/MPEG-4 AVC, leverage block size adaptivity in motion estimation, the rate-distortion boundary can be pushed further by allowing even more freedom in the partitioning process of inter pictures. Adaptive-shape partitioning, which allows blocks to be partitioned along a straight line that runs through the block at a freely chosen angle and position, complements the regular subblock partitioning, allowing the encoder to better adapt to the local characteristics of the motion activity in a video sequence. However, the technique demands excessive encoder resources to exhaust the large search space. This paper is the result of an investigation into the relative rate-distortion importance of the various adaptive-shape modes, both in terms of the angle of the partition boundary and of its location within a block. We find that a significant reduction of the search space with a factor of up to 40 can be accomplished, while retaining 50 to 90% of the compression gain obtained in the state of the art. This allows encoders to operate at much lower complexity levels and also reduces the signaling overhead associated with adaptive-shape partitioning. Based on our observations, we formulate a number of approaches to trade off compression performance against encoder complexity. Furthermore we discuss the use of various schemes of overlapping motion estimation along the partition boundary, an aspect which is currently left unaddressed in the literature on adaptive-shape partitioning. We introduce the use of shape-adaptive transforms for the motion compensated signal, to avoid the condition that arises with adaptive-shape partitioning where a partition boundary lies inside a transform block. The result is a reduction in ringing artifacts while maintaining objective quality.
Please use this url to cite or link to this publication:
author
organization
year
type
journalArticle (original)
publication status
published
subject
keyword
Complexity, Shape-adaptive transformation, Motion compensation, Video coding, Partitioning, DCT, STANDARD, OPTIMIZATION, COMPRESSION, MOTION-COMPENSATED PREDICTION
journal title
MULTIMEDIA TOOLS AND APPLICATIONS
Multimed. Tools Appl.
volume
56
issue
3
pages
385 - 417
publisher
Springer
Web of Science type
Article
Web of Science id
000300189700001
JCR category
COMPUTER SCIENCE, THEORY & METHODS
JCR impact factor
1.014 (2012)
JCR rank
33/100 (2012)
JCR quartile
2 (2012)
ISSN
1380-7501
DOI
10.1007/s11042-010-0593-0
language
English
UGent publication?
yes
classification
A1
copyright statement
I have transferred the copyright for this publication to the publisher
id
3251665
handle
http://hdl.handle.net/1854/LU-3251665
date created
2013-06-12 15:39:25
date last changed
2016-12-19 15:43:08
@article{3251665,
  abstract     = {While many recent international video coding standards, especially H.264/MPEG-4 AVC, leverage block size adaptivity in motion estimation, the rate-distortion boundary can be pushed further by allowing even more freedom in the partitioning process of inter pictures. Adaptive-shape partitioning, which allows blocks to be partitioned along a straight line that runs through the block at a freely chosen angle and position, complements the regular subblock partitioning, allowing the encoder to better adapt to the local characteristics of the motion activity in a video sequence. However, the technique demands excessive encoder resources to exhaust the large search space. This paper is the result of an investigation into the relative rate-distortion importance of the various adaptive-shape modes, both in terms of the angle of the partition boundary and of its location within a block. We find that a significant reduction of the search space with a factor of up to 40 can be accomplished, while retaining 50 to 90\% of the compression gain obtained in the state of the art. This allows encoders to operate at much lower complexity levels and also reduces the signaling overhead associated with adaptive-shape partitioning. Based on our observations, we formulate a number of approaches to trade off compression performance against encoder complexity. Furthermore we discuss the use of various schemes of overlapping motion estimation along the partition boundary, an aspect which is currently left unaddressed in the literature on adaptive-shape partitioning. We introduce the use of shape-adaptive transforms for the motion compensated signal, to avoid the condition that arises with adaptive-shape partitioning where a partition boundary lies inside a transform block. The result is a reduction in ringing artifacts while maintaining objective quality.},
  author       = {Vermeirsch, Kenneth and De Cock, Jan and Notebaert, Stijn and Lambert, Peter and Barbarien, Joeri and Munteanu, Adrian and Van de Walle, Rik},
  issn         = {1380-7501},
  journal      = {MULTIMEDIA TOOLS AND APPLICATIONS},
  keyword      = {Complexity,Shape-adaptive transformation,Motion compensation,Video coding,Partitioning,DCT,STANDARD,OPTIMIZATION,COMPRESSION,MOTION-COMPENSATED PREDICTION},
  language     = {eng},
  number       = {3},
  pages        = {385--417},
  publisher    = {Springer},
  title        = {Efficient adaptive-shape partitioning of video},
  url          = {http://dx.doi.org/10.1007/s11042-010-0593-0},
  volume       = {56},
  year         = {2012},
}

Chicago
Vermeirsch, Kenneth, Jan De Cock, Stijn Notebaert, Peter Lambert, Joeri Barbarien, Adrian Munteanu, and Rik Van de Walle. 2012. “Efficient Adaptive-shape Partitioning of Video.” Multimedia Tools and Applications 56 (3): 385–417.
APA
Vermeirsch, Kenneth, De Cock, J., Notebaert, S., Lambert, P., Barbarien, J., Munteanu, A., & Van de Walle, R. (2012). Efficient adaptive-shape partitioning of video. MULTIMEDIA TOOLS AND APPLICATIONS, 56(3), 385–417.
Vancouver
1.
Vermeirsch K, De Cock J, Notebaert S, Lambert P, Barbarien J, Munteanu A, et al. Efficient adaptive-shape partitioning of video. MULTIMEDIA TOOLS AND APPLICATIONS. Springer; 2012;56(3):385–417.
MLA
Vermeirsch, Kenneth, Jan De Cock, Stijn Notebaert, et al. “Efficient Adaptive-shape Partitioning of Video.” MULTIMEDIA TOOLS AND APPLICATIONS 56.3 (2012): 385–417. Print.