Ghent University Academic Bibliography

Advanced

Towards robust and reliable multimedia analysis through semantic integration of services

Ben De Meester UGent, Ruben Verborgh UGent, Pieter Pauwels UGent, Wesley De Neve UGent, Erik Mannens UGent and Rik Van de Walle UGent (2016) MULTIMEDIA TOOLS AND APPLICATIONS. 75(22). p.14019-14038
abstract
Thanks to ubiquitous Web connectivity and portable multimedia devices, it has never been so easy to produce and distribute new multimedia resources such as videos, photos, and audio. This ever-increasing production leads to an information overload for consumers, which calls for efficient multimedia retrieval techniques. Multimedia resources can be efficiently retrieved using their metadata, but the multimedia analysis methods that can automatically generate this metadata are currently not reliable enough for highly diverse multimedia content. A reliable and automatic method for analyzing general multimedia content is needed. We introduce a domain-agnostic framework that annotates multimedia resources using currently available multimedia analysis methods. By using a three-step reasoning cycle, this framework can assess and improve the quality of multimedia analysis results, by consecutively (1) combining analysis results effectively, (2) predicting which results might need improvement, and (3) invoking compatible analysis methods to retrieve new results. By using semantic descriptions for the Web services that wrap the multimedia analysis methods, compatible services can be automatically selected. By using additional semantic reasoning on these semantic descriptions, the different services can be repurposed across different use cases. We evaluated this problem-agnostic framework in the context of video face detection, and showed that it is capable of providing the best analysis results regardless of the input video. The proposed methodology can serve as a basis to build a generic multimedia annotation platform, which returns reliable results for diverse multimedia analysis problems. This allows for better metadata generation, and improves the efficient retrieval of multimedia resources.
Please use this url to cite or link to this publication:
author
organization
year
type
journalArticle (original)
publication status
published
subject
keyword
Multimedia analysis, Web services, Reasoning cycle, Semantic reasoning, WEB SERVICES
journal title
MULTIMEDIA TOOLS AND APPLICATIONS
Multimed. Tools Appl.
volume
75
issue
22
pages
14019 - 14038
publisher
SPRINGER
place of publication
DORDRECHT
Web of Science type
Article
Web of Science id
000386775500002
JCR category
COMPUTER SCIENCE, THEORY & METHODS
JCR impact factor
1.53 (2016)
JCR rank
45/104 (2016)
JCR quartile
2 (2016)
ISSN
1380-7501
DOI
10.1007/s11042-014-2445-9
language
English
UGent publication?
yes
classification
A1
copyright statement
I have transferred the copyright for this publication to the publisher
id
8202549
handle
http://hdl.handle.net/1854/LU-8202549
date created
2016-12-02 14:05:23
date last changed
2017-04-27 08:40:15
@article{8202549,
  abstract     = {Thanks to ubiquitous Web connectivity and portable multimedia devices, it has never been so easy to produce and distribute new multimedia resources such as videos, photos, and audio. This ever-increasing production leads to an information overload for consumers, which calls for efficient multimedia retrieval techniques. Multimedia resources can be efficiently retrieved using their metadata, but the multimedia analysis methods that can automatically generate this metadata are currently not reliable enough for highly diverse multimedia content. A reliable and automatic method for analyzing general multimedia content is needed. We introduce a domain-agnostic framework that annotates multimedia resources using currently available multimedia analysis methods. By using a three-step reasoning cycle, this framework can assess and improve the quality of multimedia analysis results, by consecutively (1) combining analysis results effectively, (2) predicting which results might need improvement, and (3) invoking compatible analysis methods to retrieve new results. By using semantic descriptions for the Web services that wrap the multimedia analysis methods, compatible services can be automatically selected. By using additional semantic reasoning on these semantic descriptions, the different services can be repurposed across different use cases. We evaluated this problem-agnostic framework in the context of video face detection, and showed that it is capable of providing the best analysis results regardless of the input video. The proposed methodology can serve as a basis to build a generic multimedia annotation platform, which returns reliable results for diverse multimedia analysis problems. This allows for better metadata generation, and improves the efficient retrieval of multimedia resources.},
  author       = {De Meester, Ben and Verborgh, Ruben and Pauwels, Pieter and De Neve, Wesley and Mannens, Erik and Van de Walle, Rik},
  issn         = {1380-7501},
  journal      = {MULTIMEDIA TOOLS AND APPLICATIONS},
  keyword      = {Multimedia analysis,Web services,Reasoning cycle,Semantic reasoning,WEB SERVICES},
  language     = {eng},
  number       = {22},
  pages        = {14019--14038},
  publisher    = {SPRINGER},
  title        = {Towards robust and reliable multimedia analysis through semantic integration of services},
  url          = {http://dx.doi.org/10.1007/s11042-014-2445-9},
  volume       = {75},
  year         = {2016},
}

Chicago
De Meester, Ben, Ruben Verborgh, Pieter Pauwels, Wesley De Neve, Erik Mannens, and Rik Van de Walle. 2016. “Towards Robust and Reliable Multimedia Analysis Through Semantic Integration of Services.” Multimedia Tools and Applications 75 (22): 14019–14038.
APA
De Meester, Ben, Verborgh, R., Pauwels, P., De Neve, W., Mannens, E., & Van de Walle, R. (2016). Towards robust and reliable multimedia analysis through semantic integration of services. MULTIMEDIA TOOLS AND APPLICATIONS, 75(22), 14019–14038.
Vancouver
1.
De Meester B, Verborgh R, Pauwels P, De Neve W, Mannens E, Van de Walle R. Towards robust and reliable multimedia analysis through semantic integration of services. MULTIMEDIA TOOLS AND APPLICATIONS. DORDRECHT: SPRINGER; 2016;75(22):14019–38.
MLA
De Meester, Ben, Ruben Verborgh, Pieter Pauwels, et al. “Towards Robust and Reliable Multimedia Analysis Through Semantic Integration of Services.” MULTIMEDIA TOOLS AND APPLICATIONS 75.22 (2016): 14019–14038. Print.