Image sequence analysis for emerging interactive multimedia services - The European COST 211 framework

Download
1998-11-01
Alatan, Abdullah Aydın
WOLLBORN, MİCHAEL
MECH, RONALD
TUNCEL, ERTEM
Sikora, T
Flexibility and efficiency of coding, content extraction, and content-based search are key research topics in the field of interactive multimedia. Ongoing ISO MPEG-4 and MPEG-7 activities are targeting standardization to facilitate such services. European COST Telecommunications activities provide a framework for research collaboration. COST 211(bis) and COST 211(ter) activities have been instrumental in the definition and development of the ITU-T H.261 and H.263 standards for video-conferencing over ISDN and videophony ol er regular phone lines, respectively. The group has also contributed significantly to the ISO MPEG-4 activities. At present a significant effort of the COST 211(ter) group activities is dedicated toward image and video sequence analysis and segmentation-an important technological aspect for the success of emerging object-based MPEG-4 and MPEG-7 multimedia applications. The current work of COST 211 is centered around the test model, called the Analysis Model (AM), The essential feature of the AM is its ability to fuse information front different sources to achieve a high-quality object segmentation. The current information sources are the intermediate results from frame-based (still) color segmentation, motion vector based segmentation, and change-detection-based segmentation. Motion vectors, which form the basis for the motion vector based intermediate segmentation, are estimated from consecutive frames. A recursive shortest spanning tree (RSST) algorithm is used to obtain intermediate color and motion vector based segmentation results. A rule-based region processor fuses the intermediate results; a postprocessor further refines the final segmentation output. The results of the current AM are satisfactory; it is expected that there will be further improvements of the AM within the COST 211 project.
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY

Suggestions

Image segmentation with unified region and boundary characteristics within recursive shortest spanning tree
Esen, E.; Alp, Y. K. (2007-06-13)
The lack of boundary information in region based image segmentation algorithms resulted in many hybrid methods that integrate the complementary information sources of region and boundary, in order to increase the segmentation performance. In compliance with this trend, we propose a novel method to unify the region and boundary characteristics within the canonical Recursive Shortest Spanning Tree algorithm. The main idea is to incorporate the boundary information in the distance metric of RSST with minor cha...
Data science technology selection: development of a decision-making approach
Nazlıel, Kerem; Eren, Pekin Erhan; Kayabay, Kerem; Department of Information Systems (2022-12-29)
Developments in IT, Cloud, Analytics, and related fields have created an abundance of Data Science technologies for practitioners, developers, and organizations to use. This abundance and variety complicate the Data Science technology selection and management processes for the analytics teams. When teams select and use improper tools and technologies, they encounter problems and inefficiencies, also known as technical debt. As a remedy, this thesis proposes a systematic technology selection method consideri...
Adoption of online multimedia resources in a general chemistry laboratory course context: A case study
Tisoglu, Secil; Çağıltay, Kürşat; Kursun, Engin (2020-01-01)
Pre-laboratory practices and online pre-laboratory resources have been implemented in laboratory courses through various instructional approaches. This study seeks to elicit information about how online multimedia resources are embraced and used in the course system and which factors might affect the adoption of the resources in this context. This research was designed as a case study in order to explore the enablers and barriers of online multimedia resource adoption and associated problems in the system t...
Data integration over horizontally partitioned databases in service-oriented data grids
Sunercan, Hatice Kevser Sönmez; Çiçekli, Fehime Nihan; Alpdemir, Mahmut Nedim; Department of Computer Engineering (2010)
Information integration over distributed and heterogeneous resources has been challenging in many terms: coping with various kinds of heterogeneity including data model, platform, access interfaces; coping with various forms of data distribution and maintenance policies, scalability, performance, security and trust, reliability and resilience, legal issues etc. It is obvious that each of these dimensions deserves a separate thread of research efforts. One particular challenge among the ones listed above tha...
Streaming Multiscale Deep Equilibrium Models
Ertenli, Can Ufuk; Akbaş, Emre; Cinbiş, Ramazan Gökberk (2022-1-01)
We present StreamDEQ, a method that infers frame-wise representations on videos with minimal per-frame computation. In contrast to conventional methods where compute time grows at least linearly with the network depth, we aim to update the representations in a continuous manner. For this purpose, we leverage the recently emerging implicit layer models, which infer the representation of an image by solving a fixed-point problem. Our main insight is to leverage the slowly changing nature of videos and use the...
Citation Formats
A. A. Alatan, M. WOLLBORN, R. MECH, E. TUNCEL, and T. Sikora, “Image sequence analysis for emerging interactive multimedia services - The European COST 211 framework,” IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, pp. 802–813, 1998, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/48075.