SpudTV
Our BCI activity in Petamedia NOE is in the SpuDTV Field trial. Five research groups from Switzerland, UK, Germany and Netherlands are working in this project. Ashkan Yazdani is the coordinator of this field trial. More information regarding to this activity can be found here.
Basic information
- Title: PetaMedia (Peer-to-Peer Tagged Media)
- Duration: 42 months from March 2008
- Funding: 7th European Frame Programme (EU FP7)
- Website: http://www.petamedia.eu
Objectives
The PETAMEDIA NoE aims at fostering international collaborative research in the areas of multimedia content analysis (MCA) and social and peer-to-peer (SP2P) networks by coordinating the research activities among partner countries, so as to establish a European network composed of national networks, while enabling as well the participation of specific additional interested partners. PETAMEDIA is so composed of four core partners known for their proven track record and coming from four different European states, complemented by four strong national networks and by the interested partners, cf. the figure below. The final purpose of the consortium is to establish a sustainable European virtual centre of excellence connecting thematically interested research groups throughout Europe.
Research activities
The collective research effort will be directed towards integration of existing MCA and SP2P technologies, and towards identification and exploration of potentials and limitations of MCA/SP2P combinations. A particular scientific challenge is the synergetic combination of user-based collaborative tagging, peer-to-peer networks and multimedia content analysis. Solutions and collaborative research field trials will be built on the coordinating partner’s open source P2P software Tribler. These field trials are large scale experiments involving real users, who aim at evaluating two aspects, namely:
- New technological contributions to merging automated video content analysis and user-based tagging in a P2P network structure;
- Perception of users of this new form of collaboration in a social network structure build on top of a P2P network structure.
In particular, the Joint Program on Research Activities aims at integrating the research of the partners along following activities:
- Development of the technology roadmap and integrated architecture;
- Research on the future of the SP2P/MCA combination;
- Experiments investigating validity and performance of the new SP2P/MCA paradigm;
and on largely disseminating the results achieved in the frame of the cooperation.
Partnership
PetaMedia brings the four national networks in the Netherlands, Switzerland, UK and Germany together:
- NL: Netherlands Institute for Research on ICT (NIRICT)
- CH: Interactive Multimodal Information Management (IM2)
- UK: Multimedia Knowledge Management network (MMKM)
- DE: Human-Centric Communication Cluster (HC3)
The core partners are the representatives of their own national networks:
- Delft University of Technology (TUD)
- Swiss Federal Institute of Technology in Lausanne (EPFL)
- Queen Mary University of London (QMUL)
- Technical University of Berlin (TUB)
Selected organizations within the national networks are called network partners. In addition, several interested ad-hoc partners are participating in PetaMedia.
Events
- 2010 Spring School on Social Media Retrieval (S3MR) (lectures available)
- 2010 MediaEval
- 2011 Summer School on Social Media Retrieval (S3MR)
Results and resources
EPFL Balelec dataset for PetaMedia community
- Video data [dataset]
Object duplicate detection in images
- Object duplicate detection method (presented at WIAMIS’09) [paper]
- Analysis of object duplicate detection (presented at MIPR’09) [paper]
- Robust object duplicate detection (published in IJMDEM) [paper]
- Omnidirectional detection (to be presented at DSPW’11) [paper]
Object duplicate detection in video
- 3D object duplicate detection (presented at WIAMIS’10) [paper]
Tag propagation
- Tag propagation system [demo] [YouTube video 1] [YouTube video 2] [YouTube video 3] [YouTube video 4] [YouTube video 5] [YouTube video 6]
- Semi-automatic image annotation via tag propagation (presented at ACM MIR’10) [paper] [poster]
- Geotag propagation (presented at SPIE’10) [paper] [slides]
- Geotag propagation based on user trust modeling (published in MTAP) [paper] [slides]
Social game for photo album summarization
- Social game “Epitome” [demo] [presentation] [YouTube video 1] [YouTube video 2] [YouTube video 3]
- Photo album summarization through social game “Epitome” (presented at ACM MM’10) [paper] [poster] [slides]
- Comparison between social game “Epitome” and automatic visual analysis (presented at ICME’11) [paper]
- Epitomize your photos (published in IJCGT) [paper]
Subjective evaluation of scalable video coding
Implicit emotional tagging
SpudTV- recognition of affect induced by music video
- Classification of EEG and physiological signals (presented at BI’10) [paper]