Web-based query engine for content-based and semantic retrieval of audio

Abstract

In this stirdv, we have developed a iveh-hased qiier?, engine called AudinCBR to enahle conrenr-bused arid semunlic queries 011 midito? data. The interface is ahle to uncwer the Qitery-by-E.rample (QBE) and te.rtrra1 qiieries us in truditional Information Retrieval (IR) s,vsterns. Tlie relevancef~edhack. which is missing in man,v similar .sv.stem.s. is also covered in oiir system. hi QBE queries, matching process is pef:formed based on pre-.selected law-level andio .featitres. which are standardized in MPEG-7 &rts. Semantic qireries are perfirmed in thefbrm c~/te.rtiial qneries bv tising /he ohjecl and event concepts, as i d 1 u.s their temporul and conceptid relationships ,for an audio. The originality of o w appruach 10 /he retrieval r-dies on the provided iiser inrerfhce, the,/orm o/descrip/ion, and the utilized data model. The mer intet-firce is an important aspect in emerging ,fields like audio IR to retrieve desired elements. Thewfore, we de.scrihe snme new graphical iiser interfaces /hat accommodate d(fferen/ modes of intermtion witli the iiser. I n nrder to e-rtrnct the andio .semantics and low-level .fiu/nre.s ,ftonr uti aiidio. an unllofutiorl tool i s int!-odlrced. Finalll’. %re gi1.e e.runl/,le.~ I?/ seninntic qnerie.s that oiir .s,v.stem .srippnrt.v’. Index Terms Audio annotation tool, audio data model, MPEC-7, query interface for audio-IR.