WP2 OMRAS2 Tools

This topic discusses OMRAS2 tools such as Feature Extraction, Indexing, Search and Visualization. These tools will be used as pluggable components for the core system infrastructure. They will be deployed as Web Services by the core infrastructure

Feature Extraction and Visualization

• Sonic Visualiser

Feature Database Management System

• AudioDB
• fftExtract

Collection Level User Interface

• Islands of Music
• OmrasNavigationAndSearch
• Musicovery
• Pandora
• LivePlasma
• Gnod (Music Map)
• Thoughts on Language based versus graphical interfaces

High Level Audio

• AudioFingerpinting^?
• AudioClassification
• SpeechVoiceTools
• RhythmicPattern
• MetricalAlignment^?
• MelodyLineExtraction
• BassLineExtraction^?
• MelodyRepetition^?
• HighLevelStructure^?

Audio Formats

One of the problems is going to be handling a range of different audio formats such as : WMA, MP3, AAC, etc.

We might adopt a Common Audio Format that should be:

• Cross Platform XP/Debian/OSX
• Amenable to Digital Rights Management (DRM)
• Lossless but able to hold compressed streams
• 24 bit or higher bit depth
• At least 44.1kHz sample rate
• Able to embed metadata such as MPEG7 and/or ID3
• Non-proprietary

(Sounds like Ogg+FLAC to me - cc)

Symbolic Processing Tools

• ScoreAudioAlignment^?
• SymbolicStructureExtraction^?
• SymbolicMelodyExtraction^?
• SymbolicBassExtraction^?
• SymbolicPitchClassProfiles^?
• SymbolicHarmonyExtraction

Indexing and Search Tools

Low Level Feature Indexing Tools

• LocalitySensitiveHashing
• KdTrees^?

Audio Retrieval Tools

• HashBasedRetrieval^?

#Taxonomy

Taxonomy Tools

• MPEG7MultimediaDescriptionSchemes
• XMLSpyTool^?
• Taxonomy API
• Ontology languages, OWL
• Protege (OWL ontology editor)
• SWI Prolog semantic web library
• Tabulator: a semantic-web browser
• Disco: an other semantic-web browser
• The Semantic Web Client Library
• Small SWI-Prolog Semantic Web Client

Paul Lamere's List of Tools

• The Tools We Use

-- MichaelCasey - 18 Jan 2007