|
-
MPEG SMR standard
-
music notation into MPEG as shown in the logo
-
|
Please contact:
Pierfrancesco Bellini, Paolo Nesi (DSI)
last change: 24-06-2008
The music market is currently characterized by several products that present some form of integration of music notation/representation and multimedia (see some examples in the
following, and also on
slides). For example in the area of music education (integrating multimedia), music management in library (integrating with multimedia for navigation and for synchronisation), karaoke (synchronisation based integration), etc.
The integration of music notation in MPEG can cover the needs of these tools and much more adding: interoperability, porting them on i-TV and on mobiles, supporting scalability of format complexity, etc., permitting to these tools to integrate the powerful MPEG model for the multimedia modeling and play.
The integration of music notation with MPEG will open the way for a large number of new applications and markets, for instance the: multimedia electronic lecterns, music education via i-TV, multimedia content integrated with music notation on piano keyboards, mobiles, PDAs, etc. This action will increase the present market for music notation integrating it with that of Multimedia and Entertainment. The present market of Music Notation is mainly dominated by sheet production for professional and educational purposes, and may open the path to create very interesting new applications, renewing present applications that already use some integration between multimedia and music notation on
slides.
The support of the whole MPEG specification will of course not be necessary to be compliant with the resulting SMR standard. MPEG provides a profiling mechanism which allows defining suitable technology subsets for a well specified application domain, i.e. Profiles; a subset may range from a very limited number of tools (SMR only + necessary systems info) to a very large one (covering a large spectrum in multimedia functionality), provided an evidence from the industry in terms of planned products and business.
-
FCD version of the standard and many new information about SMR model and usage :
-
LINK to IEEE Multimedia article on Symbolic Music Representation in MPEG: other links:
-
usage of MPEG SMR in the IMAESTRO tools: MPEG SMR for IMAESTRO , MPEG SMR overview
-
usage of MPEG SMR into MAX/MSP tool: MPEG SMR for IMAESTRO ,
-
usage of MPEG SMR for cooeprative work on Music editing : MPEG SMR for IMAESTRO , I-Maestro MED overview
-
Demonstration Tools --< >NEW!! version (June 2008) of the MPEG-SMR tools <!-- -->old version CLICK HERE to GET THE INSTALLABLE FILE including ---:<!-- -->Music Editor based on MPEG SMR format, for PC, Windows, Stand alone
-
Music Viewer based on MPEG SMR format, for PC, Windows, Stand alone
-
Extended Music Editor, the socalled WEDELMUSIC Editor, for Windows, Stand alone
-
several examples of Coded Music in MPEG SMR
-
Music Editor into MAX/MSP for MPEG SMR, based on MED tool
-
MED: Music Editor and viewer based on MPEG SMR for MAX/MSP
-
MUCS: Cooperative work support for MAX/MSP also for MED
-
Cooperative tools and support for MAX/MSP
-
Chord editor in MPEG SMR format
-
w8632-MPEG-SMR-part-23-rev-public.pdf
-
SO/IEC 14496-23:200x specifies Symbolic Music Representation (SMR). A symbolic representation of music is a logical structure based on: (i) symbolic elements representing audiovisual events, (ii) the relationship between those events, and (iii) aspects related to how those events can be rendered (visually as music notation or audibly) and synchronized with other media types.
-
The Symbolic Music Representation enables the development of a huge number of completely new applications in several domains of entertainment, edutainment, infotainment, etc., from education and distance learning, to rehearsal and musical practice at home, from consumer electronics like set-top boxes for interactive TV to personal computers and mobiles systems. The SMR may be used to represent many kinds of symbolic music including different styles of Chant, Renaissance, Classic, Romantic and 20th Century styles, Korean notation, simplified notations for children, Braille, etc..
-
ISO/IEC 14496-23 specifies (Public version only as a DRAFT: w8632-MPEG-SMR-part-23-rev-public.pdf)
-
the syntax and semantics of the SMR bitstream;
-
Symbolic Music Extensible Format (SM-XF) an XML based language used to encode musical scores as main scores, single parts and the associated lyrics;
-
Symbolic Music Synchronization Information (SM-SI) describing the synchronisation information between the SMR elements and the other audiovisual elements
-
Symbolic Music Formatting Language (SM-FL) an XML based language used to define the rendering rules that are applied to the SMR XML format for rendering it.
-
MPEG-4 technology covers a huge media domain through the concept of synthetic and natural hybrid coding (SNHC) audio, and "symbolic" audio (like e.g. MIDI) content can be rendered and synchronised with other forms of media: images, video, graphic animations, etc. It further allows structured descriptions of audio content through a normative algorithmic description language associated with a score language more flexible than the MIDI protocol (MPEG-4 Structured Audio, SA). All these tools, though allowing to derive in someway a symbolic representation out of the information they carry, are to a large extent not enough to guarantee a correct coding of music notation as they lack for instance all kind of information about visual and graphic aspects, many symbolic details, a thorough music notation modelling, and many necessary hooks for a correct human-machine interaction. MPEG-7 also provides some symbolic music related descriptors; but they are not meant to be a means of coding symbolic music representation as a form of content. On the other hand, MPEG SMR content stream contains a complete Symbolic Music Representation. It may be rendered in synchronisation with other audio-visual elements, video, audio, images, animations, 2D and 3D scenes, etc.
-
MPEG SMR permits the realization of new applications in which multimedia and music notation may take advantage and enrich each other in terms of functionalities. For example in the areas of edutainment, entertainment, courseware production, music notation subtitles during concerts and operas, music rendering in archives, piano keyboards with symbolic music representation and audiovisual capabilities, mobile devices with music display capabilities, etc.
-
The tool represented in the last image is a real tool realised with MPEG-4 BIFS and the MPEG SMR decoder, you can download it HERE. You can access to the MPEG SMR decoder source code by means of accessing to the MPEG SMR standard. The source code of the decoder is part of the MPEG SMR standar. In addition, other tools for authoring SMR and using MPEG SMR are also available for free such as: editor, authoring tools, viewer tools for using SMR into Active X, viewer and editor tools to use SMR into MAX/MSP.
-
FAQ:
-
This AHG (ad hoc group) has been created by MPEG on the basis of the request of members of the MUSICNETWORK which is a large network in which are present more than 850 participants and more than 400 institutions and companies, among these more than 250 qualified.
-
The registration to this MPEG AHG on SMR is free of charge, and to the MUSICNETWORK is free of charge Please follow the instructions reported below. .
-
Emails passed on the reflector from its start up to 04-07-27, eudora format, history of the emails passed on the reflector, list. It is readable text, the list of the emails in EUDORA can be read also with a text editor such as NOTEPAD, etc. The EUDORA can be downloaded and installed for free.
-
report on all the ACTIVITY Performed since the beginning: MUSICNETWORK-MusicNotationReport-V2-1-Public-ver.pdf
-
-
Symbolic Music Representation and Multimedia
-
MPEG-4 permits the encoding of multimedia content, including many different kinds of object types and a scene description allowing precise synchronization among them and specifying object composition rules. This Call is for MPEG-compatible technology to support symbolic representations of music (Symbolic Music Representation) synchronized with other MPEG object types.
-
-
At the same time, MPEG tools do not include yet a systematic support of symbolic forms of music representations. Symbolic music representation is a multi-layered piece of information, which may be used for a wide range of different purposes: from coding and entertainment to music sheet production, music teaching, music analysis, content query, provision of enhanced or adapted music for consumers with specific needs, etc. It is understood that Symbolic Music Representation in this document means all kinds of symbolic music including different styles of Chant, Renaissance, Classic, Romantic and 20th Century styles, simplified notations for children, Braille and other forms yet to be considered.
-
-
Symbolic representations of music have a logical structure consisting of: symbolic elements that represent audiovisual events; the relationship between those events; and aspects of rendering those events. There are many symbolic representations of music including different styles of Chant, Renaissance, Classic, Romantic, Jazz, Rock, Pop, and 20th Century styles, percussion notation, as well as simplified notations for children, Braille, etc.
-
-
Many music-related software and hardware products are currently available in the market. Some integrate symbolic representations of music with multimedia content. Examples include:
-
· Interactive music tutorials
-
· Play training, performance training
-
· Ear training
-
· Compositional and theory training
-
· Multimedia music publication
-
· Software for music management in libraries (music tools integrating multimedia for navigation and for synchronization),
-
· Software for entertainment (mainly synchronization between sound, text and symbolic information),
-
· Piano keyboards with symbolic music representation and audiovisual capabilities,
-
· Mobile devices with music display and editing capabilities.
-
-
Current products generally utilize proprietary and incompatible technologies. Therefore content must be recreated for each product, and information exchange between products is difficult if not impossible. The lack of standardized tools to enable the symbolic representation of music results in each developer implementing their own solution. These solutions will necessarily vary in efficiency, scope, features, quality, and complexity.
-
-
MPEG Symbolic Music Representation (SMR) will enable the synchronization of symbolic music elements with audio-visual events that are represented and rendered using existing MPEG technology.
-
The breadth of MPEG standards for multimedia representation, coding, and playback, when integrated with symbolic representations of music will provide content interoperability and an efficient high quality, peer reviewed, standardized toolset for developers of these products. This will open the way for a large number of new applications with increased power and flexibility, as well as new markets for these kinds of applications. The repercussions may have a wide effect on music education, music entertainment and on the development of music as a whole.
-
-
To be compliant with the MPEG SMR standard will not require compliance with all MPEG-4 standards. In MPEG, there are mechanisms to cope with the complexity of the standard by means of Profiles.
-
-
If you have intention to respond with your valuable work at the call for proposal, you an do it even if your solution does not meet all requirements. The process for the standardisation will take into account any valuable solutions to identify that an be more attractive for the market and better solve the problem posed: MUSIC and MULTIMEDIA INTEGRATION for educational, cultural, archival acpplications and entertainment applications.
-
-
This means that if you have a market valuable solution please verify it against the call for proposal and interact with us in order to adjust the Call to make it more general to cover more cases and thus to make it more acceptable as a world wide standard.
-
-
WHY working with the AHG is important for your business
-
The requirements developed should be taken into account for producing a call for technology for including a Music Notation Model into MPEG,in addition, they could be used for determining the criteria for assessing the proposals, to verify that the potential standard meets the specified requirements, and to specify the conformance point for the standard. If you have tools that use similar technology:
-
Music notation format
-
music notation decoder (formatter of music notation, piano roll, braille production, etc.)
-
-
You are surely interested in working with the AHG in MPEG to guarantee that your needs will be included into the MPEG standard, and thus that the tools that you are developing and delivering will be compliant with the standard. This is also a strong advance since your tools could be integrated in several multimedia aplications from I-TV, PDA players, Piano Keyboards, etc., and if you are an integrator you will have the possibility of selecting among several different standard implementations of Music Notation Decoders, all compliant with the same Music Notation format.
-
-
People acknowledgments in the order of writing:
-
-
Jerome Barthelemy, IRCAM, France
-
Eleanor Selfridge-Field, Stanford, US
-
James Ingram, Germany
-
Jacques Steyn, Monash University, South Africa
-
Stuart Cunningham, University of Wales / NEWI
-
Paolo Nesi, MUSICNETWORK, University of Florence, Italy
-
Pierfrancesco Bellini, MUSICNETWORK, University of Florence, Italy
-
Giorgio Zoia, EPFL, Switzerland
-
David Crombie, FNB, The Netherlands
-
Marius Spinu, EXITECH, Italy
-
Francesco Spadoni, RIGEL, CLEVER, Italy
-
Kia Ng, University of Leeds, UK
-
Tillman Weyde, Research Department of Music and Media Technology, University of Osnabrueck, Germany
-
Stefan Morent, Department of Musicology/Computer Science, University of Tuebingen, Germany
-
Maurizio Campanai, EXITECH, Italy
-
Giuseppe Nicotra, ARCA, Italy
-
-
-
This list has been started since 03-11-17.
-
To be included in the list please send an email to nesi@dsi.unifi.itexplicitely requesting to make your name and company visible.
-
To be in the list means to support the activity of the work of the AHG for the introduction of the Music Notation into the MPEG:
-
-
-
Links:Some links to related tools/products and company (in alphabetic order):
-
Berlioz http://www.berlioz.tm.fr , music editor
-
Finale, CODA, MakeMusic, music editor and educational tools
-
Graphire Music press, http://www.graphire.com
-
Igor, NOTEHEADS, http://www.noteheads.com Music editor, music sheets, ...
-
MIDIllustrator: MidiIllustrator Music Notation Software: Print, Practice and Play Midi Sheet Music, http://www.MidiIllustrator.com MidiIllustrator is music notation software: Notate, print, practice & play free Midi sheet music. Bring your favorite songs to life. Convert 1000s of Midi & Karaoke files freely available on the World Wide Web into dynamic, interactive scores. User friendly learning tools boost your musical abilities. Learn new music step by step, sight reading notes from the staff OR without reading a note using lead sheets with chord notation, guitar frets & the on-screen piano.
-
Mozart http://www.mozart.co.uk , music editor, ...
-
MusEdit http://www.musedit.com
-
MUSICALIS, music editor and educational tools
-
MusicXML, interchange format
-
Nightingale http://www.ngale.com/
-
NoteAbility http://debussy.music.ubc.ca/~opus1/index.html
-
SIBELIUS, music editor and educational tools
-
Vivaldi, Opus, Amadeus http://www.vivaldistudio.com , Music editor, OMR, educational tools, music sheets
-
WEDELMUSIC: Web Delivering of Music Scores, EXITECH, music editor, multimedia integration and distribution
-
Capella, music editor and educational tools, http://www.whc.de/
-
MIDISCAN: optical music recognition tool
-
SmartScore:
-
SharpEye: optical music recognition tool
-
SCORE: http://ace.acadiau.ca/score/LINKS3.HTM, music editor
-
-
Some Links to Music Learning tools
Some referred Projects and tools:
-
CANTATE: music notation, library, SMDL, http:// projects.fnb.nl
-
CCARH and MuseData: http://musedata.stanford.edu/databases/index.html
-
CUIDADO: Processing of Music and Mpeg7: http://www.ircam.fr/produits/technologies/multimedia/cuidado-e.html
-
Guido http://www.informatik.tu-darmstadt.de/AFS/GUIDO/
-
HARMONICA, network http://projects.fnb.nl/harmonica
-
IMUTUS: Interactive music tuition system
-
MOODS: Music Object Oriented Distributed System
-
MUSICWEB educational, teaching, object oriented, CORBA. Computer aided music education http://sun1.rrzn.uni-hannover.de/musicweb
-
MUSICAL (eContent): Multimedia Streaming of Interactive Content Across Mobile Networks, http://musical.intranet.gr
-
NIFF, http://www.musitek.com/niff.html
-
OPENDRAMA: music tools for opera show, http://www.opendrama.com
-
SMDL, a closed ISO Standard
-
Variations 2 at the Indiana University- Bloomingtonhttp://www.dml.indiana.edu/.
-
Xemo project http://www.xemo.org
-
MUSITECH project: http://musitech.fmt.uos.de at the University of Osnabrueck, department of Music and Media Technology http://www.fmt.uos.de
-
Links to list of Music Notation resources
-
Document list of Working Group on Music Notation of MUSICNETWORK. The addition of new document can be done by all MUSICNETWORK Participants.The page contains also a list of examples of music notation, just to show which are the most relevant requirements for music notation modeling at structural level. This is very interesting for modeing the logical part of music notation. The addition/upload of new documents can be done by all MUSICNETWORK Participants, the registration is free and can be poerformed via the main www site of the network.
-
Music Notation Codes: http://www.music-notation.info/en/compmus/notationformats.html, http://www.music-notation.info/en/compmus/musicnotation.html , http://www.music-notation.info/,
-
Notation Scoreing Zone,http://www.synthzone.com/notation.htm
-
MusicMoz, http://musicmoz.org/Computers/Software/Notation/
-
AudioMIDI, http://www.audiomidi.com/software/notation.cfm
-
DMOZ: http://dmoz.org/Computers/Multimedia/Music_and_Audio/Software/Notation/
-
Music Notation and Engraving, http://www2.coloradocollege.edu/dept/MU/Musicpress/Default.htm
-
Musical Information in Musicology and Desktop Publishing, Music Notation example of the most frequend hardness, http://www.ccarh.org/publications/reprints/ieee/ by Eleanor Selfridge-Field and Edmund Correia, Jr.
-
MML http://www.musicmarkup.info/ MML (Music Markup Language)
-
An article on music notation XML for interchange format http://emusician.com/ar/emusic_xml_music/index.htm
-
An article from IRCAM on Music Notation aspects and Synchronisation (mention of the AHG activities) mn-req-alignment.pdf
-
music notation glossary, from David Pawson, RNIB:http://www.dpawson.co.uk/smrf/
-
virginia tech glossary of Music notation http://www.music.vt.edu/musicdictionary/
-
Glosasry of music notationhttp://www.interactivemusicnetwork.org/glossary/, thanks to Giuseppe Nicotra
References to Organisations:
Please send to us any other links to tools, organisations, formats, etc. that can be useful for providing information in this sector.