|MPEG SMR reference page
MPEG Symbolic Music Representation, standard
music notation into MPEG as shown in the logo
Please contact: Pierfrancesco Bellini, Paolo Nesi (DSI)
last change: 24-06-2008
The music market is currently
characterized by several products that present some form of integration
of music notation/representation and multimedia (see some examples in
and also on slides). For
the area of music education (integrating multimedia), music management
library (integrating with multimedia for navigation and for
karaoke (synchronisation based integration), etc.
The integration of music notation in
MPEG can cover the needs of these tools and much more adding:
porting them on i-TV and on mobiles, supporting scalability of format
complexity, etc., permitting to these tools to integrate the powerful
for the multimedia modeling and play.
The integration of music notation with
MPEG will open the way for a large number of new applications and
instance the: multimedia electronic lecterns, music education via i-TV,
multimedia content integrated with music notation on piano keyboards,
PDAs, etc. This action will increase the present market for music
notation integrating it with that of Multimedia and Entertainment. The
present market of Music Notation is mainly dominated by sheet
production for professional and educational purposes, and may open the
create very interesting new applications, renewing present applications
already use some integration between multimedia and music notation on slides.
The support of the whole MPEG specification will of course not be
to be compliant with the resulting SMR standard. MPEG provides a
profiling mechanism which allows defining suitable technology subsets
for a well specified application domain, i.e. Profiles; a subset may
range from a very limited number of tools (SMR only + necessary systems
info) to a very large one (covering a large spectrum in multimedia
functionality), provided an evidence from the industry in terms of
planned products and business.
FCD version of the standard and many new information about SMR model and usage :
- FCD version of the symbolic music representation standard: w8632-MPEG-SMR-part-23-rev-public.pdf
- The final and full version of the MPEG-SMR standard can be acquired from ISO. It includes both specification on paper and source code of the MPEG SMR decoder.
- Other applications of MPEG SMR have been developed by the authors of this we page, please contact them to get updated information.
- LINK to IEEE Multimedia article on Symbolic Music Representation in MPEG: other links:
- Demonstration Tools -- CLICK HERE to GET MPEG-4 Player with SMR decoder including--
- Link to MPEG SMR technology description on MEPG site: decription of MPEG SMR technology
- usage of MPEG SMR in the IMAESTRO tools: MPEG SMR for IMAESTRO , MPEG SMR overview
- usage of MPEG SMR into MAX/MSP tool: MPEG SMR for IMAESTRO ,
- usage of MPEG SMR for cooeprative work on Music editing : MPEG SMR for IMAESTRO , I-Maestro MED overview
- Demonstration Tools --
- Music Editor based on MPEG SMR format, for PC, Windows, Stand alone
- Music Viewer based on MPEG SMR format, for PC, Windows, Stand alone
- Extended Music Editor, the socalled WEDELMUSIC Editor, for Windows, Stand alone
- several examples of Coded Music in MPEG SMR
- Music Editor into MAX/MSP for MPEG SMR, based on MED tool
- MED: Music Editor and viewer based on MPEG SMR for MAX/MSP
- MUCS: Cooperative work support for MAX/MSP also for MED
- Cooperative tools and support for MAX/MSP
- Chord editor in MPEG SMR format
SO/IEC 14496-23:200x specifies Symbolic Music Representation (SMR). A symbolic representation of music is a logical structure based on: (i) symbolic elements representing audiovisual events, (ii) the relationship between those events, and (iii) aspects related to how those events can be rendered (visually as music notation or audibly) and synchronized with other media types.
The Symbolic Music Representation enables the development of a huge number of completely new applications in several domains of entertainment, edutainment, infotainment, etc., from education and distance learning, to rehearsal and musical practice at home, from consumer electronics like set-top boxes for interactive TV to personal computers and mobiles systems. The SMR may be used to represent many kinds of symbolic music including different styles of Chant, Renaissance, Classic, Romantic and 20th Century styles, Korean notation, simplified notations for children, Braille, etc..
ISO/IEC 14496-23 specifies (Public version only as a DRAFT: w8632-MPEG-SMR-part-23-rev-public.pdf)
- the syntax and semantics of the SMR bitstream;
- Symbolic Music Extensible Format (SM-XF) an XML based language used to encode musical scores as main scores, single parts and the associated lyrics;
- Symbolic Music Synchronization Information (SM-SI) describing the synchronisation information between the SMR elements and the other audiovisual elements
- Symbolic Music Formatting Language (SM-FL) an XML based language used to define the rendering rules that are applied to the SMR XML format for rendering it.
MPEG-4 technology covers a huge media domain through the concept of synthetic and natural hybrid coding (SNHC) audio, and "symbolic" audio (like e.g. MIDI) content can be rendered and synchronised with other forms of media: images, video, graphic animations, etc. It further allows structured descriptions of audio content through a normative algorithmic description language associated with a score language more flexible than the MIDI protocol (MPEG-4 Structured Audio, SA). All these tools, though allowing to derive in someway a symbolic representation out of the information they carry, are to a large extent not enough to guarantee a correct coding of music notation as they lack for instance all kind of information about visual and graphic aspects, many symbolic details, a thorough music notation modelling, and many necessary hooks for a correct human-machine interaction. MPEG-7 also provides some symbolic music related descriptors; but they are not meant to be a means of coding symbolic music representation as a form of content. On the other hand, MPEG SMR content stream contains a complete Symbolic Music Representation. It may be rendered in synchronisation with other audio-visual elements, video, audio, images, animations, 2D and 3D scenes, etc.
MPEG SMR permits the realization of new applications in which multimedia and music notation may take advantage and enrich each other in terms of functionalities. For example in the areas of edutainment, entertainment, courseware production, music notation subtitles during concerts and operas, music rendering in archives, piano keyboards with symbolic music representation and audiovisual capabilities, mobile devices with music display capabilities, etc.
The tool represented in the last image is a real tool realised with MPEG-4 BIFS and the MPEG SMR decoder, you can download it HERE. You can access to the MPEG SMR decoder source code by means of accessing to the MPEG SMR standard. The source code of the decoder is part of the MPEG SMR standar. In addition, other tools for authoring SMR and using MPEG SMR are also available for free such as: editor, authoring tools, viewer tools for using SMR into Active X, viewer and editor tools to use SMR into MAX/MSP.
(ad hoc group) has been created by MPEG on the basis of the request of
of the MUSICNETWORK
which is a large network in which are present more than 850
more than 400 institutions and companies, among these more than 250
registration to this MPEG AHG on SMR is free of charge, and to the
free of charge Please follow the instructions reported below. .
passed on the reflector from
its start up to 04-07-27, eudora
format, history of the emails passed on the reflector, list. It is
readable text, the list of the emails in EUDORA can
be read also with a text editor such as NOTEPAD, etc. The EUDORA can be
downloaded and installed for free.
- report on all
the ACTIVITY Performed since the beginning: MUSICNETWORK-MusicNotationReport-V2-1-Public-ver.pdf
Music Representation and Multimedia
permits the encoding of multimedia content, including many
different kinds of object types and a scene description allowing
synchronization among them and specifying object composition rules.
is for MPEG-compatible technology to support symbolic representations
(Symbolic Music Representation) synchronized with other MPEG object
same time, MPEG tools do not include yet a systematic support of
symbolic forms of music representations. Symbolic music representation
multi-layered piece of information, which may be used for a wide range
different purposes: from coding and entertainment to music sheet
music teaching, music analysis, content query, provision of enhanced or
music for consumers with specific needs, etc. It is understood that
Music Representation in this document means all kinds of symbolic music
including different styles of Chant, Renaissance, Classic, Romantic and
Century styles, simplified notations for children, Braille and other
to be considered.
Symbolic representations of music have a
logical structure consisting of: symbolic elements that represent
events; the relationship between those events; and aspects of rendering
events. There are many symbolic representations
of music including different styles of Chant, Renaissance, Classic,
Jazz, Rock, Pop, and 20th Century styles, percussion
well as simplified notations for children, Braille, etc.
music-related software and hardware products are currently
available in the market. Some integrate symbolic representations of music with
multimedia content. Examples include:
training, performance training
and theory training
for music management in libraries (music tools integrating
multimedia for navigation and for synchronization),
for entertainment (mainly synchronization between sound, text
and symbolic information),
keyboards with symbolic music representation and audiovisual
devices with music display and editing capabilities.
products generally utilize proprietary and incompatible
technologies. Therefore content must be recreated for each product, and
information exchange between products is difficult if not impossible.
of standardized tools to enable the symbolic representation of music
each developer implementing their own solution. These solutions will
necessarily vary in efficiency, scope, features, quality, and
MPEG Symbolic Music Representation (SMR) will
enable the synchronization
of symbolic music elements with audio-visual events that are
rendered using existing MPEG technology.
breadth of MPEG standards for multimedia representation, coding, and
playback, when integrated with symbolic representations of music will
content interoperability and an efficient high quality, peer reviewed,
standardized toolset for developers of these products. This will open
for a large number of new applications with increased power and
well as new markets for these kinds of applications. The repercussions
a wide effect on music education, music entertainment and on the
music as a whole.
be compliant with the MPEG SMR standard will not require compliance
with all MPEG-4 standards. In MPEG, there are mechanisms to cope with
complexity of the standard by means of Profiles.
If you have intention to respond with your valuable work at the call
for proposal, you an do it even if your solution does not meet all
requirements. The process for the standardisation will take into
account any valuable solutions to identify that an be more attractive
for the market and better solve the problem posed: MUSIC and MULTIMEDIA
INTEGRATION for educational, cultural, archival acpplications and
This means that if you have a market valuable solution please verify it
against the call for proposal and interact with us in order to adjust
the Call to make it more general to cover more cases and thus to make
it more acceptable as a world wide standard.
working with the AHG is
important for your business
The requirements developed should be
taken into account for producing a call for technology for including a
Music Notation Model into MPEG,
in addition, they could be used for determining the criteria for
assessing the proposals, to verify that the potential standard meets
the specified requirements, and to specify the conformance point for
the standard. If you have tools that use similar technology:
You are surely interested in working
with the AHG in MPEG to guarantee that your needs will be included into
the MPEG standard, and thus that the tools that you are developing and
delivering will be compliant with the standard. This is also a strong
advance since your tools could be integrated in several multimedia
aplications from I-TV, PDA players, Piano Keyboards, etc., and if you
are an integrator you will have the possibility of selecting among
several different standard implementations of Music Notation Decoders,
all compliant with the same Music Notation format.
People acknowledgments in the
order of writing:
- Music notation format
- music notation decoder (formatter of music notation, piano roll,
braille production, etc.)
This list has been started since 03-11-17.
- Jerome Barthelemy, IRCAM, France
Selfridge-Field, Stanford, US
- James Ingram, Germany
- Jacques Steyn, Monash University, South Africa
- Stuart Cunningham, University of Wales / NEWI
- Paolo Nesi, MUSICNETWORK, University of Florence, Italy
- Pierfrancesco Bellini, MUSICNETWORK, University of Florence, Italy
- Giorgio Zoia, EPFL, Switzerland
- David Crombie, FNB, The Netherlands
- Marius Spinu, EXITECH, Italy
- Francesco Spadoni, RIGEL, CLEVER, Italy
- Kia Ng, University of Leeds, UK
Tillman Weyde, Research Department of Music and Media
Technology, University of Osnabrueck, Germany
Stefan Morent, Department of Musicology/Computer Science,
University of Tuebingen, Germany
- Maurizio Campanai, EXITECH, Italy
- Giuseppe Nicotra, ARCA, Italy
To be included in the list
please send an email to firstname.lastname@example.org explicitely requesting to
make your name and company visible.
To be in the list means to support the activity of the work of the AHG
for the introduction of the Music Notation into the MPEG:
Some links to related tools/products and company (in alphabetic
- Berlioz http://www.berlioz.tm.fr
, music editor
- Finale, CODA, MakeMusic, music editor and educational tools
- Graphire Music press, http://www.graphire.com
- Igor, NOTEHEADS, http://www.noteheads.com
Music editor, music sheets, ...
- MIDIllustrator: MidiIllustrator
Music Notation Software: Print, Practice and Play Midi Sheet Music,
MidiIllustrator is music notation software: Notate, print, practice
& play free Midi sheet music. Bring your favorite songs to life.
Convert 1000s of Midi & Karaoke files freely available on the World
Wide Web into dynamic, interactive scores. User friendly learning
tools boost your musical abilities. Learn new music step by step, sight
reading notes from the staff OR without reading a note using lead
sheets with chord notation, guitar frets & the on-screen piano.
- Mozart http://www.mozart.co.uk ,
music editor, ...
- MusEdit http://www.musedit.com
- MUSICALIS, music editor and educational tools
- MusicXML, interchange
- Nightingale http://www.ngale.com/
- SIBELIUS, music editor and
- Vivaldi, Opus, Amadeus http://www.vivaldistudio.com ,
Music editor, OMR, educational tools, music
- WEDELMUSIC: Web Delivering of Music
Scores, EXITECH, music editor, multimedia integration and
- Capella, music editor and educational
optical music recognition tool
- SharpEye: optical music recognition tool
- SCORE: http://ace.acadiau.ca/score/LINKS3.HTM,
Some referred Projects and tools:
Some Links to Music Learning tools
Links to list of Music Notation resources
music notation, library, SMDL, http:// projects.fnb.nl
- CCARH and MuseData: http://musedata.stanford.edu/databases/index.html
- CUIDADO: Processing of Music and
- HARMONICA, network http://projects.fnb.nl/harmonica
- IMUTUS: Interactive music tuition
- MOODS: Music Object
Oriented Distributed System
- MUSICWEB educational, teaching, object
oriented, CORBA. Computer aided music education http://sun1.rrzn.uni-hannover.de/musicweb
Multimedia Streaming of Interactive Content Across Mobile Networks, http://musical.intranet.gr
- NIFF, http://www.musitek.com/niff.html
- OPENDRAMA: music tools for opera show, http://www.opendrama.com
- SMDL, a closed ISO Standard
- Variations 2 at the Indiana University - Bloomington http://www.dml.indiana.edu/.
- MUSITECH project: http://musitech.fmt.uos.de at
the University of Osnabrueck, department of Music and Media Technology http://www.fmt.uos.de
list of Working Group on Music Notation of MUSICNETWORK. The
addition of new document can be done by all MUSICNETWORK
page contains also a list of examples of music notation, just to show
which are the most relevant requirements for music notation modeling at
structural level. This is very interesting for modeing the logical part
of music notation. The addition/upload of new documents can be done by
all MUSICNETWORK Participants, the registration is free and can be
poerformed via the main www site of the network.
- Music Notation Codes: http://www.music-notation.info/en/compmus/notationformats.html,
- Notation Scoreing Zone,
- MusicMoz, http://musicmoz.org/Computers/Software/Notation/
- AudioMIDI, http://www.audiomidi.com/software/notation.cfm
- DMOZ: http://dmoz.org/Computers/Multimedia/Music_and_Audio/Software/Notation/
- Music Notation and Engraving, http://www2.coloradocollege.edu/dept/MU/Musicpress/Default.htm
Information in Musicology and Desktop Publishing, Music Notation
example of the most frequend hardness,
http://www.ccarh.org/publications/reprints/ieee/ by Eleanor
Selfridge-Field and Edmund Correia, Jr.
- MML http://www.musicmarkup.info/ MML (Music
- An article
on music notation XML for interchange format
- An article from IRCAM on Music
Notation aspects and Synchronisation (mention of the AHG activities) mn-req-alignment.pdf
- music notation glossary, from David
Pawson, RNIB: http://www.dpawson.co.uk/smrf/
- virginia tech glossary of Music
of music notation
http://www.interactivemusicnetwork.org/glossary/, thanks to Giuseppe
Please send to us any other links to tools, organisations, formats,
etc. that can be useful for providing information in this sector.
service provided by http://www.digits.com/
return to the Nesi's Home