
|
MPEG SMR reference page
MPEG Symbolic Music Representation, standard
music notation into MPEG as shown in the logo
|
Please contact: Pierfrancesco Bellini, Paolo Nesi (DSI)
last change: 24-06-2008
The music market is currently
characterized by several products that present some form of integration
of music notation/representation and multimedia (see some examples in
the following,
and also on slides). For
example in
the area of music education (integrating multimedia), music management
in
library (integrating with multimedia for navigation and for
synchronisation),
karaoke (synchronisation based integration), etc.
The integration of music notation in
MPEG can cover the needs of these tools and much more adding:
interoperability,
porting them on i-TV and on mobiles, supporting scalability of format
complexity, etc., permitting to these tools to integrate the powerful
MPEG model
for the multimedia modeling and play.
The integration of music notation with
MPEG will open the way for a large number of new applications and
markets, for
instance the: multimedia electronic lecterns, music education via i-TV,
multimedia content integrated with music notation on piano keyboards,
mobiles,
PDAs, etc. This action will increase the present market for music
notation integrating it with that of Multimedia and Entertainment. The
present market of Music Notation is mainly dominated by sheet
production for professional and educational purposes, and may open the
path to
create very interesting new applications, renewing present applications
that
already use some integration between multimedia and music notation on slides.
The support of the whole MPEG specification will of course not be
necessary
to be compliant with the resulting SMR standard. MPEG provides a
profiling mechanism which allows defining suitable technology subsets
for a well specified application domain, i.e. Profiles; a subset may
range from a very limited number of tools (SMR only + necessary systems
info) to a very large one (covering a large spectrum in multimedia
functionality), provided an evidence from the industry in terms of
planned products and business.
FCD version of the standard and many new information about SMR model and usage :
- FCD version of the symbolic music representation standard: w8632-MPEG-SMR-part-23-rev-public.pdf
- The final and full version of the MPEG-SMR standard can be acquired from ISO. It includes both specification on paper and source code of the MPEG SMR decoder.
- Other applications of MPEG SMR have been developed by the authors of this we page, please contact them to get updated information.
- LINK to IEEE Multimedia article on Symbolic Music Representation in MPEG: other links:
- Demonstration Tools -- CLICK HERE to GET MPEG-4 Player with SMR decoder including--
- Link to MPEG SMR technology description on MEPG site: decription of MPEG SMR technology
- usage of MPEG SMR in the IMAESTRO tools: MPEG SMR for IMAESTRO , MPEG SMR overview
- usage of MPEG SMR into MAX/MSP tool: MPEG SMR for IMAESTRO ,
- usage of MPEG SMR for cooeprative work on Music editing : MPEG SMR for IMAESTRO , I-Maestro MED overview
- Demonstration Tools --
- Music Editor based on MPEG SMR format, for PC, Windows, Stand alone
- Music Viewer based on MPEG SMR format, for PC, Windows, Stand alone
- Extended Music Editor, the socalled WEDELMUSIC Editor, for Windows, Stand alone
- several examples of Coded Music in MPEG SMR
- Music Editor into MAX/MSP for MPEG SMR, based on MED tool
- MED: Music Editor and viewer based on MPEG SMR for MAX/MSP
- MUCS: Cooperative work support for MAX/MSP also for MED
- Cooperative tools and support for MAX/MSP
- Chord editor in MPEG SMR format
- w8632-MPEG-SMR-part-23-rev-public.pdf
SO/IEC 14496-23:200x specifies Symbolic Music Representation (SMR). A symbolic representation of music is a logical structure based on: (i) symbolic elements representing audiovisual events, (ii) the relationship between those events, and (iii) aspects related to how those events can be rendered (visually as music notation or audibly) and synchronized with other media types.
The Symbolic Music Representation enables the development of a huge number of completely new applications in several domains of entertainment, edutainment, infotainment, etc., from education and distance learning, to rehearsal and musical practice at home, from consumer electronics like set-top boxes for interactive TV to personal computers and mobiles systems. The SMR may be used to represent many kinds of symbolic music including different styles of Chant, Renaissance, Classic, Romantic and 20th Century styles, Korean notation, simplified notations for children, Braille, etc..
ISO/IEC 14496-23 specifies (Public version only as a DRAFT: w8632-MPEG-SMR-part-23-rev-public.pdf)
- the syntax and semantics of the SMR bitstream;
- Symbolic Music Extensible Format (SM-XF) an XML based language used to encode musical scores as main scores, single parts and the associated lyrics;
- Symbolic Music Synchronization Information (SM-SI) describing the synchronisation information between the SMR elements and the other audiovisual elements
- Symbolic Music Formatting Language (SM-FL) an XML based language used to define the rendering rules that are applied to the SMR XML format for rendering it.
MPEG-4 technology covers a huge media domain through the concept of synthetic and natural hybrid coding (SNHC) audio, and "symbolic" audio (like e.g. MIDI) content can be rendered and synchronised with other forms of media: images, video, graphic animations, etc. It further allows structured descriptions of audio content through a normative algorithmic description language associated with a score language more flexible than the MIDI protocol (MPEG-4 Structured Audio, SA). All these tools, though allowing to derive in someway a symbolic representation out of the information they carry, are to a large extent not enough to guarantee a correct coding of music notation as they lack for instance all kind of information about visual and graphic aspects, many symbolic details, a thorough music notation modelling, and many necessary hooks for a correct human-machine interaction. MPEG-7 also provides some symbolic music related descriptors; but they are not meant to be a means of coding symbolic music representation as a form of content. On the other hand, MPEG SMR content stream contains a complete Symbolic Music Representation. It may be rendered in synchronisation with other audio-visual elements, video, audio, images, animations, 2D and 3D scenes, etc.
MPEG SMR permits the realization of new applications in which multimedia and music notation may take advantage and enrich each other in terms of functionalities. For example in the areas of edutainment, entertainment, courseware production, music notation subtitles during concerts and operas, music rendering in archives, piano keyboards with symbolic music representation and audiovisual capabilities, mobile devices with music display capabilities, etc.
The tool represented in the last image is a real tool realised with MPEG-4 BIFS and the MPEG SMR decoder, you can download it HERE. You can access to the MPEG SMR decoder source code by means of accessing to the MPEG SMR standard. The source code of the decoder is part of the MPEG SMR standar. In addition, other tools for authoring SMR and using MPEG SMR are also available for free such as: editor, authoring tools, viewer tools for using SMR into Active X, viewer and editor tools to use SMR into MAX/MSP.
FAQ:
- This
AHG
(ad hoc group) has been created by MPEG on the basis of the request of
members
of the MUSICNETWORK
which is a large network in which are present more than 850
participants and
more than 400 institutions and companies, among these more than 250
qualified.
- The
registration to this MPEG AHG on SMR is free of charge, and to the
MUSICNETWORK is
free of charge Please follow the instructions reported below. .
- Emails
passed on the reflector from
its start up to 04-07-27, eudora
format, history of the emails passed on the reflector, list. It is
readable text, the list of the emails in EUDORA can
be read also with a text editor such as NOTEPAD, etc. The EUDORA can be
downloaded and installed for free.
- report on all
the ACTIVITY Performed since the beginning: MUSICNETWORK-MusicNotationReport-V2-1-Public-ver.pdf
Symbolic
Music Representation and Multimedia
MPEG-4
permits the encoding of multimedia content, including many
different kinds of object types and a scene description allowing
precise
synchronization among them and specifying object composition rules.
This Call
is for MPEG-compatible technology to support symbolic representations
of music
(Symbolic Music Representation) synchronized with other MPEG object
types.
At the
same time, MPEG tools do not include yet a systematic support of
symbolic forms of music representations. Symbolic music representation
is a
multi-layered piece of information, which may be used for a wide range
of
different purposes: from coding and entertainment to music sheet
production,
music teaching, music analysis, content query, provision of enhanced or
adapted
music for consumers with specific needs, etc. It is understood that
Symbolic
Music Representation in this document means all kinds of symbolic music
including different styles of Chant, Renaissance, Classic, Romantic and
20th
Century styles, simplified notations for children, Braille and other
forms yet
to be considered.
Symbolic representations of music have a
logical structure consisting of: symbolic elements that represent
audiovisual
events; the relationship between those events; and aspects of rendering
those
events. There are many symbolic representations
of music including different styles of Chant, Renaissance, Classic,
Romantic,
Jazz, Rock, Pop, and 20th Century styles, percussion
notation, as
well as simplified notations for children, Braille, etc.
Many
music-related software and hardware products are currently
available in the market. Some integrate symbolic representations of music with
multimedia content. Examples include:
·
Interactive
music tutorials
·
Play
training, performance training
·
Ear
training
·
Compositional
and theory training
·
Multimedia
music publication
·
Software
for music management in libraries (music tools integrating
multimedia for navigation and for synchronization),
·
Software
for entertainment (mainly synchronization between sound, text
and symbolic information),
·
Piano
keyboards with symbolic music representation and audiovisual
capabilities,
·
Mobile
devices with music display and editing capabilities.
Current
products generally utilize proprietary and incompatible
technologies. Therefore content must be recreated for each product, and
information exchange between products is difficult if not impossible.
The lack
of standardized tools to enable the symbolic representation of music
results in
each developer implementing their own solution. These solutions will
necessarily vary in efficiency, scope, features, quality, and
complexity.
MPEG Symbolic Music Representation (SMR) will
enable the synchronization
of symbolic music elements with audio-visual events that are
represented and
rendered using existing MPEG technology.
The
breadth of MPEG standards for multimedia representation, coding, and
playback, when integrated with symbolic representations of music will
provide
content interoperability and an efficient high quality, peer reviewed,
standardized toolset for developers of these products. This will open
the way
for a large number of new applications with increased power and
flexibility, as
well as new markets for these kinds of applications. The repercussions
may have
a wide effect on music education, music entertainment and on the
development of
music as a whole.
To
be compliant with the MPEG SMR standard will not require compliance
with all MPEG-4 standards. In MPEG, there are mechanisms to cope with
the
complexity of the standard by means of Profiles.
If you have intention to respond with your valuable work at the call
for proposal, you an do it even if your solution does not meet all
requirements. The process for the standardisation will take into
account any valuable solutions to identify that an be more attractive
for the market and better solve the problem posed: MUSIC and MULTIMEDIA
INTEGRATION for educational, cultural, archival acpplications and
entertainment applications.
This means that if you have a market valuable solution please verify it
against the call for proposal and interact with us in order to adjust
the Call to make it more general to cover more cases and thus to make
it more acceptable as a world wide standard.
WHY
working with the AHG is
important for your business
The requirements developed should be
taken into account for producing a call for technology for including a
Music Notation Model into MPEG,
in addition, they could be used for determining the criteria for
assessing the proposals, to verify that the potential standard meets
the specified requirements, and to specify the conformance point for
the standard. If you have tools that use similar technology:
- Music notation format
- music notation decoder (formatter of music notation, piano roll,
braille production, etc.)
You are surely interested in working
with the AHG in MPEG to guarantee that your needs will be included into
the MPEG standard, and thus that the tools that you are developing and
delivering will be compliant with the standard. This is also a strong
advance since your tools could be integrated in several multimedia
aplications from I-TV, PDA players, Piano Keyboards, etc., and if you
are an integrator you will have the possibility of selecting among
several different standard implementations of Music Notation Decoders,
all compliant with the same Music Notation format.
People acknowledgments in the
order of writing:
- Jerome Barthelemy, IRCAM, France
- Eleanor
Selfridge-Field, Stanford, US
- James Ingram, Germany
- Jacques Steyn, Monash University, South Africa
- Stuart Cunningham, University of Wales / NEWI
- Paolo Nesi, MUSICNETWORK, University of Florence, Italy
- Pierfrancesco Bellini, MUSICNETWORK, University of Florence, Italy
- Giorgio Zoia, EPFL, Switzerland
- David Crombie, FNB, The Netherlands
- Marius Spinu, EXITECH, Italy
- Francesco Spadoni, RIGEL, CLEVER, Italy
- Kia Ng, University of Leeds, UK
-
Tillman Weyde, Research Department of Music and Media
Technology, University of Osnabrueck, Germany
-
Stefan Morent, Department of Musicology/Computer Science,
University of Tuebingen, Germany
- Maurizio Campanai, EXITECH, Italy
- Giuseppe Nicotra, ARCA, Italy
This list has been started since 03-11-17.
To be included in the list
please send an email to nesi@dsi.unifi.it explicitely requesting to
make your name and company visible.
To be in the list means to support the activity of the work of the AHG
for the introduction of the Music Notation into the MPEG:
Links:
Some links to related tools/products and company (in alphabetic
order):
- Berlioz http://www.berlioz.tm.fr
, music editor
- Finale, CODA, MakeMusic, music editor and educational tools
- Graphire Music press, http://www.graphire.com
- Igor, NOTEHEADS, http://www.noteheads.com
Music editor, music sheets, ...
- MIDIllustrator: MidiIllustrator
Music Notation Software: Print, Practice and Play Midi Sheet Music,
http://www.MidiIllustrator.com
MidiIllustrator is music notation software: Notate, print, practice
& play free Midi sheet music. Bring your favorite songs to life.
Convert 1000s of Midi & Karaoke files freely available on the World
Wide Web into dynamic, interactive scores. User friendly learning
tools boost your musical abilities. Learn new music step by step, sight
reading notes from the staff OR without reading a note using lead
sheets with chord notation, guitar frets & the on-screen piano.
- Mozart http://www.mozart.co.uk ,
music editor, ...
- MusEdit http://www.musedit.com
- MUSICALIS, music editor and educational tools
- MusicXML, interchange
format
- Nightingale http://www.ngale.com/
- NoteAbility
http://debussy.music.ubc.ca/~opus1/index.html
- SIBELIUS, music editor and
educational tools
- Vivaldi, Opus, Amadeus http://www.vivaldistudio.com ,
Music editor, OMR, educational tools, music
sheets
- WEDELMUSIC: Web Delivering of Music
Scores, EXITECH, music editor, multimedia integration and
distribution
- Capella, music editor and educational
tools, http://www.whc.de/
- MIDISCAN:
optical music recognition tool
- SmartScore:
- SharpEye: optical music recognition tool
- SCORE: http://ace.acadiau.ca/score/LINKS3.HTM,
music editor
Some Links to Music Learning tools
Some referred Projects and tools:
- CANTATE:
music notation, library, SMDL, http:// projects.fnb.nl
- CCARH and MuseData: http://musedata.stanford.edu/databases/index.html
- CUIDADO: Processing of Music and
Mpeg7: http://www.ircam.fr/produits/technologies/multimedia/cuidado-e.html
-
Guido http://www.informatik.tu-darmstadt.de/AFS/GUIDO/
- HARMONICA, network http://projects.fnb.nl/harmonica
- IMUTUS: Interactive music tuition
system
- MOODS: Music Object
Oriented Distributed System
- MUSICWEB educational, teaching, object
oriented, CORBA. Computer aided music education http://sun1.rrzn.uni-hannover.de/musicweb
- MUSICAL
(eContent):
Multimedia Streaming of Interactive Content Across Mobile Networks, http://musical.intranet.gr
- NIFF, http://www.musitek.com/niff.html
- OPENDRAMA: music tools for opera show, http://www.opendrama.com
- SMDL, a closed ISO Standard
- Variations 2 at the Indiana University - Bloomington http://www.dml.indiana.edu/.
- Xemo
project http://www.xemo.org
- MUSITECH project: http://musitech.fmt.uos.de at
the University of Osnabrueck, department of Music and Media Technology http://www.fmt.uos.de
Links to list of Music Notation resources
- Document
list of Working Group on Music Notation of MUSICNETWORK. The
addition of new document can be done by all MUSICNETWORK
Participants.The
page contains also a list of examples of music notation, just to show
which are the most relevant requirements for music notation modeling at
structural level. This is very interesting for modeing the logical part
of music notation. The addition/upload of new documents can be done by
all MUSICNETWORK Participants, the registration is free and can be
poerformed via the main www site of the network.
- Music Notation Codes: http://www.music-notation.info/en/compmus/notationformats.html,
http://www.music-notation.info/en/compmus/musicnotation.html
, http://www.music-notation.info/,
- Notation Scoreing Zone,
http://www.synthzone.com/notation.htm
- MusicMoz, http://musicmoz.org/Computers/Software/Notation/
- AudioMIDI, http://www.audiomidi.com/software/notation.cfm
- DMOZ: http://dmoz.org/Computers/Multimedia/Music_and_Audio/Software/Notation/
- Music Notation and Engraving, http://www2.coloradocollege.edu/dept/MU/Musicpress/Default.htm
- Musical
Information in Musicology and Desktop Publishing, Music Notation
example of the most frequend hardness,
http://www.ccarh.org/publications/reprints/ieee/ by Eleanor
Selfridge-Field and Edmund Correia, Jr.
- MML http://www.musicmarkup.info/ MML (Music
Markup Language)
- An article
on music notation XML for interchange format
http://emusician.com/ar/emusic_xml_music/index.htm
- An article from IRCAM on Music
Notation aspects and Synchronisation (mention of the AHG activities) mn-req-alignment.pdf
- music notation glossary, from David
Pawson, RNIB: http://www.dpawson.co.uk/smrf/
- virginia tech glossary of Music
notation http://www.music.vt.edu/musicdictionary/
- Glosasry
of music notation
http://www.interactivemusicnetwork.org/glossary/, thanks to Giuseppe
Nicotra
References to
Organisations:
Please send to us any other links to tools, organisations, formats,
etc. that can be useful for providing information in this sector.
service provided by http://www.digits.com/
return to the Nesi's Home
page.