Developed Prototypes

Technological Base

Musical Computer

In our research group, we use Information an Communications Technology (ICT) to provide the computers with Musical Intelligence and Creativity. With "computers" we mean not only personal computers but SmartPhones, iPhone/iPad/iPod, Tablets, video games consoles ...

Using Signal Processing and Machine Learning Techniques applied to the music (audio and scores), we extract relevant musical information and we can offer:

  • * New real time methods for playing and interacting with the sound of the music.
  • * Serious games for music learning.
  • * New methods and tools for music composition and musical creativity.
  • * New interfaces for musical content searching.
  • * Cultural heritage preservation

Here, you can see some examples of what the things we can do with our technology.

Interactivity with the sound of the music

The computer is able to "listen" to the music played by a real instrument. The interactivity is based on the sound of the played instrument.

Computer listening

Tool for the String quarter

we have developed a tool to violin, viola, cello and bass students. While the students are playing their classical instrument, using the regular mic of the computer, they can see in real time, the position of the finger of the left hand to know whether or not they are performing properly.

Violin Tool Cello Tool

Watch the video:



Play with my song

We have developed also tools for playing with singing voice!

Original song:

  • * Rumbator
  • You sing and we convert your song into flamenco style!

    Rumbator

    RUMBA!:

  • * Voice to musical instruments
  • ... or you can sound like a violin!

    VIOLIN!:

    ... or like a string quartet!

    STRING QUARTER!:

    ... or like any other instrument you may want!



Music Creation

We have also developed a system able to learn different music styles. The system learns the style and then it is able to compose music of that style.

Therefore, we can compose music for a video game free of royalties or we can compose music for learning music with different difficulty levels and much more!

Listen to the examples!

  • * Classic Piano Music
  • Piano Example 1:

    Piano Example 2:

  • * Flamenco Music
  • OLE!:

  • * Epic Music
  • EPIC:

  • * Scary Music
  • Beware!:

  • * Music for learning
  • Easy level:

    Advanced level:



Optical Music Recognition

We not only provide the computer with the capacity of listening to the music. We also provide them with the capacity of reading scores!

OMR tool

For example, we have developed software able to read ancient scores.

OMR tool

Here you can see an example of an ancient score preserved at the "Archivo de la Catedral de Málaga". You can see the original scores, the transcribed one in both ancient and modern notation and ... you can listen to it!

OMR tool

AUDIO:



New interfaces for musical content searching

We have developed a system for music visualization based on the characteristics of the music: melody, chords, rythm... Each songs is a world. The position of the songs in the 3D space is related to all these characteristics. If two songs are close to each other that means that they are somehow related and they are similar.

3D visualization of songs