Bio-Inspired Computing for Music Charles Martin - Univ. Oslo, Dept. - - PowerPoint PPT Presentation

▶

Jun 22, 2023 190 likes •453 views

Bio-Inspired Computing for Music Charles Martin - Univ. Oslo, Dept. Informatics https://folk.uio.no/charlepm https://charlesmartin.com.au But why?? Predictive Musical Interaction - How can musical instruments be more intelligent ? -

SLIDE 1

Bio-Inspired Computing for Music

SLIDE 2

Charles Martin - Univ. Oslo, Dept. Informatics

https://folk.uio.no/charlepm https://charlesmartin.com.au

SLIDE 3

But why??

SLIDE 4

Predictive Musical Interaction

How can musical instruments

be more “intelligent”?

What would that mean for

musicians, music making, and music?

microjam.info

SLIDE 5

Music and Research

we make new musical instruments, measure musical experiences, find new ways to express

urselves with technology.

Why?

Expression and creativity is important.
Music is everywhere; people care about it.
Music is hard; realtime, high standards.
It’s fun.

You don’t have to be a professional musician to do a great musical project!

SLIDE 6

Space: the final frontier. These are the voyages

SLIDE 7

Models

Then... Now...

SLIDE 8

Mozer (1994) Eck & Schmidhuber (2003)

Music Generation: Predicting note-by-note

Magenta (Google) 2016-2017

SLIDE 9

Representations of Music

Thin Medium? Thick

folkRNN Performance RNN WaveNet

SLIDE 10

Theme: Creative Machine Learning

Using Deep Learning to represent

and create music and art!

Compose music for video games?
Mobile apps that generate music

endlessly!

MIREX Competition Tasks - music

information retrieval

Techniques: Deep Learning,

Recurrent Networks, Convolutional Networks,

SLIDE 11

Theme: Intelligent Instruments

How can we integrate ML/AI into NIMEs?

Help users make better music.
“Guess” intentions (key, scale,

harmony).

Generate extra sounds (ensemble

experience) using ANNs or evolution.

Make sound/music in response to

sensors/cameras (sonification).

Challenge/fun here is interacting with

ML algorithms.

Data → ML → Interaction!

SLIDE 12

Theme: Embedded Instruments

Use microcontrollers /

single board computers to make stand-alone NIMEs

Includes prototyping,

hardware creation, programming.

Could be for augmented

instruments as well?

e.g.,

SLIDE 13

Theme: Social Music Making

How can music bring people together?

Make “ensemble” playing easier.
Instruments that change to

support “parts” in a group.

Asynchronous music making:

performing as a group via facebook or the web

SLIDE 14

SLIDE 15

SLIDE 16

Mixture Density RNN

SLIDE 17

SLIDE 18

SLIDE 19

Neural Touchscreen Ensemble

SLIDE 20

SLIDE 21

Neural iPad Ensemble

SLIDE 22

SLIDE 23

Embodied Musical Predictions

EMPI: Embodied Musical Predictive Instrument

SLIDE 24

RITMO: Centre for Interdisciplinary Studies in Rhythm, Time and Motion

SLIDE 25

MusicLab vol. 3: Rhythm

MusicLab Vol. 3 explores the phenomenon of rhythm

in music and in the body - all within MusicLab’s

unique blend of research and edutainment through and intellectual warm-up with world-leading experts, music-dance performances and data jockeying with

ur house DJ and anyone else interested.

Time and place: Nov. 15, 2018 7:00 PM, Escape, Ole Johan Dahls hus

https://www.hf.uio.no/ritmo/english/n ews-and-events/events/musiclab/201 8/rhythm/index.html