AN INVESTIGATION INTO THE USES OF MACHINE LEARNING FOR ELECTRONIC SOUND SYNTHESIS

  • Laurence Metters

Student thesis: ResM

Abstract

This thesis presents an investigation into the uses of machine learning and artificial intelligence for electronic sound synthesis, specifically the creation of new synthesised sounds for composition and research. Using the Magenta Labs Neural Synthesizer (NSynth), a synthesis tool that uses deep neural networks to generate new sounds based on data input from electronic synthesizers, this research project aimed to produce a system where bespoke synthesizers could be used to produce interesting sound combinations consisting of approaches to electronic sound synthesis that would not conventionally be used together. Combinations of different approaches to electronic sound synthesis produced interesting results when choices were made based on sonic characteristics of individual synthesisers, such as the plucked timbres of a Karplus-Strong synthesizer and the smooth extended notes of a frequency modulation synthesizer. In this thesis, contextual information into both electronic sound synthesis including justification for the use of each synthesis method as well as an investigation into Artificial Intelligence(AI) and machine learning techniques relevant to the use of the NSynth has also been carried out with the intention of producing an informed and researched final product in the form of a composition. The summary of this research project culminated in a final composition utilising the sound samples produced by the NSynth, arranged into a piece inspired by computer music research compositions including John Chowning’s ‘Stria’ and ‘Switched on Bach’ by Wendy Carlos. The synthesizers in this research project were produced in Max and designed with specific sonic qualities of the instruments in mind, with versatility to produce more samples following the same process for further research and application by other composers inspired by the work. The resulting composition included a number of interesting sounds with plenty of variation in sonic qualities that resembled computer music composition as well as standard western composition, demonstrating the versatility of the concept of using AI and bespoke synthesisers to create new and interesting sounds.
Date of Award2021
Original languageEnglish
Awarding Institution
  • University of Plymouth
SupervisorEduardo Miranda (Other Supervisor)

Keywords

  • Artificial Intelligence
  • AI
  • Computer Music
  • Music
  • Neural network
  • Electronic Sound Synthesis

Cite this

'