News

Deep learning can fool listeners by imitating any guitar amplifier

A study from the Aalto Acoustics Lab demonstrates that digital simulations of guitar amplifiers can sound just like the real thing. The implications are that as the software models continue to improve, they can replace traditional analogue guitar amplifiers, which are bulky, fragile and expensive.
Testing guitar signals at the Aalto Acoustics Lab
Testing guitar signals at the Acoustics Lab

Many popular guitar amplifiers and distortion effects are based on analogue circuitry. To achieve the desired distortion of the guitar signal, these circuits use nonlinear components, such as vacuum tubes, diodes, or transistors. As music production becomes increasingly digitised, the demand for faithful digital emulations of analogue audio effects is increasing.  

Professor Vesa Välimäki explains that this is an exciting development in deep learning, ‘Deep neural networks for guitar distortion modelling has been tested before, but this is the first time, where blind-test listeners couldn’t tell the difference between a recording and a fake distorted guitar sound! This is akin to when the computer first learned to play chess’. 

The main objective of the field of Virtual Analog (VA) modelling is to create digital emulations of these analogue systems which will allow bulky, expensive and fragile analogue equipment to be replaced by software plugins that can be used on a modern desktop or laptop computer.  

A specific amplifier’s circuitry can be accurately simulated using circuit modelling techniques, but the result is often a model that is too computationally demanding for real-time processing. Additionally, a new model has to be created for each amplifier being modelled, and the process is labour intensive.

A basic schematic of the guitar signal between the neural net and amplifier

An alternative approach for VA modelling is “black-box” modelling. Black-box modelling is based on measuring the circuit’s response to some input signals and creating a model which replicates the observed input-output mapping. The study from which these results came, was based on the WaveNet convolutional neural network. 

The digital amplifier model is created using a deep neural network. Audio is recorded from a ’target ’guitar amplifier, and this audio is used to train the deep neural network to simulate that guitar amplifier. 

Alec Wright, a doctoral student, focusing on audio processing using deep learning says,’ The tests were conducted to validate the performance of models emulating either the Blackstar HT5 Metal or Mesa Boogie Express 5:50+ tube amplifiers. The models were created with a focus on real-time performance, and all of them can be run in real-time on a desktop computer’. 

All of this means that in the near future, all a guitarist will need to do is plug into their laptop that is running the deep neural plugin, and a thoroughly convincing vintage guitar amp sound will come from the speakers.  

It remains to be seen if guitar amplifier purists will be willing to part with their beloved rigs, but this innovation paves the way for any audio enthusiast to digitally get the desired guitar sound, whether it be a Marshall, Orange, Fender, or anything else, on the road or in the studio.  

Read the paper here: https://www.mdpi.com/2076-3417/10/3/766

More information

Study Acoustics and Audio Technology at Aalto University

Three Aalto University students working in a acoustics laboratory

Acoustics and Audio Technology - Computer, Communication and Information Sciences, Master of Science (Technology)

The major in Acoustics and Audio Technology equips students with a fundamental understanding of human hearing, audio perception, and physics of sound. The skills they acquire enable, for example, reducing noise pollution, planning harmonic environments and designing coherent sound experiences.

Study options
  • Published:
  • Updated:

Read more news

From left: Taras Redchuk, Chris Hayes, Aakeel Wagay, Ada Pajari, Dan Noel, Eveliny Nery and Jarno Mäkelä. Photo: Mikko Raskinen.
Appointments Published:

‘Off to a flying start’ – a new research team explores bacteria that thrive in extreme conditions

Jarno Mäkelä joined Aalto’s Department of Neuroscience and Medical Engineering as Assistant Professor of Biophysics in early September, together with research fellow Taras Redchuk, postdoctoral researchers Dan Noel, Eveliny Nery, doctoral researchers Ada Pajari and Aakeel Wagay, and research assistant Chris Hayes. They were accompanied by equipment, funding from the Academy of Finland and an ERC Starting Grant from the European Research Council.
Aalto Industrial Internet Campus
Cooperation, Research & Art Published:

The physical and digital worlds of production and internal logistics meet in a multidisciplinary TwinFlow project

Researchers from Aalto University and the University of Tampere are collaborating with companies to accelerate the data-driven business in the manufacturing industry. The joint three-year project is funded by Business Finland.
Eloi Moliner IWAENC-tapahtumassa.
Awards and Recognition Published:

Best Student Paper Award for Eloi Moliner – again!

The award-winning paper shows how speech recordings can be improved by removing the room reverberation effect using unsupervised machine learning
Map screenshot from mappingmanuscriptmigrations.org web service by Semantic Computing Research group at Aalto University
Research & Art Published:

Aalto computer scientists in SEMANTiCS 2024

Scientists from the Department of Computer Science in the International Conference on Semantic Systems.