What does the music of the future sound like, between artificial intelligence and human sensibility

What does the music of the future sound like, between artificial intelligence and human sensibility

Culture & lifestyle · ·

Composed by artificial intelligence, listened to on streaming, experienced in virtual reality, performed by holograms, paid for with bitcoin. The music of the future is already here.

Creating art and composing music through artificial neural networks and algorithms, yet with the same sensibility as a human being, is no longer a utopia. When we think of artificial intelligence, we most often associate it with activities in which humans can easily be replaced by machines: manual labour, tasks requiring complex calculations, or data optimisation. In reality, the creative industry too benefits from the potential offered by AI, particularly in musical composition. And so here we are, surrounded by film and video game soundtracks and Spotify playlists, all composed by computers, that sound surprisingly good and, above all, indistinguishable from human works.

Raffigurazione di intelligenza artificiale
The music of the future is composed by artificial intelligence

Artificial intelligence and the music of the future

Less than two years after its founding, a Luxembourg-based startup managed to launch Aiva (Artificial Intelligence Virtual Artist), the first virtual composer of classical and symphonic music to be registered with a collective copyright management society (Sacem, the French equivalent of Siae). The artificial intelligence, programmed by the two brothers and computer engineers Pierre and Vincent Barreau, is capable of composing original pieces based on the scores of the greatest composers — such as Mozart, Bach, Beethoven and Vivaldi — and could, in future, complete unfinished works such as Schubert's Symphony No. 8.

Gli startupper Pierre e Vincent Barreau hanno lanciato l'intelligenza artificiale Aiva
Brothers Pierre and Vincent Barreau, the creators of the artificial intelligence Aiva © Anna Katina

However, for the Barreau brothers human-machine interaction remains fundamental, to the extent that they rely on professional musicians to verify the learning parameters of their algorithm before each recording. Human input is also required during orchestration, arrangement and production, and thanks to this Aiva has already released an album, Genesis, music for piano and orchestra.

The technology behind Aiva is based on deep learning algorithms, a type of machine learning in which multiple artificial neural networks interact — that is, systems that mimic the workings of the human brain. Using the algorithms developed by the Barreau brothers, Aiva analyses more than 15,000 digitised musical scores, generating a mathematical and intuitive model of music that is used to write new compositions. The pieces thus obtained can be performed by real, live musicians, or through the less costly VST technology or virtual studio technology.

"To create Aiva we drew inspiration from Spike Jonze's science fiction film Her," Pierre tells the Luxembourg Chamber of Commerce. "The film tells the story of the evolution of an artificially intelligent operating system, capable of experiencing human emotions. In an important scene, Her (the voice of the operating system that falls in love with its user, ed.) whispers into the protagonist's ear: 'Let me compose a piece of music for you!'".

Joaquin Phoenix protagonista del film Lei (Her) fissa lo schermo del suo computer
A scene from Spike Jonze's 2013 film Her, which inspired the creation of Aiva

For years, artificial intelligence has been used for musical composition, sometimes with modest commercial success. Last summer, American actress Taryn Southern, who was launched by the talent show American Idol and became a YouTube star, made her debut with the pop album I AM AI, entirely composed, played and produced by the open-source programme Amper, while the singer's contribution was limited to the arrangements and vocals.

https://youtu.be/XUs6CznN8pw"]https://www.youtube.com/watch?time_continue=2&v=sRudUWG7e7A&has_verified=1

As widely advertised, I AM AI is not the first album made with artificial intelligence. Experiments with computer-generated music date back to the mid-1950s, from the first algorithmic composition Illiac Suite by Lejaren Hiller to the piece Push Button Bertha as the result of research conducted by Martin Klein and Douglas Bolitho. Pioneer Brian Eno, who has composed several albums of "generative music", has been producing computer-generated music since the 1990s. "It will creep into our sector like any other music," he once said on the subject, "but we have to take it into account and understand that the new possibilities outweigh the disruptive effects."

https://youtu.be/LSHZ_b05W7o"]https://www.youtube.com/watch?time_continue=2&v=sRudUWG7e7A&has_verified=1

In 2016, the AI system developed by Sony, Flow Machines, built the track Daddy's Car based solely on Beatles songs. The same system then created an entire album, Hello World, curated by French composer Benoit Carré under the pseudonym SKYGGE, which involved numerous artists including Kiesza and Stromae, and by scientist François Pachet, who recently became director of Spotify's technology research laboratory dedicated to the discovery of new musical genres.

Daniel Ek fondatore e CEO di Spotify a New York nel 2015
Daniel Ek, CEO and founder of Spotify © Andrew Burton/Getty Images

The music of the future is not owned, it is listened to on streaming

In a liquid society such as ours, music consumption is no longer identified with the material ownership of a record — save for the re-emergence of niche phenomena of reappropriation, such as vinyl — but in the sharing and somewhat distracted, almost always prompted, listening to individual songs or playlists on streaming. And, as in musical composition, artificial intelligence also dominates online consumption. Digital platforms offering streaming services develop extremely effective algorithms, with data-processing formulas based on users' listening habits that bring them ever closer to those users' tastes, suggesting personalised new music or artists they don't know and will, in all likelihood, enjoy.

Rappresentazione rapporto uomo-macchina
Human-artificial intelligence interaction © Getty Images

Queen of online streaming platforms, ten years after its launch and from its dominant position, Spotify boasts over 140 million users in 61 countries, including 70 million subscribers (premium users) who pay almost ten euros a month to listen, without limits or adverts, to 30 million tracks. Figures that leave direct competitors such as Apple Music, Amazon and Deezer in the dust. While Spotify's imminent stock market listing is seen by potential investors as a giant question mark, Daniel Ek's creation still has work to do in building an ecosystem that inspires confidence in record labels and, above all, in artists — as Thom Yorke and Geoff Barrow of Portishead have repeatedly complained — guaranteeing them greater profit margins. For now, however, it is also the only service on which the music industry pins its hopes of survival.

Sistema VR
Oculus Rift virtual reality system © Tim P. Whitby/Getty Images for Westfield

At concerts with virtual and augmented reality

Technology is also shaping the way music is experienced from the perspective of the live event, thanks to virtual reality and augmented reality, which are becoming ever more immersive and accessible. By wearing masks and sensory gloves, the objects placed in three-dimensional environments, sensations of balance and other physiological factors are perceived as real. From Google to Magic Leap, virtual reality has already moved beyond the boundaries of hearing and sight, offering fully interactive experiences. Concerts become personal, songs become true events in their own right, and listeners become active participants.

As in 2016, when the celebrated Queen track Bohemian Rhapsody was transformed into an app. After all, the band's guitarist Brian May is a declared enthusiast of VR technology, to the extent of having launched his own line of headsets, while Björk too has accustomed us to immersing ourselves in her 3D world. A number of artists now work with virtual or augmented reality developers and 3D mapping to create memorable musical experiences, taking fans to spectacular locations without requiring them to travel, or inviting them on stage to play alongside them.

La vocaloid Hatsune Miku è una cantante virtuale
Hatsune Miku in 2017 in Chiba, Japan. The virtual singer developed by the music technology company Crypton Future Media is known the world over © Taro Karibe/Getty Images

Today performers do not necessarily need to be present or even alive to play on a stage, as the holograms of Tupac, Michael Jackson and Gorillaz have demonstrated. The animated avatar's co-creator, Jamie Hewlett, told the Daily Star that he and Damon Albarn are becoming "too old" for Gorillaz, but the show will be able to go on without them. Almost thirty years after his death, Roy Orbison, the man behind Oh, Pretty Woman, is about to go on tour with the Royal Philharmonic Orchestra. One of the most famous pop stars in Japan, meanwhile, is Hatsune Miku, a humanoid singer who does not exist, yet has been churning out hits for ten years and could, following her collaboration with Pharrell Williams, be the star of other high-profile duets.

Bitcoin e blockchain
Visual representation of the bitcoin cryptocurrency © Dan Kitwood/Getty Images

Who will exchange music in bitcoin?

It is a great temptation for the entire music industry: the possibility of carrying out transactions on the web without bank intermediation, but through the blockchain. This computing technology — a chain of successive blocks that record transactions in cryptocurrencies such as bitcoin — could be used to compare rights databases in real time, highlight any conflicts and improve the efficiency of collective management organisations, guaranteeing more money for creators and rights holders. Provided, that is, that the information about them and about the recordings is known and accurate.

In the pop world, particularly among rappers, the race to cryptocurrencies began years ago, well before they exploded in all their volatility. In 2014, 50 Cent put his fifth album, Animal Ambition, on sale in bitcoin, unwittingly taking in 700, the present-day equivalent of around eight million dollars. Last November, Björk began selling her album Utopia in bitcoin and three other minor digital cryptocurrencies. An open bet, still entirely to be played out.