Fantasía #363

This project is generated from live code and contains animation with unique and infinite music. Activate the live view and press the space bar to begin playing.

“What you will see on the screen is a picture of the various abstract images that might pass through your mind if you sat in a concert hall listening to this music. At first, you are conscious of the piano. Then the music begins to suggest other kinds of things to your imagination. They might be… oh, just masses of color. Or they may be cloud forms… or great landscapes, or vague shadows… or geometrical objects floating in space.” — Fantasia (Walt Disney Productions, 1940)

A fantasia is a musical composition with a free form and often improvisatory style, seldom following the rules of any strict musical form. Fantasía (Alejandro Campos, 2024) is a generative experience born from a machine-generated musical score that informs the visual arrangement of constructed shapes, algorithmic textures, and emergent compositions. This series continues Campos’s ongoing attachment to playfulness, unencumbered acts of creativity, and the pursuit of capturing the joy of imagination.

In a unique blend of generative processes, Fantasía uses a machine learning model connected to an algorithmic process, producing both classical compositions and playful visuals – everything happening in-browser and in real-time. The music’s AI model is trained on a large dataset of classical performances, creating a piano sheet that – as long as Fantasía remains open – continues an infinite improvisation that’s unique to each of the works. Each piece’s score is also used by the generative algorithm to produce a visual counterpart, like a map that traces the movements of notes on canvas: the colors capturing the different moods of each type of score, and the geometries expressing the musical structures of each composition.

Seeing these artworks can evoke the experience of listening to the music once again, and with each deeper exploration of the algorithm’s range, comes familiarity with this new fantastical language. The eye moving between shapes, the drawings conveying their musical narrative – Fantasía hides nothing, as if speaking in universal gestures.

This series uses brush.js (a library developed and open-sourced by Campos, now working without p5), TensorFlow.js (an open-source ML platform for JavaScript), Magenta.js for generating music with Magenta models, Tone.js (a Web Audio framework for creating interactive music in the browser), and several other open-source MIT license libraries. The music plays with Tone Piano, a multisampled piano implementation using Salamander Grand Piano Sounds.

Created in collaboration with Adam Berninger of TENDER.