Have you ever wondered what it would sound like if you could turn any text into music? What if you could create your own songs by simply typing in some words or phrases? Well, now you can, thanks to Riffusion, a new web app that uses artificial intelligence to generate music from text.
Riffusion is based on a neural network called Stable Diffusion, which can create realistic images from text prompts. Riffusion fine-tunes this model to generate images of spectrograms, which are visual representations of sound. These spectrograms can then be converted into audio clips using a technique called Griffin-Lim algorithm.
The result is a novel and fun way to explore the possibilities of music generation with AI. You can type in any text you want, such as a genre, a mood, a theme, or even a combination of them, and Riffusion will produce a unique musical piece for you. You can also modify existing sounds by providing an image of a spectrogram and a new text prompt. For example, you can change the instrument, the style, or the tempo of a sound clip.
Riffusion was created by Seth Forsgren and Hayk Martiros as a hobby project. They are both passionate about music and AI, and wanted to share their work with the world. You can learn more about Riffusion and how it works on their website or on their GitHub page. You can also join their Discord community to chat with other users and share your creations.
Riffusion is not only a fun and creative tool, but also a potential source of inspiration and learning for musicians, composers, producers, and anyone interested in music and AI. You can experiment with different genres, styles, moods, and sounds, and discover new musical ideas. You can also learn about spectrograms, diffusion models, audio processing, and other concepts related to music generation with AI.
If you are curious about Riffusion and want to try it out for yourself, you can visit their web app and start typing in some text. You will be amazed by what Riffusion can do with just a few words. Riffusion is a new way to generate music with AI that is easy, fun, and exciting. Give it a try today and see what you can create!
