Adobe reveales experimental AI tool to generates music from text

This week, Adobe announced an experimental audio AI tool that complements Photoshop’s image-based tools. Adobe’s Project Music GenAI Control is an “initial generative AI music generation and editing tool,” according to the company, that lets you create music (and other audio) from text prompts and adjust them in the same interface.

Unlike generated audio experiments like Google’s MusicLM, Adobe goes a step further and eliminates the hassle of outputting and moving it for editing in external apps like Pro Tools, Logic Pro, and GarageBand. Firefly-based technology is your creative ally. “Instead of manually cutting existing music to make intros, outros, and background audio, Project Music GenAI Control could help users to create exactly the pieces they need—solving workflow pain points end-to-end” Adobe wrote in an announcement blog post.

The business advises laying a foundation of text inputs such as “sad jazz,” “happy dance,” or “powerful rock.” From there, you can add more cues to change the song’s length, tempo, structure, and repetition, increase it, remix whole sections, or make loops. According to the business, it can even transform audio by using a reference melody as a guide.

Adobe says the music created is safe for commercial use. It also integrates content credentials (a “nutrition label” for the generated content) in an attempt to make the AI-powered nature of the masterpiece transparent.

“One of the exciting things about these new tools is that they aren’t just about generating audio—they’re taking it to the level of Photoshop by giving creatives the same kind of deep control to shape, tweak, and edit their audio. It’s a kind of pixel-level control for music,” Nicholas Bryan, an Adobe Research scientist, wrote.

The Carnegie Mellon University School of Computer Science and the University of California, San Diego are partners in the research. The experimental aspect of Project Music GenAI Control was highlighted in Adobe’s release. (The video above doesn’t show off much of its interface, which suggests it might not have a user interface that faces consumers yet.) Therefore, it’s possible that you’ll have to wait before the feature (supposedly) becomes available in Adobe Creative Cloud.