Adobe has revealed details of its new cutting-edge generative AI tools for creating and editing custom audio and music. The experimental work is being carried out by its Adobe Research section.
Project Music GenAI Control
Adobe describes Project Music GenAI Control as an early-stage generative AI music generation and editing tool. With the tool, you can generate music from text prompts. You also get fine-grained control to edit the audio to match your needs. Nicholas Bryan, Senior Research Scientist at Adobe Research, said “With Project Music GenAI Control, generative AI becomes your co-creator. It helps people craft music for their projects, whether they’re broadcasters, or podcasters, or anyone else who needs audio that’s just the right mood, tone, and length.”
Text prompt
As with Adobe’s Firefly Generative AI models, you begin using Project Music GenAI Control by entering a text prompt. Sample prompts shared by Adobe include “powerful rock,” “happy dance,” or “sad jazz.” The AI then generates music based on your input text. Once the tools have created your music, you can edit it with the tools integrated directly into the workflow.
Simple user interface
With Project Music GenAI Control’s simple user interface, you can transform your generated audio based on a reference melody. You can also adjust the tempo, structure and repeating patterns of your piece of music. In addition, you can choose when to increase and decrease the audio’s intensity. Other editing options include extending the length of a clip, re-mixing a section or even generating a seamlessly repeatable loop.
Deep control for music
Adobe’s aim is that Project Music GenAI Control will help you create exactly the pieces of music you need. This means you won’t have to manually cut existing music to make intros, outros and background audio. “One of the exciting things about these new tools is that they aren’t just about generating audio—they’re taking it to the level of Photoshop by giving creatives the same kind of deep control to shape, tweak, and edit their audio. It’s a kind of pixel-level control for music,” explains Bryan.
What we think
Generative AI is one of the hottest topics around at the moment, with new tools being announced every month it seems. Adobe’s Project Music GenAI Control could be a fabulous tool for producing bespoke music for your video or audio content. Although it is still at an early stage of development, it promises a great alternative to editing stock library music. However, there are understandable concerns about the sources used by AI to learn and the risk of copyright infringements. It’s also important to consider the implications of generative AI for human artists and creators. It’s good that Adobe has developed its own AI ethics principles to address some of the issues around accountability, but there still needs to be a wider debate about the impact of AI.
