Adobe expands generative AI audio with Firefly music, speech and sound effects

Adobe expands generative AI audio with Firefly music, speech and sound effects Adobe Inc. today announced the general availability of audio capabilities in Firefly, the company’s all-in-one creative AI tool suite, allowing users to produce music, speech, and sound effects for their projects. In June, the company unveiled big changes for Firefly, including a large number of skills for Firefly AI Assistant that built in agentic capabilities for Elements – the company’s user-friendly video and photo editing tool suite – that allowed users to introduce characters, locations and objects that stay the same across projects. Today’s new tools include generators for music, speech and sound effects. Generate Music is powered by Firefly Music Model under the hood and creates universally licensed original tracks designed for a user’s own video’s length and mood, so the music can go with whatever content is being generated without worries about copyright issues. It can also be fine-tuned to match the brand and presentation. Generate Speech uses both Firefly Speech and an option for a model from ElevenLabs Inc. It can take a script and turn it into a fluid, natural voiceover that allows for control over voice, cadence and emotion. ElvenLabs is well known for extremely powerful speech models that cover a wide variety of synthetic voices with varied capabilities, emotionality and control. The sound effect tool also includes an underlying Firefly model that creates custom effects using a prompt, following the timing and energy of the content to produce an appropriate sound. “Going back to school and trying to stay consistent as a content creator can get really overwhelming. I love that Adobe Firefly has made my creative process so much easier,” said Esther Rehema, a fashion, beauty and lifestyle creator. “Being able to find music that is safe for commercial use and fits my content is such a game-changer. Adobe added that the audio produced by Firefly Studio is production quality and commercially safe, like everything else generated by its AI models. No separate subscription is needed for any track generated by the tool. AI audio generation tools, from music to special effects, have been trending for years. This includes audio tools such as Lyra 3 from Google LLC, OpenAI Group PBC’s reported music-generation experiments and Stability AI Ltd.’s Stable Audio open-source model. Image: Adobe A message from John Furrier, co-founder of SiliconANGLE: Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities. 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI. Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.