AI startup Stability AI has teamed up with chipmaker Arm to carry Stability’s Secure Audio Open, an AI mannequin that may generate audio together with sound results, to cell units operating Arm chips.
Whereas numerous AI-powered apps can generate audio, like Suno and Udio, most depend on cloud processing, that means that they will’t be used offline. Furthermore, some audio technology fashions had been educated on copyrighted content material — posing an IP threat. Stability claims Secure Audio Open’s coaching set is made up totally of royalty-free audio and songs.
Secure Audio Open operating on Arm chips, which will probably be demoed on the Cellular World Congress convention in Barcelona this week, can generate a sound from a textual content description like, “Light ocean waves at sundown.” Stability says that it labored with Arm to optimize and “distill” Secure Audio Open, dashing up technology instances by 30x. Producing a single 11-second audio pattern takes round 8 seconds on an Armv9 CPU.
To be clear, the optimized Secure Audio Open mannequin isn’t obtainable to obtain — at the very least not but. However in an announcement, Stability CEO Prem Akkaraju hinted that Stability will work to carry its fashions, together with Secure Audio Open, to client apps and units sooner or later.
“As increasingly more skilled creatives and companies undertake generative AI to energy their manufacturing pipeline, it’s essential that our fashions and workflows can be found in all places for builders to construct and creators to create,” Akkaraju mentioned. “We’re excited to companion with Arm for this actual purpose.”
Stability says it’s collaborating with Arm to additional optimize and fine-tune Secure Audio Open for cell.
Stability, the beleaguered agency behind the favored picture technology mannequin Secure Diffusion, raised new money final yr as traders together with Eric Schmidt and Napster founder Sean Parker sought to show the enterprise round. Emad Mostaque, Stability’s co-founder and ex-CEO, reportedly mismanaged Stability into monetary spoil, main workers to resign, a partnership with Canva to fall by way of, and traders to develop involved concerning the firm’s prospects.
In the previous few months, Stability has employed a brand new CEO, appointed Titanic director James Cameron to its board of administrators, and launched a number of new picture technology fashions.
