Meta is making it easier for artists and sound designers to produce audio using only AI. The Facebook owner has released an open source AudioCraft kit that bundles three existing generative AI models for creating sounds from text descriptions. AudioGen and MusicGen respectively produce sound effects and music, while EnCodec compresses sounds to produce higher-quality results. A musician or sound designer might have everything they need to compose pieces.
The release includes pre-trained AudioGen models for those who want to start quickly, and tinkerers will have access to the entire AudioCraft code and model weighting. The open source debut gives pros and researchers a chance to train the models using their own data, Meta says. All the pre-trained models use either public or Meta-owned material, so there's no chance of copyright disputes.