OpenAI is reportedly developing a new generative music tool that can create music from text and audio prompts, potentially revolutionizing the way background music is added to videos and accompaniments are generated for vocal tracks.
The tool, as described by sources cited in a report from The Information, could enable users to automatically add background music to existing videos or provide guitar accompaniment to a vocal track, among other applications. This development underscores OpenAI’s ongoing efforts to expand its capabilities beyond text-based AI models.
While details on the launch timeline of the generative music tool remain unclear, sources indicate that OpenAI is actively working on the project. It is also uncertain whether the tool will be launched as a standalone product or integrated with OpenAI’s existing products, such as ChatGPT and the video app Sora. This ambiguity leaves room for speculation about how the tool will be positioned in the market and how it will interact with other OpenAI offerings.
In an interesting collaboration, OpenAI is working with students from the prestigious Juilliard School to annotate musical scores for use as training data. This partnership highlights the importance of high-quality, expertly annotated data in developing sophisticated AI models capable of generating nuanced and contextually appropriate music.
OpenAI has previously released generative music models, although these efforts predated the launch of ChatGPT. In recent years, the company has focused on developing audio models for text-to-speech and speech-to-text functionalities, indicating a broader strategy to enhance its AI capabilities across multiple modalities. The generative music tool represents a significant expansion of OpenAI’s audio-related endeavors.
The development of generative music tools is a competitive space, with companies like Google and Suno also actively engaged in creating similar technologies. OpenAI’s entry into this market is likely to have significant implications for the music and video production industries, potentially changing how creators approach the generation of background music and accompaniments.
