Google’s AI model converts text to music

MusicLM generates music at 24 kHz that remains consistent over several minutes.

Updated - January 31, 2023 05:12 pm IST

The Google logo is pictured at the entrance to the Google offices in London

The Google logo is pictured at the entrance to the Google offices in London | Photo Credit: Reuters

Google researchers have developed an AI tool, MusicLM, that can generate high-quality music from text descriptions.

(For insights on emerging themes at the intersection of technology, business and policy, subscribe to our tech newsletter Today’s Cache.)

MusicLM generates music at 24 kHz that remains consistent over several minutes. It outperforms previous systems both in audio quality and adherence to the text descriptions, Google claimed in a research paper on Thursday.

The model can even transform a whistled or hummed melody according to the style described in a text caption, Google added.

The tech company however does not have any plans to release the model right now as it acknowledged that there are several risks associated with the new model and the use-case it tackles. 

“We strongly emphasize the need for more future work in tackling these risks associated to music generation — we have no plans to release models at this point,” Google said in the research.

The generated samples will reflect the biases present in the training data, raising the question about appropriateness for music generation for cultures underrepresented in the training data, while at the same time also raising concerns about cultural appropriation, Google noted.

The company’s future works may focus on lyrics generation, along with improvement of text conditioning and vocal quality, modeling of high-level song structure like introduction, verse, chorus, and modeling the music at a higher sample rate, according to the research paper.

0 / 0
Sign in to unlock member-only benefits!
  • Access 10 free stories every month
  • Save stories to read later
  • Access to comment on every story
  • Sign-up/manage your newsletter subscriptions with a single click
  • Get notified by email for early access to discounts & offers on our products
Sign in

Comments

Comments have to be in English, and in full sentences. They cannot be abusive or personal. Please abide by our community guidelines for posting your comments.

We have migrated to a new commenting platform. If you are already a registered user of The Hindu and logged in, you may continue to engage with our articles. If you do not have an account please register and login to post comments. Users can access their older comments by logging into their accounts on Vuukle.