Meta introduces Llama 3 large language model; aims to make it multilingual soon

Meta introduced its Llama 3 large language model as chief Mark Zuckerberg said Meta AI would be upgraded with the latest offering

April 19, 2024 12:16 pm | Updated 12:16 pm IST

Meta highlighted that Llama 3 had improved on previous models’ limitations [File]

Meta highlighted that Llama 3 had improved on previous models’ limitations [File] | Photo Credit: REUTERS

Meta on Thursday introduced its latest large language model, Llama 3, which it claims is the “most capable openly available LLM to date.”

The social media firm also said more models are slated to be released soon.

Meta highlighted that Llama 3 had improved on previous models’ limitations and that features such as multilingual/multimodal capabilities were a goal in the “near future,” along with better reasoning and coding performance.

“Thanks to improvements in pretraining and post-training, our pretrained and instruction-fine-tuned models are the best models existing today at the 8B and 70B parameter scale,” said Meta in a blog post on Thursday.

“With this new model, we believe Meta AI is now the most intelligent AI assistant that you can freely use,” said Mark Zuckerberg in an Instagram post on Thursday, adding that Meta AI would also be able to animate photos and speed up image generation.

(For top technology news of the day, subscribe to our tech newsletter Today’s Cache)

However, Meta AI stirred up controversy this week after the chatbot pretended to be the parent of a child while it was responding to users in a Facebook group.

Meta stressed that it used high quality data in order to train its latest model, as it faces legal action over allegations of scraping copyrighted works for AI training.

“Llama 3 is pretrained on over 15T tokens that were all collected from publicly available sources. Our training dataset is seven times larger than that used for Llama 2, and it includes four times more code,” said the company, noting that over 5% of the Llama 3 pretraining data set consisted of high-quality non-English data from over 30 languages.

However, Meta acknowledged there was still work to be done and invited feedback from users.

Llama will be made available on AWS, Databricks, Google Cloud, Hugging Face, Kaggle, IBM WatsonX, Microsoft Azure, NVIDIA NIM, and Snowflake.

Meta AI was not yet available in India.

0 / 0
Sign in to unlock member-only benefits!
  • Access 10 free stories every month
  • Save stories to read later
  • Access to comment on every story
  • Sign-up/manage your newsletter subscriptions with a single click
  • Get notified by email for early access to discounts & offers on our products
Sign in


Comments have to be in English, and in full sentences. They cannot be abusive or personal. Please abide by our community guidelines for posting your comments.

We have migrated to a new commenting platform. If you are already a registered user of The Hindu and logged in, you may continue to engage with our articles. If you do not have an account please register and login to post comments. Users can access their older comments by logging into their accounts on Vuukle.