Photo: Dima Solomin
Mark Zuckerberg announced that Meta has been working on artificial intelligence research to create worlds through speech, upgrade the process of chatting with your voice assistant and translate between languages.
In a world where we are all connected, Mark Zuckerberg believes that our lives will be seamlessly integrated with digital reality one day. The Facebook founder outlined his plans for the metaverse.
“The key to unlocking a lot of these advances in AI,” said Zuckerberg, giving a speech at the giant’s live-streamed “Inside the Lab” event.
Meta is developing a new variation of the generative AI model that will enable people to illustrate their world and set out aspects in it, said Zuckerberg.
Zuckerberg presented an AI concept named Builder Bot, where he showed up as a 3D avatar with no legs on an island and gave speech commands to make a beach and then create other clouds, trees, and even a picnic blanket.
“As we advance this technology further, you’ll be able to create nuanced worlds to explore and share experiences with others, with just your voice,” he said. Zuckerberg, however, did not specify a timeline for these improvements or disclose additional details on how Builder Bot works.
He believes that people will be able to have natural conversations with their voice assistants in the future. In addition, he also stressed how Meta is developing AI research for conversational interactions and understanding what it means for individuals when they communicate.
He added that the giant’s Project CAIRaoke was “a fully end-to-end neural model for building on-device assistants.”
The Project CAIRaoke tech presentation exhibited a family utilizing it to aid in cooking a stew, with the voice assistant telling caution that the family had already put salt in the pot. The assistant also regarded that they were running low on salt and ordered more.
Meta’s CAIRaoke system can now provide a more immersive experience for users. With the new model, Meta has taken language translation one step further by incorporating AR and VR features into their already impressive product line-up of services.
It was firmly limiting the responses of its new CAIRaoke-based model until it could guarantee that the system did not produce offensive language, said Jerome Pesenti, vice president for AI at Meta.
“These language models are very powerful … so we are making a lot of effort to be able to control them,” Pesenti said.