Meta CEO Mark Zuckerberg announced that the company is shifting its focus towards building artificial general intelligence (AGI) and plans to release it as open-source software. Zuckerberg believes that the next generation of services requires advancements in various areas of AI, including reasoning, planning, coding, memory, and cognitive abilities. To support this effort, Meta plans to have a massive array of compute power in its cloud facilities by the end of 2024, with 350,000 Nvidia H100s or their equivalents. Only Microsoft has placed similar orders, causing delivery times for H100s to stretch out. Each Nvidia H100 contains 80 billion transistors and is significantly faster than previous models. The compute capacity of Meta’s AI infrastructure will be 130 times larger than a supercomputer. With this immense power, Meta will continue training Llama 3, a generative AI text model that could rival OpenAI’s GPT-4. Zuckerberg believes that AI and the metaverse are closely connected, and he envisions smart glasses as the primary way people will interact with AI and the metaverse. He also mentioned the successful launch of Meta’s Ray-Ban Meta glasses.
