Llama 3.1 405 billion Parameter Released

Llama 3.1 405B is the first openly available model that rivals the top AI models when it comes to state-of-the-art capabilities in general knowledge, steerability, math, tool use, and multilingual translation. With the release of the 405B model, Meta supercharges innovation—with unprecedented opportunities for growth and exploration. They believe the latest generation of Llama will …

Read more

Meta Free AI Models and Integrating AI Ask Meta Query Into Facebook and Instagram

Meta has put Meta AI front and center in the search bars for Facebook and Instagram that have served as key tools to find content from particular friends or creators. This is what the All-in-Podcast guys called scorched Earth for AI. This means almost no one will pay the $20 per month or other subscriptions …

Read more

Weird Claim That Zuckerberg Does Not Believe in AI Compute Scaling

Ate-a-Pi has a weird claim that Mark Zuckerberg does not believe in AI compute scaling delivering better performance. There is also a claim about energy constraints for data centers and AI chips maximizing on performance per watt. Zuckerberg says that the exponential curves are still scaling. He says no ones how long that scaling continues. …

Read more

Meta Llama 3 70B Open Source Model Beats Claude 3 Sonnet

Llama 3 is Meta’s latest generation of models that has state-of-the art performance and efficiency for openly available LLMs. Meta AI is available online for free. The small 7B model beats Mistral 7B and Gemma 7B. The 70B beats Claude 3 Sonnet (closed source Anthropic model) and competes against Gemini Pro 1.5 (closed source model …

Read more

OpenAI Q* Reasoning Rumor is Similar to Meta AI Planning Approach

Meta is working on adding latent space planning/search to large language model AI. 1️⃣H-GAP (https://arxiv.org/abs/2312.02682) 2️⃣Diffusion World Model (https://arxiv.org/abs/2402.03570) 3️⃣TAP (https://arxiv.org/abs/2208.10291) 4️⃣LaMCTS (https://arxiv.org/abs/2007.00708) 5️⃣LaP3 (https://arxiv.org/abs/2106.10544) 6️⃣LaSynth (https://arxiv.org/abs/2107.00101) 7️⃣LaMOO (https://arxiv.org/abs/2110.03173) Rumored OpenAI Q* Is Optimization in Abstract Representation Space The innovation in Q* lies in its optimization process, conducted not within the space of possible text …

Read more

META Will Merge AI and Metaverse with AI Glasses

META CEO Mark Zuckerberg announced on Instagram that META is dumping more than $10 billion into the computing infrastructure to develop AGI. AGI is AI that can match or surpass humans across a range of cognitively demanding tasks. Meta’s two AI research efforts are brought closer together to support the long-term goals of building general …

Read more

Will Meta Have a Zettaflop of AI Compute in 2024?

Mark Zuckerberg plans on acquiring 350,000 Nvidia H100 GPUs to help Meta build a next-generation AI that possesses human-like intelligence. Zuckerberg mentioned the figure today as he announced his company’s long-term effort to develop an artificial general intelligence (AGI), or an AI that can learn and be used to perform a variety of tasks. By …

Read more

Bull Market With Top Seven Tech Stocks and Bear Market Without Them

2023 has been a relatively good year for the benchmark S&P 500 and growth stock-fueled Nasdaq Composite. The S&P 500 is widely viewed as the best benchmark of Wall Street’s health. It’s a market cap-weighted index comprised of 500 generally profitable, time-tested companies, a few of which have multiple classes of shares. All told, the …

Read more