'Mistral is Peanuts For Us': Meta Execs Obsessed Over Beating OpenAI's GPT-4 Internally, Court Filings Reveal (techcrunch.com) 7
Executives and researchers leading Meta's AI efforts obsessed over beating OpenAI's GPT-4 model while developing Llama 3, according to internal messages unsealed by a court in one of the company's ongoing AI copyright cases, Kadrey v. Meta. From a report: "Honestly... Our goal needs to be GPT-4," said Meta's VP of Generative AI, Ahmad Al-Dahle, in an October 2023 message to Meta researcher Hugo Touvron. "We have 64k GPUs coming! We need to learn how to build frontier and win this race."
Though Meta releases open AI models, the company's AI leaders were far more focused on beating competitors that don't typically release their model's weights, like Anthropic and OpenAI, and instead gate them behind an API. Meta's execs and researchers held up Anthropic's Claude and OpenAI's GPT-4 as a gold standard to work toward. The French AI startup Mistral, one of the biggest open competitors to Meta, was mentioned several times in the internal messages, but the tone was dismissive. "Mistral is peanuts for us," Al-Dahle said in a message. "We should be able to do better," he said later.
Though Meta releases open AI models, the company's AI leaders were far more focused on beating competitors that don't typically release their model's weights, like Anthropic and OpenAI, and instead gate them behind an API. Meta's execs and researchers held up Anthropic's Claude and OpenAI's GPT-4 as a gold standard to work toward. The French AI startup Mistral, one of the biggest open competitors to Meta, was mentioned several times in the internal messages, but the tone was dismissive. "Mistral is peanuts for us," Al-Dahle said in a message. "We should be able to do better," he said later.
Turnabout is fair play (Score:3)
This time around it's the Llama that wants to whip somebody else's ass.
Thank goodness (Score:2)
GPT-4 is rapidly evolving into a different thing that's more than an LLM, with tie-ins to lots of different information sources, access to sandboxed phython runtime to calculate answers, a 'projects' construct for group discussions with related people and documents, and so on...
Re:Thank goodness (Score:4, Interesting)
"I don't really know why they give it away."
It's the only ethical thing to do for humanity... I say screw copyright, let them eat everything but also leave the weights fully open, all the functional tuning but without any censorship or guardrails applied whatsoever. If they also want to host it and build a service around that or make a more business friendly version with censorship/guardrails applied to that open core there is absolutely nothing wrong with that.
Let's not forget, OpenAI was founded and created to do this as an open effort as well, they produced something with commercial potential and instantly screwed their funders and the world.
Rumors (Score:4, Funny)
Internally, OpenAI refers to its own model as "Winamp".
Fantastic (Score:2)
The advances Meta has brought to AR/VR and AI are big steps toward making up for the evils of data collection. Not to mention moving toward a community notes type system and helping empower people with free speech and truth rather than the 'truth cartel.'
If you are going to steal my data, using it to make sure nobody owns AI is something worth doing that for.
FB (Score:2)
I am beginning to feel that FB is not long for this world.