Meta's Free Code Llama AI Programming Tool Closes the Gap With GPT-4

Meta's latest update to its code generation AI model, Code Llama 70B, is "the largest and best-performing model" yet. From a report: Code Llama tools launched in August and are free for both research and commercial use. According to a post on Meta's AI blog, Code Llama 70B can handle more queries than previous versions, which means developers can feed it more prompts while programming, and it can be more accurate. Code Llama 70B scored 53 percent in accuracy on the HumanEval benchmark, performing better than GPT-3.5's 48.1 percent and closer to the 67 percent mark an OpenAI paper (PDF) reported for GPT-4. Built on Llama 2, Code Llama helps developers create strings of code from prompts and debug human-written work. Meta simultaneously launched two other Code Llama tools last fall, Code Llama -- Python and Code Llama -- Instruct, which focused on specific coding languages.

spits out code

[bugs2squash]

is it called Code Llama because it spits out code ?

Re:

[RitchCraft]

No, it's because Zuckerberg spits on society. No way I'm using anything that Zuckerberg is a part of. "No touchy!"

Re:

[Wolfling1]

+1

Re:

[troff]

... because Winamp whips its ass?

Wow, ~5% better?

[wakeboarder]

That's in the weeds

Does it whip the Llama's ass?

[thesjaakspoiler]

That is all that matters since 1997

Llama's license is not free for commercial use

[Improv]

It's not as open a license as Facebook tells us.

Re:

[truedfx]

I know nobody likes to RTFA, but literally, it's right there: "Code Llama 70B is available in the same three versions as previously released Code Llama models, all free for research and commercial use:".

Re:

[Improv]

Slashdot may be accurately summarising the article, but the article is incorrect.

Codellama is under the same license as Llama 2, and Llama 2's license is not an open license.

Re:

[truedfx]

Read it yourself, https://github.com/facebookres... [github.com], the only relevant clause is clause 2, which is a restriction that does not depend on whether the use is commercial. Llama is free for commercial use for anyone not subject to that restriction.

Re:

[Improv]

Which means it is not free for commercial use. It has limits, Which is why I've been raising a fuss whenever people make this claim (or the claim that it's an opensource license, where this and another clause are both problems).

Re:

[truedfx]

No one claimed it was an open source license. It's not, and if someone did you'd be right to correct them, but no one did here. As for commercial use, we can absolutely use this, even commercially, without having to pay for it. That is how an ordinary person would interpret the phrase "free for commercial use". Likewise, your "not free for commercial use" implies that people who are permitted to use it non-commercially suddenly face restrictions when they want to change their use to a commercial one. That i

Re:

[Improv]

Clause 2 limits noncommercial use. Hence it is not free for commercial use. Without paying, people face a usage limit on how much they are allowed to use it; even though the limit is very high, it is there, and they would need to pay for an alternative license if they go over it. It is not free either in terms of liberty or price.

Re:

[truedfx]

Without paying, people face a usage limit on how much they are allowed to use it;

No, they don't. Read the license carefully: firstly, Clause 2 does not distinguish between non-commercial use and commercial use, despite the "Additional Commercial Terms" title, and secondly, the restriction is based on the monthly active users on the Llama 2 version release date.

This means that if you had 700 million monthly active users on the Llama 2 version release date, you are not permitted to use Llama 2, whether commer

Re:

[Improv]

That's not what that means. That term became active when the license was released. It means if you ever go over 700 million active users in the previous month, you need to talk to Facebook for a different license.

(there's also that other limit on how you can use the output, prohibiting usage that might go to train another model)