Home News Meta releases Code Llama, a new LLM geared for programming

Meta releases Code Llama, a new LLM geared for programming

by WeeklyAINews
0 comment

Head over to our on-demand library to view periods from VB Rework 2023. Register Right here


True to the rumors and advance reports, Meta Platforms, the corporate previously generally known as Fb, at present unveiled Code Llama, its new generative AI massive language mannequin (LLM) designed particularly for programming — and just like the extra general-purpose LLaMA 2, it’s open supply and licensed for industrial use.

Code Llama is “designed to help software program engineers in all sectors — together with analysis, trade, open supply tasks, NGOs, and companies,” Meta says in its weblog put up saying the fashions.

The device instantly turns into a serious rival to OpenAI’s Codex (powered by a modified GPT-3), the Codex-powered Github Copilot from Microsoft, and different coding-specific LLM assistants resembling Stack Overflow’s OverflowAI.

In its weblog put up, Meta explains that Code LlaMA is a “code-specialized” model of LLaMA 2 that may generate code, full code, create developer notes and documentation, be used for debugging, and extra. It helps Python, C++, Java, PHP, Typescript (Javascript), C# and Bash. You may learn the total analysis paper from Meta about its efficiency here, which describes Code LlaMA as a “household” of LLMs for code.

Constructing on that analogy, the household consists of three major members: a 7-billion, a 13-billion and a 34-billion parameter mannequin, every skilled on 500 billion tokens. The smaller fashions are designed to run on fewer GPUs (the 7-billion mannequin can run on a single one), a useful attribute given the rumored shortage on this important piece of {hardware} for the time being, and Meta says each are quicker than its 34-billion large mannequin.

See also  8 Ethical Considerations of Large Language Models (LLM) Like GPT-4

All fashions help as much as 100,000 tokens for his or her prompts. This implies “customers can present the mannequin with extra context from their codebase to make the generations extra related,” in response to Meta.

The LLaMA prolonged household additionally consists of two fine-tuned fashions, one for Python and one for Instruct, the latter of which “has [been] fine-tuned to generate useful and secure solutions in pure language,” and due to this fact, Meta says, ought to be used when producing new code from pure language prompts. That’s, it returns safer, extra anticipated and maybe much less artistic responses.

You may download Code LlaMA directly from Meta here and discover the source code on Github here.

Source link

You may also like

logo

Welcome to our weekly AI News site, where we bring you the latest updates on artificial intelligence and its never-ending quest to take over the world! Yes, you heard it right – we’re not here to sugarcoat anything. Our tagline says it all: “because robots are taking over the world.”

Subscribe

Subscribe my Newsletter for new blog posts, tips & new photos. Let's stay updated!

© 2023 – All Right Reserved.