A specialized version of the Llama 2 large language model called Code Llama has been developed specifically for writing and discussing code.
Facebook parent company Meta has introduced an AI-based tool for coding, called Code Llama.
a large language model (LLM) that can produce code from text prompts, Llama 2 has a code-specific variant called Code Llama. It was developed by performing additional training on datasets tailored to specific codes and sampling more data for longer periods of time. Code Llama can produce code and natural language about code in response to prompts in both code and natural language, such as “Write me a function that outputs the fibonacci sequence.” The tool can also be used for debugging and code completion. Python, C++, Java, PHP, TypeScript, JavaScript, C#, and Bash are among the languages that are supported.
From the Meta AI website, developers can request access to Code Llama. Code Llama is being made available in three sizes with 7B, 13B, and 34B parameters, all of which are free for research and commercial use. 500B code tokens and data pertaining to code are used to train each model. The fill-in-the-middle (FIM) capability, which allows for the insertion of code into already existing code, has been trained into the 7B and 13B base and instruct models. This includes out-of-the-box support for duties like code completion.
[ Read next: What can ChatGPT and LLMs really do for your business? ]
The three models address different serving and latency requirements, with the 7B model, for example, served on a single GPU while the 34B model returns the best results and allows for better coding assistance. Meta has fine-tuned two additional variations of the tool: Code Llama – Python was further fine-tuned on 100B tokens of Python code, and Code Llama – Instruct was fine-tuned to understand natural language instructions.
SOURCE: INFOWORLD
