Meta Code Llama

In this format, the model continues to write code following the code that is provided in the prompt. An implementation of this prompt can be found here.

<s>{{ code_prompt }}

The instructions prompt template for Meta Code Llama follow the same structure as the Meta Llama 2 chat model, where the system prompt is optional, and the user and assistant messages alternate, always ending with a user message. Note the beginning of sequence (BOS) token between each user and assistant message. An implementation for Meta Code Llama can be found here.

<s>[INST] <<SYS>>
{{ system_prompt }}
<</SYS>>

{{ user_message_1 }} [/INST] {{ model_answer_1 }} </s>
<s>[INST] {{ user_message_2 }} [/INST]

Infilling can be done in two different ways: with the prefix-suffix-middle format or the suffix-prefix-middle. An implementation of this format is provided here.

Notes:

<s><PRE>{{ code_prefix }}<SUF>{{ code_suffix }}<MID>

<s><PRE><SUF>{{ code_suffix }}<MID>{{ code_prefix }}