Llama 2 was released July 18, 2023 in partnership with Microsoft. Available in 7B, 13B, and 70B parameter sizes with open commercial licensing (a first for Meta). The 70B model scored 68.9% on MMLU. Trained on 2T tokens with a 4K context window. Llama 2 Chat variants were fine-tuned for dialogue using RLHF.
Modality
text