---
license: llama2
base_model:
- meta-llama/Llama-2-7b-hf
- smpanaro/Llama-2-7b-NuGPTQ
tags:
- coreml
---
CoreML conversion of Llama 2 7B from [smpanaro/Llama-2-7b-NuGPTQ](https://huggingface.co/smpanaro/Llama-2-7b-NuGPTQ).

Use [this CLI](https://github.com/smpanaro/coreml-llm-cli) to download and run inference. macOS 14 (Sonoma) is required.