--- license: other license_name: deepseek-license license_link: LICENSE quantized_by: pipilok pipeline_tag: text-generation base_model: - deepseek-ai/DeepSeek-V2-Lite-Chat --- Original model: https://huggingface.co/deepseek-ai/DeepSeek-V2-Lite-Chat Tested on Snapdragon X Elite with LM Studio 0.3.2 ARM64 Technology Preview https://lmstudio.ai/snapdragon Avg answer Speed: 30 tok/s ## LM Studio Settings: ``` Before System: <|im_start|>system\n After System: <|im_end|>\n Before User: <|im_start|>user\n After User: <|im_end|>\n Before Assistant: <|im_start|>assistant\n After Assistant: <|im_end|>\n ```