mlx-Janus-Pro
Collection
8 items
•
Updated
This model is derived from https://huggingface.co/deepseek-ai/Janus-Pro-1B and the main modifications are as follows
- bin files are updated to safetensors
- Add chat_template
4bit refers to quantifying the LLM part to 4 bits.
LM means that it contains only the language model part.
Quick Start
In Macos (Apple silicon), use mlx framework https://github.com/wnma3mz/tLLM
tllm.server --model_path $MODEL_PATH --hostname localhost --is_local --client_size 1
$MODEL_PATH like wnma3mz/Janus-Pro-1B-4bit
- Downloads last month
- 5
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the HF Inference API does not support mlx models with pipeline type text-generation
Model tree for wnma3mz/Janus-Pro-1B-LM-4bit
Base model
deepseek-ai/Janus-Pro-1B