view post Post 3288 You can now run DeepSeek-V3-0324 on your own local device!Run our Dynamic 2.42 and 2.71-bit DeepSeek GGUFs: unsloth/DeepSeek-V3-0324-GGUFYou can run them on llama.cpp and other inference engines. See our guide here: https://docs.unsloth.ai/basics/tutorial-how-to-run-deepseek-v3-0324-locally See translation π₯ 16 16 β€οΈ 8 8 π 4 4 + Reply