mlx-community/DeepHermes-3-Llama-3-3B-Preview-8bit
Text Generation
•
Updated
Ivan Fioravanti PRO
ivanfioravanti
AI & ML interests
None yet
Recent Activity
updated
a model
about 2 hours ago
mlx-community/DeepHermes-3-Llama-3-3B-Preview-8bit
updated
a model
about 2 hours ago
mlx-community/DeepHermes-3-Llama-3-3B-Preview-bf16
updated
a model
about 2 hours ago
mlx-community/DeepHermes-3-Llama-3-3B-Preview-4bit
Organizations
ivanfioravanti's activity
updated
3
models
about 2 hours ago
published
3
models
about 2 hours ago
updated
a
model
about 2 hours ago
published
a
model
about 2 hours ago
updated
a
model
about 2 hours ago
published
a
model
about 2 hours ago
updated
2
models
about 2 hours ago
published
2
models
about 2 hours ago
updated
a
model
about 2 hours ago
published
a
model
about 2 hours ago
liked
a
model
5 days ago
liked
a
model
9 days ago
reacted to
stefan-it's
post with 👍
13 days ago
Post
3113
After running some 3DMark and FurMark benchmarks on Windows to make sure that my new 5090 is not causing melting cables [1] and some nice shots with a thermal camera (I don't think that's too much), running some fine-tuning experiments with my favorite Flair & Transformers libraries are very easy to perform.
Important steps:
Good idea is to start with a fresh Ubuntu 24.04 installation with latest CUDA 12.8 and the open NVIDIA driver - follow more advices from [2]:
I tried update from an existing Ubuntu installation with an older CUDA and driver version and it resulted in a non-startable system.
If you are using PyTorch 2.6 with built CUDA 12.6 it will result in:
But no worries! For PyTorch you need just to use a nightly 2.7 version that was built with CUDA 12.8. This can easily done via:
After that the latest Flair version can be installed and fine-tuning will work!
References:
[1]: https://www.reddit.com/r/nvidia/comments/1inpox7/rtx_50_series_12vhpwr_megathread/
[2]: https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network
Important steps:
Good idea is to start with a fresh Ubuntu 24.04 installation with latest CUDA 12.8 and the open NVIDIA driver - follow more advices from [2]:
sudo apt -y install cuda-toolkit-12-8 nvidia-openI tried update from an existing Ubuntu installation with an older CUDA and driver version and it resulted in a non-startable system.
If you are using PyTorch 2.6 with built CUDA 12.6 it will result in:
NVIDIA Graphics Device with CUDA capability sm_120 is not compatible with the current PyTorch installation.
The current PyTorch install supports CUDA capabilities sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90.But no worries! For PyTorch you need just to use a nightly 2.7 version that was built with CUDA 12.8. This can easily done via:
pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu128After that the latest Flair version can be installed and fine-tuning will work!
References:
[1]: https://www.reddit.com/r/nvidia/comments/1inpox7/rtx_50_series_12vhpwr_megathread/
[2]: https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network
- 1 reply
Upload folder using huggingface_hub
2
#1 opened 28 days ago
by
ivanfioravanti