Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
Hyperbolic
Fireworks
Novita
fal
SambaNova
Nebius AI Studio
Cerebras
Together AI
Replicate
HF Inference API
Misc
Reset Misc
PowerInfer
Inference Endpoints
Misc with no match
AutoTrain Compatible
text-generation-inference
Eval Results
Merge
4-bit precision
8-bit precision
custom_code
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
19
Full-text search
Edit filters
Sort: Trending
Active filters:
PowerInfer
Clear all
PowerInfer/ReluLLaMA-7B-Predictor
Updated
Dec 18, 2023
•
5
PowerInfer/ReluLLaMA-13B-Predictor
Updated
Dec 18, 2023
PowerInfer/ReluFalcon-40B-Predictor
Updated
Dec 18, 2023
roleplaiapp/SmallThinker-3B-Preview-Q2_K-GGUF
Text Generation
•
Updated
Jan 16
•
13
roleplaiapp/SmallThinker-3B-Preview-Q3_K_S-GGUF
Text Generation
•
Updated
Jan 16
•
8
roleplaiapp/SmallThinker-3B-Preview-Q3_K_M-GGUF
Text Generation
•
Updated
Jan 16
•
11
roleplaiapp/SmallThinker-3B-Preview-Q3_K_L-GGUF
Text Generation
•
Updated
Jan 16
•
9
roleplaiapp/SmallThinker-3B-Preview-Q4_0-GGUF
Text Generation
•
Updated
Jan 16
•
13
roleplaiapp/SmallThinker-3B-Preview-Q4_K_S-GGUF
Text Generation
•
Updated
Jan 16
•
8
roleplaiapp/SmallThinker-3B-Preview-Q4_K_M-GGUF
Text Generation
•
Updated
Jan 16
•
13
roleplaiapp/SmallThinker-3B-Preview-Q5_0-GGUF
Text Generation
•
Updated
Jan 16
•
8
roleplaiapp/SmallThinker-3B-Preview-Q5_K_S-GGUF
Text Generation
•
Updated
Jan 16
•
15
roleplaiapp/SmallThinker-3B-Preview-Q5_K_M-GGUF
Text Generation
•
Updated
Jan 16
•
9
roleplaiapp/SmallThinker-3B-Preview-Q6_K-GGUF
Text Generation
•
Updated
Jan 16
•
16
roleplaiapp/SmallThinker-3B-Preview-Q8_0-GGUF
Text Generation
•
Updated
Jan 16
•
11
roleplaiapp/SmallThinker-3B-Preview-IQ3_M-GGUF
Text Generation
•
Updated
Jan 16
•
14
roleplaiapp/SmallThinker-3B-Preview-IQ3_XXS-GGUF
Text Generation
•
Updated
Jan 16
•
4
roleplaiapp/SmallThinker-3B-Preview-IQ4_NL-GGUF
Text Generation
•
Updated
Jan 16
•
7
roleplaiapp/SmallThinker-3B-Preview-IQ4_XS-GGUF
Text Generation
•
Updated
Jan 16
•
14