PowerInfer

community

AI & ML interests

We are committed to advancing the field of AGI by pushing the boundaries of local LLM inference efficiency.

models 24

PowerInfer/SmallThinker-3B-Preview

Text Generation • Updated Jan 16 • 44k • 400

PowerInfer/SparseQwen2-7B

Updated Dec 25, 2024 • 13 • 5

PowerInfer/TurboSparse-Mistral-Instruct

Feature Extraction • Updated Jun 14, 2024 • 83 • 20

PowerInfer/TurboSparse-Mixtral

Feature Extraction • Updated Jun 14, 2024 • 19 • 35

PowerInfer/TurboSparse-Mixtral-Instruct

Feature Extraction • Updated Jun 14, 2024 • 24 • 28

PowerInfer/Bamboo-base-v0_1

Feature Extraction • Updated Jun 7, 2024 • 49 • 22

PowerInfer/Bamboo-DPO-v0_1

Feature Extraction • Updated Jun 7, 2024 • 73 • 7

PowerInfer/OPT-7B-predictor

Updated Apr 10, 2024 • 3

PowerInfer/Bamboo-DPO-v0.1-predictor

Updated Mar 28, 2024

PowerInfer/Bamboo-DPO-v0.1-gguf

Updated Mar 28, 2024 • 62 • 7

datasets 2

PowerInfer/LONGCOT-Refine-500K

Viewer • Updated Jan 2 • 522k • 139 • 46

PowerInfer/QWQ-LONGCOT-500K

Viewer • Updated Dec 26, 2024 • 286k • 95 • 125