FasterDecoding

FasterDecoding's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts

tianlecai 

authored 2 papers 9 months ago

SnapKV: LLM Knows What You are Looking for Before Generation

Paper • 2404.14469 • Published Apr 22, 2024 • 23

JetMoE: Reaching Llama2 Performance with 0.1M Dollars

Paper • 2404.07413 • Published Apr 11, 2024 • 36

Gsunshine 

authored a paper 10 months ago

One-Step Diffusion Distillation via Deep Equilibrium Models

Paper • 2401.08639 • Published Dec 12, 2023

tianlecai 

authored 2 papers 11 months ago

DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

Paper • 2402.19481 • Published Feb 29, 2024 • 20

BitDelta: Your Fine-Tune May Only Be Worth One Bit

Paper • 2402.10193 • Published Feb 15, 2024 • 19

jamesliu1 

authored a paper 11 months ago

BitDelta: Your Fine-Tune May Only Be Worth One Bit

Paper • 2402.10193 • Published Feb 15, 2024 • 19

tianlecai 

updated a model 11 months ago

FasterDecoding/BitDelta_Mistral_combo

Updated Feb 14, 2024

tianlecai 

updated a model 12 months ago

FasterDecoding/medusa-1.0-vicuna-13b-v1.5

Text Generation • Updated Jan 25, 2024 • 13 • 1

Gsunshine 

authored a paper 12 months ago

Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads

Paper • 2401.10774 • Published Jan 19, 2024 • 54

yli3521 

authored a paper 12 months ago

Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads

Paper • 2401.10774 • Published Jan 19, 2024 • 54

tianlecai 

authored a paper 12 months ago

Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads

Paper • 2401.10774 • Published Jan 19, 2024 • 54

tianlecai 

updated 3 models about 1 year ago

FasterDecoding/medusa-1.0-vicuna-33b-v1.3

Text Generation • Updated Dec 18, 2023 • 14

FasterDecoding/medusa-1.0-zephyr-7b-beta

Text Generation • Updated Dec 18, 2023 • 181 • 1

FasterDecoding/medusa-v1.0-vicuna-7b-v1.5

Text Generation • Updated Oct 29, 2023 • 254

tianlecai 

updated 3 models over 1 year ago

FasterDecoding/medusa-vicuna-33b-v1.3

Updated Sep 11, 2023 • 7 • 4

FasterDecoding/medusa-vicuna-13b-v1.3

Updated Sep 11, 2023 • 20 • 5

FasterDecoding/medusa-vicuna-7b-v1.3

Updated Sep 11, 2023 • 4.76k • 16

tianlecai 

updated a Space over 1 year ago

Running

🌖

README

tianlecai 

authored a paper over 1 year ago

Large Language Models as Tool Makers

Paper • 2305.17126 • Published May 26, 2023 • 3