FalconMamba 7B

tiiuae 's Collections

Falcon3

FalconMamba 7B

Falcon2

Falcon

RefinedWeb

ViSpeR

updated 28 days ago

This collection features the FalconMamba 7B base model, the instruction-tuned version, their 4-bit and GGUF variants, and the demo.

Upvote

Running on Zero

65

65

Falcon Mamba Playground

🐍

Generate chat responses using FalconMamba-7b model
Falcon Mamba: The First Competitive Attention-free 7B Language Model

Paper • 2410.05355 • Published Oct 7, 2024 • 33

Note FalconMamba technical report
tiiuae/falcon-mamba-7b

Text Generation • Updated Dec 17, 2024 • 25.9k • 228

Note First strong attention free model for general purpose usage, based on Mamba1 architecture
tiiuae/falcon-mamba-7b-instruct

Text Generation • Updated Dec 17, 2024 • 19.3k • 66

Note FalconMamba-7B fine-tuned on instruction data, for chat-like interaction with the model
tiiuae/falcon-mamba-7b-4bit

Text Generation • Updated Oct 10, 2024 • 102 • 11

Note FalconMamba-7B quantized in 4bit precision using `bitsandbytes` library for lighter memory requirements and smaller GPU hardwares
tiiuae/falcon-mamba-7b-instruct-4bit

Updated Oct 10, 2024 • 179 • 12

Note FalconMamba-7B-instruct quantized in 4bit precision using `bitsandbytes` library for lighter memory requirements and smaller GPU hardwares
tiiuae/falcon-mamba-7b-instruct-BF16-GGUF

Updated Oct 10, 2024 • 34 • 1

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in BF16 format
tiiuae/falcon-mamba-7b-instruct-F16-GGUF

Updated Oct 10, 2024 • 27 • 1

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in F16 format
tiiuae/falcon-mamba-7b-instruct-Q8_0-GGUF

Updated Oct 10, 2024 • 44 • 5

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in quantized Q8_0 format
tiiuae/falcon-mamba-7b-instruct-Q4_K_M-GGUF

Updated Oct 10, 2024 • 51 • 5

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in quantized Q4_K_M format
tiiuae/falcon-mamba-7b-BF16-GGUF

Updated Oct 10, 2024 • 49 • 2

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in BF16 format
tiiuae/falcon-mamba-7b-F16-GGUF

Updated Oct 10, 2024 • 21 • 1

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in F16 format
tiiuae/falcon-mamba-7b-Q8_0-GGUF

Updated Oct 10, 2024 • 19 • 2

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in quantized Q8_0 format
tiiuae/falcon-mamba-7b-Q4_K_M-GGUF

Updated Oct 10, 2024 • 11 • 1

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in quantized Q4_K_M format
tiiuae/falcon-mamba-7b-pre-decay

Updated Oct 10, 2024 • 22 • 3

Note Pre-decay stage checkpoint useful for continuous pretraining

Upvote

FalconMamba 7B

Falcon Mamba Playground