LLMs quantized with GPTQ
Irina Proskurina
iproskurina
AI & ML interests
LLMs: quantization, pre-training
Recent Activity
updated
a model
14 days ago
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g0111-s0
published
a model
14 days ago
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g0111-s0
updated
a model
16 days ago
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g10-s0
Organizations
Collections
4
models
54

iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g0111-s0
Text Generation
•
Updated
•
4

iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g10-s0
Text Generation
•
Updated
•
18

iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g11-s0
Text Generation
•
Updated
•
18

iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g562-s0
Text Generation
•
Updated
•
8

iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g12-s0
Text Generation
•
Updated
•
10

iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g563-s0
Text Generation
•
Updated
•
11

iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g0-s0
Text Generation
•
Updated
•
14

iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g13-s0
Text Generation
•
Updated
•
11

iproskurina/opt-test
Text Generation
•
Updated
•
13

iproskurina/opt-125m-gptq2
Text Generation
•
Updated
•
21