solidrust
/

Memgpt-3x7b-MOE-AWQ

Text Generation

4-bit precision

Inference Endpoints

Mixture of Experts

starsnatched/MemGPT-DPO

starsnatched/MemGPT-3

starsnatched/MemGPT

text-generation-inference

Model card Files Files and versions Community

liminerity/Memgpt-3x7b-MOE AWQ

Model creator: liminerity
Original model: Memgpt-3x7b-MOE

Model Summary

Memgpt-3x7b-MOE is a Mixure of Experts (MoE) made with the following models using LazyMergekit:

Downloads last month: 7

Safetensors

Model size

2.7B params

Tensor type

I32

·

FP16

·

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for solidrust/Memgpt-3x7b-MOE-AWQ

Base model

liminerity/Memgpt-3x7b-MOE

Quantized

(1)

this model

Collection including solidrust/Memgpt-3x7b-MOE-AWQ

3x7B AWQ

Mixture of experts 3 x 7B. • 5 items • Updated Apr 25