switch-large-128_qmoe

This is the google/switch-large-128 model quantized with the QMoE framework to ternary precision and stored in the custom further compressed QMoE format.

Please see the QMoE repository for how to use this model.

Downloads last month: 10

Inference Examples

Text2Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.