pszemraj
/

nougat-small-onnx-quant_avx512_vnni

Image-Text-to-Text

vision-encoder-decoder

Model card Files Files and versions

nougat-small-onnx-quant_avx512_vnni

This was quantized from pszemraj/nougat-small-onnx using the --avx512_vnni flag. You need to have a processor with avx512_vnni instructions for this to work properly.

per_channel is set to True for better accuracy
Usage is the same as: https://huggingface.co/pszemraj/nougat-small-onnx
verify that you have the requirements by checking for results with lscpu | grep avx512_vnni

Downloads last month: 6

Inference Providers NEW

Image-Text-to-Text

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including pszemraj/nougat-small-onnx-quant_avx512_vnni

Nougat ONNX

Faster Nougat in ONNX format (optimum onnxruntime) • 6 items • Updated Feb 24, 2024 • 1