Introduction

It's clone from 'dunzhang/stella_en_400M_v5'. This version is changing the code for only using CPU for inference.

Safetensors

Model size

435M params

Tensor type

F32

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The HF Inference API does not support model that require custom code execution.

Evaluation results

accuracy on MTEB AmazonCounterfactualClassification (en)
test set self-reported

92.358
ap on MTEB AmazonCounterfactualClassification (en)
test set self-reported

70.813
ap_weighted on MTEB AmazonCounterfactualClassification (en)
test set self-reported

70.813
f1 on MTEB AmazonCounterfactualClassification (en)
test set self-reported

88.951
f1_weighted on MTEB AmazonCounterfactualClassification (en)
test set self-reported

92.686
main_score on MTEB AmazonCounterfactualClassification (en)
test set self-reported

92.358
accuracy on MTEB AmazonPolarityClassification
test set self-reported

97.195
ap on MTEB AmazonPolarityClassification
test set self-reported

96.082
ap_weighted on MTEB AmazonPolarityClassification
test set self-reported

96.082
f1 on MTEB AmazonPolarityClassification
test set self-reported

97.194