Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

arxiv: 2403.07691

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

342

Full-text search

Active filters: 2403.07691

herooooooooo/SmolLM2-FT-DPO

Text Generation • Updated Dec 8, 2024 • 38

mmeendez/SmolLM2-FT-ORPO

Text Generation • Updated Dec 13, 2024 • 11

fermsi/SmolLM2-FT-ORPO

Text Generation • Updated Dec 14, 2024 • 8

T145/ZEUS-8B-V2-ORPO-QLORA

Text Generation • Updated Dec 15, 2024 • 11

mgat1/SmolLM2-FT-ORPO

Text Generation • Updated Dec 19, 2024 • 18

jucanbe/SmolLM2-FT-ORPO

Text Generation • Updated Dec 22, 2024 • 48

RichardErkhov/AdamLucek_-_Orpo-Llama-3.2-1B-40k-awq

Updated Dec 22, 2024 • 11

Avibhi/SmolLM2-FT-ORPO

Text Generation • Updated Dec 22, 2024 • 43

Avibhi/SmolLM2-ORPO-truthyv0.1

Text Generation • Updated Dec 22, 2024 • 45

Digish/SmolLM2-FT-ORPO

Text Generation • Updated Dec 25, 2024 • 18

odinushuaia/SmolLM2-FT-ORPO

Text Generation • Updated Dec 28, 2024 • 32

hsila/SmolLM2-135M-ORPO

Text Generation • Updated Dec 29, 2024 • 33

daqc/SmolLM2-FT-ORPO-Medicina-es

Text Generation • Updated Dec 31, 2024 • 33

yairgalili/SmolLM2-FT-ORPO

Text Generation • Updated Jan 2 • 18

marcoullmann/SmolLM2-FT-ORPO

Text Generation • Updated Jan 3 • 23

hjerpe/SmolLM2-FT-ORPO

Text Generation • Updated Jan 6 • 10

RichardErkhov/anakin87_-_gemma-2b-orpo-awq

Updated Jan 10 • 5

oftverse/ORPO_ultrafeedback_binarized_phi-2_LORA_ADAPTER_16rank

czuo03/SmolLM2-FT-ORPO

Text Generation • Updated Jan 15 • 9

Gopal2002/SmolLM2-FT-ORPO

Text Generation • Updated Jan 16 • 12

MUTSC/SmolLM2-FT-ORPO

Text Generation • Updated Jan 16 • 9

peaceAsh/smolcourse_chapter2_ORPO

Text Generation • Updated Jan 18 • 15

silviasapora/mistral-7b-orpo-noisy-v2

Text Generation • Updated Jan 21 • 9

RichardErkhov/trl-lib_-_Qwen2-0.5B-ORPO-exl2

knight7561/SmolLM2_python_coder-FT-ORPO

Text Generation • Updated Jan 20 • 13

silviasapora/mistral-7b-orpo-shuffled-v2

Text Generation • Updated Jan 21 • 6

silviasapora/gemma-7b-orpo-noisy-4e-5

Text Generation • Updated Jan 23 • 9

silviasapora/gemma-7b-borpo-noisy-6e-5

Text Generation • Updated Jan 25 • 7

silviasapora/gemma-7b-borpo-shuffled-5e-5

Text Generation • Updated Jan 24 • 9

silviasapora/gemma-7b-borpo-noisy-5e-5

Text Generation • Updated Jan 24 • 12