Edit Models filters

argilla/ultrafeedback-binarized-preferences-cleaned

Intel/orca_dpo_pairs

Open-Orca/SlimOrca-Dedup

meta-math/MetaMathQA

ise-uiuc/Magicoder-Evol-Instruct-110K

ise-uiuc/Magicoder-OSS-Instruct-75K

jondurbin/airoboros-2.2.1

teknium/openhermes

LDJnr/Pure-Dove

LDJnr/Verified-Camel

jondurbin/truthy-dpo-v0.1

migtissera/Synthia-v1.3

wenbopan/Chinese-dpo-pairs

allenai/tulu-v2-sft-mixture

HuggingFaceH4/capybara

HuggingFaceH4/ultrachat_200k

cerebras/SlimPajama-627B

cognitivecomputations/WizardLM_evol_instruct_V2_196k_unfiltered_merged_split

hkust-nlp/deita-10k-v0

argilla/distilabel-capybara-dpo-7k-binarized

Anthropic/hh-rlhf

allenai/tulu-v2-sft-mixture-olmo-4096

berkeley-nest/Nectar

lmsys/chatbot_arena_conversations

openai/summarize_from_feedback

openai/webgpt_comparisons

openbmb/UltraFeedback

Datasets with no match

mozilla-foundation/common_voice_11_0

mozilla-foundation/common_voice_7_0

HuggingFaceH4/ultrafeedback_binarized

teknium/OpenHermes-2.5

cis-lmu/Glot500

fka/awesome-chatgpt-prompts

microsoft/orca-math-word-problems-200k

Open-Orca/OpenOrca

allenai/MADLAD-400

m-a-p/CodeFeedback-Filtered-Instruction

bigcode/starcoderdata

oscar-corpus/OSCAR-2109

Open-Orca/SlimOrca

cognitivecomputations/dolphin-coder

garage-bAInd/Open-Platypus

TIGER-Lab/MathInstruct

jondurbin/gutenberg-dpo-v0.1

cognitivecomputations/samantha-data

legacy-datasets/wikipedia

databricks/databricks-dolly-15k

mozilla-foundation/common_voice_13_0

OpenAssistant/oasst1

tiiuae/falcon-refinedweb

allenai/ultrafeedback_binarized_cleaned

jondurbin/airoboros-3.2

lmsys/lmsys-chat-1m

facebook/voxpopuli

EleutherAI/pile

cognitivecomputations/Dolphin-2.9

togethercomputer/RedPajama-Data-1T

anthracite-org/kalo-opus-instruct-22k-no-refusal

internlm/Agent-FLAN

Locutusque/function-calling-chatml

Vezora/Tested-22k-Python-Alpaca

mozilla-foundation/common_voice_17_0

nvidia/HelpSteer

nothingiisreal/Reddit-Dirty-And-WritingPrompts

m-a-p/Code-Feedback

jondurbin/cinematika-v0.1

yahma/alpaca-cleaned

HuggingFaceFW/fineweb

Gryphe/Sonnet3.5-Charcard-Roleplay

tatsu-lab/alpaca

wikimedia/wikipedia

glaiveai/glaive-function-calling-v2

Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned

Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned

Muennighoff/natural-instructions

argilla/distilabel-intel-orca-dpo-pairs

unalignment/toxic-dpo-v0.2

codeparrot/apps

mozilla-foundation/common_voice_8_0

huggan/smithsonian_butterflies_subset

facebook/belebele

camel-ai/biology

Gryphe/Sonnet3.5-SlimOrcaDedupCleaned

camel-ai/physics

mlabonne/orpo-dpo-mix-40k

camel-ai/chemistry

HuggingFaceH4/no_robots

grimulkan/LimaRP-augmented

kingbri/PIPPA-shareGPT

OpenAssistant/oasst_top1_2023-08-25

microsoft/orca-agentinstruct-1M-v1

HuggingFaceFW/fineweb-edu

nvidia/HelpSteer2

Nopm/Opus_WritingStruct

AI-MO/NuminaMath-CoT

anthracite-org/nopm_claude_writing_fixed

unalignment/toxic-dpo-v0.1

HuggingFaceTB/cosmopedia

openchat/openchat_sharegpt4_dataset

HuggingFaceTB/smoltalk

glaiveai/glaive-code-assistant-v3

allura-org/Celeste-1.x-data-mixture

Gryphe/ChatGPT-4o-Writing-Prompts

anon8231489123/ShareGPT_Vicuna_unfiltered

jondurbin/airoboros-3.1

lemonilia/LimaRP

netcat420/MFANN

jondurbin/airoboros-2.2

open-web-math/open-web-math

Models

116

Full-text search

Active filters: argilla/ultrafeedback-binarized-preferences-cleaned

QuantFactory/Faro-Yi-9B-DPO-GGUF

Text Generation • Updated May 24, 2024 • 47 • 1

vikarti-anatra/Faro-Yi-9B-DPO-6bpw-exl2

Text Generation • Updated May 24, 2024 • 17 • 1

vikarti-anatra/Faro-Yi-9B-DPO-8bpw-exl2

Text Generation • Updated May 25, 2024 • 18 • 1

bartowski/Faro-Yi-9B-DPO-GGUF

Text Generation • Updated May 24, 2024 • 98 • 4

vikarti-anatra/Faro-Yi-9B-DPO-gguf

Text Generation • Updated May 25, 2024 • 7 • 1

ggalmeida0/Faro-Yi-9B-DPO-Q8_0-GGUF

Text Generation • Updated May 26, 2024

StefanKrsteski/Phi-3-mini-4k-instruct-DPO-EPFL

Updated Jun 4, 2024 • 4

AliE02/NaturalLanguagePioneersDPO

Text Generation • Updated May 30, 2024 • 20

allenai/llama-3-tulu-2-dpo-70b

Text Generation • Updated Aug 5, 2024 • 26

allenai/llama-3-tulu-2-dpo-8b

Text Generation • Updated Aug 9, 2024 • 750 • 1

MoxoffSpA/Moxoff-Phi3Mini-KTO

Text Generation • Updated Jun 27, 2024 • 3.93k

MoxoffSpA/Moxoff-Phi3Mini-DPO

Text Generation • Updated Jun 27, 2024 • 3.92k

MoxoffSpA/Moxoff-Phi3Mini-ORPO

Text Generation • Updated Jun 27, 2024 • 3.96k

MoxoffSpA/Moxoff-Phi3Mini-PPO

Text Generation • Updated Jun 27, 2024 • 3.96k

hamishivi/OLMo-1B-0724-Instruct-hf

Text Generation • Updated Jul 17, 2024 • 9

mradermacher/llama-3-tulu-2-dpo-70b-GGUF

Updated Jul 19, 2024 • 11

mradermacher/llama-3-tulu-2-dpo-8b-GGUF

Updated Jul 20, 2024 • 65

mradermacher/llama-3-tulu-2-dpo-70b-i1-GGUF

Updated Aug 2, 2024 • 42

mradermacher/llama-3-tulu-2-dpo-8b-i1-GGUF

Updated Aug 2, 2024 • 20

allenai/llama-3.1-tulu-2-dpo-70b

Updated Aug 15, 2024 • 11

allenai/llama-3.1-tulu-2-dpo-8b

Updated Aug 15, 2024 • 14

depurator/llama-3.1-tulu-2-dpo-8b-Q4_K_M-GGUF

Updated Aug 28, 2024 • 1

AINovice2005/ElEmperador

Text Generation • Updated Oct 16, 2024 • 159

mradermacher/ElEmperador-GGUF

Updated Oct 14, 2024 • 79

miulab/llama2-7b-ultrafeedback-rm

Text Classification • Updated Oct 3, 2024 • 9

mradermacher/DPO_mistral_v01_7b_ultra_0131_1k_1epoch-GGUF

Updated Nov 7, 2024 • 4

mradermacher/DPO_mistral_v01_7b_ultra_0130_1k-GGUF

Updated Nov 7, 2024 • 7

tensorblock/Faro-Yi-9B-DPO-GGUF

Text Generation • Updated Nov 16, 2024 • 15

tensorblock/Moxoff-Phi3Mini-PPO-GGUF

Updated Nov 16, 2024 • 6

tensorblock/Moxoff-Phi3Mini-ORPO-GGUF

Updated Nov 16, 2024 • 6