README.md

metadata

datasets:
  - tdro-llm/finetune_data
pipeline_tag: sentence-similarity
tags:
  - sentence-transformers
base_model:
  - meta-llama/Meta-Llama-3-8B

s2-tdro-Llama-3-8B-curr

Arxiv | Github

tDRO: Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval. Guangyuan Ma, Yongliang Ma, Xing Wu, Zhenpeng Su, Ming Zhou and Songlin Hu.

This is a fine-tuned tDRO optimized retriever with Sample Ratio Reweighting of tdro-llm/finetune_data.