Compute-Constrained Data Selection

https://github.com/oseyosey/CCDS

AI & ML interests

Compute-Constrained Data Selection

Recent Activity

osieosie authored a paper 2 months ago

ModuLoRA: Finetuning 3-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers

osieosie updated a model 2 months ago

CCDS-Scaling/llama2-7b-ifeval-less-p0.50-lora-seed3-linear-1epoch

osieosie updated a model 2 months ago

CCDS-Scaling/llama2-7b-ifeval-less-p0.50-lora-seed2-linear-1epoch

View all activity

CCDS-Scaling's activity

osieosie

authored a paper 2 months ago

ModuLoRA: Finetuning 3-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers

Paper • 2309.16119 • Published Sep 28, 2023 • 1

osieosie

updated 19 models 2 months ago

CCDS-Scaling/llama2-7b-ifeval-less-p0.50-lora-seed3-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.50-lora-seed2-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.50-lora-seed1-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.25-lora-seed2-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.25-lora-seed1-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.10-lora-seed3-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.10-lora-seed2-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.10-lora-seed1-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.05-lora-seed5-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.05-lora-seed4-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.05-lora-seed3-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.05-lora-seed2-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.05-lora-seed1-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.025-lora-seed5-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.025-lora-seed4-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.025-lora-seed3-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.025-lora-seed2-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-less-p0.025-lora-seed1-linear-1epoch

CCDS-Scaling/llama2-7b-ifeval-embed-p0.50-lora-seed3-linear-1epoch