Zaid Ahmad Awan

zaidawan

AI & ML interests

None yet

Recent Activity

published a dataset 2 days ago

zaidawan/ssa

updated a model 4 months ago

zaidawan/unsloth_Meta-Llama-3.1-8B-Instruct-bnb-4bit_Adapter

replied to smangrul's post 4 months ago

🚨 New Release of 🤗PEFT! 1. New methods for merging LoRA weights. Refer this HF Post for more details: https://huggingface.co/posts/smangrul/850816632583824 2. AWQ and AQLM support for LoRA. You can now: - Train adapters on top of 2-bit quantized models with AQLM - Train adapters on top of powerful AWQ quantized models Note for inference you can't merge the LoRA weights into the base model! 3. DoRA support: Enabling DoRA is as easy as adding `use_dora=True` to your `LoraConfig`. Find out more about this method here: https://arxiv.org/abs/2402.09353 4. Improved documentation, particularly docs regarding PEFT LoRA+DeepSpeed and PEFT LoRA+FSDP! 📄 Check out the docs at https://huggingface.co/docs/peft/index. 5. Full Release Notes: https://github.com/huggingface/peft/releases/tag/v0.9.0

View all activity

Organizations

None yet

zaidawan's activity

published a dataset 2 days ago

zaidawan/ssa

Updated 2 days ago • 3

updated a model 4 months ago

zaidawan/unsloth_Meta-Llama-3.1-8B-Instruct-bnb-4bit_Adapter

Updated Dec 9, 2024

replied to smangrul's post 4 months ago

are we suppose to train LORA Adapter using AWQ base model ?
or if LORA is trained using bnb int 4 or fp16 base model can i use that adapater with AWQ model without losing much in terms of performance and accuracy

New activity in hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 4 months ago

Finetuning AWQ model

#17 opened 4 months ago by

zaidawan

updated a dataset 4 months ago

zaidawan/synthetic_agents

Viewer • Updated Dec 6, 2024 • 27.2k • 10

updated a model 4 months ago

zaidawan/unsloth_test_llama3_8B_finetuned_adapter

Updated Dec 5, 2024