README.md

---
language:
- en
tags:
- embeddings
- base-model
- qwen
license: apache-2.0
---

# Qwen2.5-7B-Instruct-embed-base

This is a base model derived from Qwen2.5-7B-Instruct with the language modeling head removed. 
It's intended to be used as a base for embedding tasks and further fine-tuning.

## Model Details
- Base model: Qwen2.5-7B-Instruct
- The 'lm_head' layer has been removed
- Maintains the original model's norm layers
- Suitable for embedding tasks and custom head additions