---
language: en
tags:
- medical
- deepseek
- fine-tuned
- clinical-reasoning
license: apache-2.0
datasets:
- FreedomIntelligence/medical-o1-reasoning-SFT
---

# Fine-tuned DeepSeek R1 Model for Medical Reasoning

This model is a fine-tuned version of DeepSeek R1 specialized for medical reasoning and clinical decision-making.

## Training Details
- Base Model: unsloth/DeepSeek-R1-Distill-Llama-8B
- Training Data: Medical reasoning dataset (FreedomIntelligence/medical-o1-reasoning-SFT)
- Fine-tuning Method: LoRA (Low-Rank Adaptation)
- Training Parameters:
  - Batch Size: 2
  - Learning Rate: 2e-4
  - Epochs: 1
  - Max Sequence Length: 2048

## Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("Vedant101/fine-tune-deep-seek-r1")
tokenizer = AutoTokenizer.from_pretrained("Vedant101/fine-tune-deep-seek-r1")
```