Model Card for Model ID

Summary Length PPO experiment #1
No KL divergence in loss

Model Details

Dataset size: 1024
Epochs: 1
Batch Size: 4

Optimizer args: Torch AdamW default

Outcomes

Nonsensical text output

Downloads last month: 136

Safetensors

Model size

1.24B params

Tensor type

BF16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for amang1802/Llama3.2-1B-summary-length-1024-1ep

Quantizations

1 model

Collection including amang1802/Llama3.2-1B-summary-length-1024-1ep

PPO experiments

Collection

Using PPO with simpler reward functions • 8 items • Updated 12 days ago