---
library_name: transformers
tags:
- physics
datasets:
- kejian/arxiv-physics-debug-v0
language:
- en
base_model:
- meta-llama/Llama-3.2-1B-Instruct
---
# Llama 3.2 Physics Fine-tuned Model

This model is a fine-tuned version of [meta-llama/Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) on [kejian/arxiv-physics-debug-v0](https://huggingface.co/datasets/kejian/arxiv-physics-debug-v0).

## Model description
- Base model: [meta-llama/Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct)
- Training data: [kejian/arxiv-physics-debug-v0](https://huggingface.co/datasets/kejian/arxiv-physics-debug-v0)
- Fine-tuning type: LoRA
- Use case: Physics domain questions
- Training Arguments:
  - Learning Rate: 2e-5
  - Epochs: 3
  - Gradient Accumulation Steps: 8
- Training setup: Ubuntu 24.04 with RX7800XT


## Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("benhaotang/llama3.2-1B-physics-finetuned")
tokenizer = AutoTokenizer.from_pretrained("benhaotang/llama3.2-1B-physics-finetuned")
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
model.to(device)
# Example usage
text = "What is renormalization group flow in physcis?\n"
inputs = tokenizer(text, return_tensors="pt").to("cuda")
outputs = model.generate(**inputs, max_length=2048)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
```

Expected output:

> The renormalization group flow is a method used in physics to study the behavior of systems at very small distances and high energies. It is a way to analyze the evolution of physical parameters in a system over time, taking into account the interactions between them. In essence, the renormalization group flow is a way of describing how a system evolves as it is scaled up or down in energy.
>
> The renormalization group flow is based on the idea that the behavior of a system at small distances (i.e., low energies) is closely related to its behavior at large distances (i.e., high energies). The renormalization group is a mathematical framework that describes how physical parameters change as the energy of a system increases.
>
> In the context of quantum field theory, the renormalization group flow is used to study the behavior of particles and forces in the early universe. It is particularly useful for understanding the evolution of the universe from the Planck era to the present day.
>
> The renormalization group flow is a powerful tool for physicists, allowing them to analyze complex systems and understand their behavior at the smallest scales. It has been applied to a wide range of systems, including gauge theories, quantum field theories, and cosmological models.
>
> Some of the key features of the renormalization group flow include:
>
> * The evolution of physical parameters over time, taking into account the interactions between them
> * The use of renormalization group equations to describe the behavior of the system
> * The ability to study the behavior of systems at very small distances and high energies
> * The use of the renormalization group to understand the evolution of the universe from the Planck era to the present day.
> 
> Overall, the renormalization group flow is a powerful tool for physicists, allowing them to analyze complex systems and understand their behavior at the smallest scales.
> 
> Here are some examples of systems that have been studied using the renormalization group flow:
> 
> * The early universe: The renormalization group flow has been used to study the evolution of the universe from the Planck era to the present day, taking into account the interactions between particles and forces.
> * Gauge theories: The renormalization group flow has been used to study the behavior of gauge theories, including the strong, weak, and electromagnetic forces.
> * Quantum field theories: The renormalization group flow has been used to study the behavior of quantum field theories, including the behavior of particles and forces at very small distances and high energies.
> * Cosmological models: The renormalization group flow has been used to study the evolution of the universe, taking into account the interactions between particles and forces.
> 
> Some of the key researchers who have contributed to the development of the renormalization group flow include:
> 
> * Edward Witten: Witten is a physicist who has made significant contributions to the development of the renormalization group flow, particularly in the context of gauge theories and quantum field theories.
> * Gerard 't Hooft: 't Hooft is a physicist who has made significant contributions to the development of the renormalization group flow, particularly in the context of gauge theories and quantum field theories.
> * John Schwarz: Schwarz is a physicist who has made significant contributions to the development of the renormalization group flow, particularly in the context of gauge theories and quantum field theories.
> 
> Overall, the renormalization group flow is a powerful tool for physicists, allowing them to analyze complex systems and understand their behavior at the smallest scales. It has been applied to a wide range of systems, including gauge theories, quantum field theories, and cosmological models.