---
library_name: transformers
license: llama3.2
language:
- hu
base_model:
- meta-llama/Llama-3.2-1B-Instruct
---

# Model Card for Llama-3.2-1B-HuAMR

<!-- Provide a quick summary of what the model is/does. -->


## Model Details

### Model Description

<!-- Provide a longer summary of what this model is. -->

This model is a fine-tuned version of [meta-llama/Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) on the None dataset. It achieves the following results on the evaluation set:

- **Model type:** Abstract Meaning Representation parser
- **Language(s) (NLP):** Hungarian

### Model Sources [optional]

<!-- Provide the basic links for the model. -->

- **Repository:** [GitHub Repo](https://github.com/botondbarta/HuAMR)

## Training Details

### Training Procedure

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->

#### Training Hyperparameters

- learning_rate: 5e-05
- train_batch_size: 1
- gradient_accumulation_steps: 16
- total_train_batch_size: 16
- optimizer: AdamW
- lr_scheduler_type: linear
- max_grad_norm: 0.3

#### Metrics

<!-- These are the evaluation metrics being used, ideally with a description of why. -->

[More Information Needed]

## Citation [optional]

<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->

**BibTeX:**

[More Information Needed]

## Framework versions
 - Transformers 4.34.1
 - Pytorch 2.3.0+cu118
 - Datasets 2.19.0
 - Tokenizers 0.19.1