niclasgriesshaber/Meta-Llama-3.1-8B-Instruct-bnb-4bit-lora-embg-to-en

Early Modern Bohemian German to English Translation Model

Overview

This model translates from Early Modern Bohemian German (EMBG) to English. It was fine-tuned using LoRA on a unique historical dataset of 3,873 paragraph-level translation pairs sourced from legal court records. The dataset was meticulously transcribed and translated by the Chichele Professor of Economic History, Sheilagh Ogilvie, from All Souls College, University of Oxford.

Key Features

• Base Model: unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
• Fine-Tuning: Performed using LoRA and Unsloth, leveraging Hugging Face's Transformers and TRL libraries.
• Languages Supported:
  • Source: Early Modern Bohemian German (EMBG)
  • Target: English
• Dataset: Legal court records, manually transcribed and translated over five years. The dataset will be published in an upcoming ACL paper.

Use Cases

• Research in economic history and legal studies.
• Exploration of historical dialects and their nuances.
• Applications in language revitalisation and historical text analysis.