FintoAI-data-KAUNO / README.md
juhoinkinen's picture
Upload folder using huggingface_hub
fb35079 verified
|
raw
history blame
1.4 kB
metadata
license: cc0-1.0
language:
  - fi
pipeline_tag: text-classification
thumbnail: >-
  https://raw.githubusercontent.com/NatLibFi/FintoAI/main/ai.finto.fi/static/img/finto-ai-social.png
tags:
  - glam
  - lam
  - subject indexing
  - annif

FintoAI-data-KAUNO

The Annif projects with KAUNO vocabulary used at the Finto AI service.

This repository is mirrored from GitHub to the 🤗 Hugging Face Hub; the GitHub repository does not contain the model files, but only the configurations for maintaining the projects, see below.

Models

The data files for projects and vocabularies are stored in the /data directory of this repository in the 🤗 Hugging Face Hub.

DVC pipeline

The projects are trained and evaluated using a DVC (Data Version Control) pipeline defined in dvc.yaml.

The pipeline takes care of

  1. installing Annif in a venv,
  2. loading the vocabulary,
  3. training the projects,
  4. evaluating the projects.

When the necessary vocabulary and training corpora are in place the pipeline can be run using the command

dvc repro

For more information about using DVC with Annif projects see the DVC exercise of Annif tutorial.