DavidDutour's picture
Update README.md
f28165b verified
|
raw
history blame
875 Bytes
metadata
license: creativeml-openrail-m
language:
  - fr
  - en
tags:
  - chatml

French Pro model

This version aims to be a multilingual model (EN 🇺🇸 + FR🇫🇷) to refine the specific professional tasks in French. This model is adapted to professional tasks with advanced RAG contexts.

Dataset

EnnoAi-Pro has been trained on a French dataset to enhance its analysis and response quality. The dataset contains ~275K high-quality training samples of professional and general strategic themes.

Tuning

We used note specific recipe with QLora methods to increase accuracy with RAG techniques.

Prompt Format

We use the default ChatML format with system role support.

<|begin_of_text|><|im_start|>system
{SYSTEM_CONTEXT}<|im_end|>
<|im_start|>user
{USER_ENTRY}<|im_end|>
<|im_start|>assistant
{ASSISTANT_ENTRY}<|im_end|>

This model is under construction