Mojiz

Mojiz is a finetuned MT5 model for Arabic summarization.

Model Description

Usage

from peft import PeftModel, PeftConfig
from transformers import AutoModelForSeq2SeqLM

config = PeftConfig.from_pretrained("ahmedabdelwahed/sft-base-12-epochs")
model = AutoModelForSeq2SeqLM.from_pretrained("google/mt5-base")
model = PeftModel.from_pretrained(model, "ahmedabdelwahed/sft-base-12-epochs")

Direct Use

Training Details

Training Data

[More Information Needed]

Training Procedure

Preprocessing [optional]

[More Information Needed]

Training Hyperparameters

  • Training regime: [More Information Needed]

[More Information Needed]

Evaluation

Metrics

[More Information Needed]

Results

[More Information Needed]

Model Examination [optional]

Citation [optional]

Framework versions

  • PEFT 0.7.1
Downloads last month
43
Safetensors
Model size
582M params
Tensor type
F32
·
Inference Examples
Inference API (serverless) does not yet support peft models for this pipeline type.

Model tree for ahmedabdelwahed/sft-base-12-epochs

Base model

google/mt5-base
Adapter
(20)
this model