metadata

language:
  - en
library_name: transformers
license: other

Model Card for ContractAssist model

Instruction tuned FlanT5-XXL on Legal Clauses data generated via ChatGPT. The model is capable for generating and/or modifying the Legal Clauses.

Model Details

Model Description

Developed by: Jaykumar Kasundra, Shreyans Dhankhar
Model type: Language model
Language(s) (NLP): en
License: other
Resources for more information:
- Associated Paper

Uses

Running the model on a GPU in 8bit

Click to expand

# pip install accelerate peft bitsandbytes
import torch
from transformers import AutoModelForSeq2SeqLM, AutoTokenizer
from peft import PeftModel,PeftConfig
peft_model_id = 'NebulaSense/ContractAssist'

peft_config = PeftConfig.from_pretrained(peft_model_id) 

model =  AutoModelForSeq2SeqLM.from_pretrained(peft_config.base_model_name_or_path, device_map="auto",load_in_8bit=True)
tokenizer = AutoTokenizer.from_pretrained(peft_config.base_model_name_or_path)
model = PeftModel.from_pretrained(model, peft_model_id)
model.eval()

Direct Use

The model can directly be used to generate/modify legal clauses and help assist in drafting contracts. It likely works best on english language.

Compute Infrastructure

Amazon SageMaker Training Job.

Hardware

1 x 24GB NVIDIA A10G

Software

Transformers, PEFT, BitsandBytes

Citation

BibTeX:

Model Card Authors

Jaykumar Kasundra, Shreyans Dhankhar