---
license: apache-2.0
---

# Model Card for Model ID


The base model ``ganga-1b`` trained on a monolingual Hindi language dataset as part of the Project Unity

## Model Details

### Model Description

Project Unity is an initiative aimed at addressing India's linguistic diversity and richness by creating a comprehensive resource that covers the country's major languages. Our goal is to achieve state-of-the-art performance in understanding and generating text in Indian languages. To achieve this, we train models on monolingual regional languages of India. Our first release is the Ganga-1B model, which has been trained on a large dataset of public domain web-crawled hindi language data, including news articles, web documents, books, government publications, educational materials, and social media conversations (filtered for quality). Additionally, the dataset has been further curated by native Indian speakers to ensure high-quality. Importantly, the Ganga-1B model outperforms existing open-source models that support Indian languages, even at sizes of up to 7 billion parameters. Designed to be compact and efficient, the model can easily run on edge devices, making it ideal for a range of applications that require generating human-like text. Its modest size also enables easy integration into resource-constrained environments, such as personal devices or cloud infrastructure, allowing for wider adoption and innovation in AI-driven technologies.



- **Developed by:** Lingo-IITGN
- **Model type:** Transformer-based Language Model
- **Language(s) (NLP):** Hindi (hi)
- **License:** Apache 2.0



## How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]


## Bias, Risks, and Limitations


### Recommendations

This service is a research preview, and as such, it only provides limited safety measures. Additionally, it may generate offensive content. It is strictly prohibited to use this service for any illegal, harmful, violent, racist, or sexual purposes.

Please note that you should not upload any private information. The service collects user dialogue data, which includes both text and images, and reserves the right to distribute it under a Creative Commons Attribution (CC-BY) license or a similar license.




## Evaluation



### Results


|    Model    | Fertility |   PPL  |
|:-----------:|:---------:|:------:|
|   ganga-1b  |    1.12   |  34.85 |
| airavata-7b |    1.69   |  46.24 |
|  pragna-1b  |    1.58   |  12.74 |
|  bloom-1b1  |    1.27   |  33.39 |
|  bloom-1b7  |    1.27   | 873.08 |
|   bloom-3b  |    1.27   |  23.77 |
|   gemma-2b  |    1.89   |    -   |


#### Summary




## Model Card Contact

Lingo-IITGN