---
library_name: transformers
tags: []
---


## New custom modified architecture

### Inspired by NanoGPT(by Keller Jordan)

#### Making the archetecture work using AutoModelForCausalLM still WIP