---
license: gpl-3.0
---

## Neuro-GPT: Towards a Foundation Model for EEG  [paper](https://arxiv.org/abs/2311.03764)

#### Published on IEEE - ISBI 2024

We propose Neuro-GPT, a foundation model consisting of an EEG encoder and a GPT model. The foundation model is pre-trained on a large-scale data set using a self-supervised task that learns how to reconstruct masked EEG segments. We then fine-tune the model on a Motor Imagery Classification task to validate its performance in a low-data regime (9 subjects). Our experiments demonstrate that applying a foundation model can significantly improve classification performance compared to a model trained from scratch.

## Installation
```console
git clone git@github.com:wenhui0206/NeuroGPT.git
pip install -r requirements.txt
cd NeuroGPT/scripts
./train.sh
```

## Requirements
pip install -r requirements.txt

## Datasets
- [TUH EEG Corpus](https://isip.piconepress.com/projects/tuh_eeg/html/downloads.shtml#c_tueg)
- [BCI Competition IV 2a Dataset](https://www.bbci.de/competition/iv/#datasets)