Update geneformer/tokenizer.py

Filter gene mapping dict for items that exist in gene_token_dict

Update geneformer/tokenizer.py

Add function for summing of Ensembl IDs

move dicts to init

update tokenizer to include eos token

fix cell state gene embeddings bug (#345)

patch datasets save_to_disk

correct typo

Update readthedocs for classifier

Get the gene keys and gene list keys from the token dictionary instead of medians (#304)

Add classifier module and examples

Fix typo (#301)

Add option for variable input_size and to add CLS/SEP Tokens (#299)

edit docstring format to highlight options

change doc formatting

add sphinx docs

Add option for modified batch size for loom tokenizer

Add option for modifying chunk size for anndata tokenizer

tokenizer-uncropped-input_ids (#275)

anndata_tokenizer (#170)

Add error for no files found and suppress loompy import warning

Update tokenizer to allow tokenization without custom cell attributes

Modify tokenizer to allow renaming attr names btwn loom and .dataset

Add further explanation regarding input file format for transcriptome tokenizer

Add further explanation to tokenizer example script and updated tokenizer to match loompy raised error

Fix bug with metadata when processing multiple .loom files (#3)

Add data collator for cell classification and example for cell classification

Add Geneformer tokenizer and updated model card