llm-arch / src /data_synthesis /generate_data.py

Commit History

Checked type hints
2cb7b84

alfraser commited on

Tidied up generate_data.py
a1317da

alfraser commited on

Tidied up comments
acb7b9c

alfraser commited on

Fixed bugs in the dataload process with referencing the new json folder and then looking up the available databases.
7a2c982

alfraser commited on

Fixed a bug in generate data where it didn't reference the json folder in the new file sructure
0ff95ad

alfraser commited on

Added the scripts which were used to build the dataset to the repo, and tweaked to use common code
a19a983

alfraser commited on