Commit History

Add dataset creation script
c92ce97

m3hrdadfi commited on

Saving weights and logs of step 57500
ca87603

saied commited on

Saving weights and logs of step 55000
f7eb0c5

saied commited on

Saving weights and logs of step 52500
010c4cf

saied commited on

Saving weights and logs of step 50000
1c4a009

saied commited on

Saving weights and logs of step 47500
c91e660

saied commited on

Saving weights and logs of step 45000
32306ce

saied commited on

Saving weights and logs of step 42500
d81ff25

saied commited on

Saving weights and logs of step 40000
c95b078

saied commited on

Saving weights and logs of step 37500
dacda15

saied commited on

Saving weights and logs of step 35000
bc7b998

saied commited on

Saving weights and logs of step 32500
d50e019

saied commited on

Saving weights and logs of step 30000
d5bba1b

saied commited on

Saving weights and logs of step 27500
2e9e4dc

saied commited on

Saving weights and logs of step 25000
f389a77

saied commited on

Saving weights and logs of step 22500
fb09f75

saied commited on

Saving weights and logs of step 20000
80d1da9

saied commited on

Saving weights and logs of step 17500
730ca0d

saied commited on

Saving weights and logs of step 15000
cbfcb64

saied commited on

Saving weights and logs of step 12500
853161d

saied commited on

Saving weights and logs of step 10000
cd7d53d

saied commited on

Saving weights and logs of step 7500
bb9fbf4

saied commited on

Saving weights and logs of step 5000
72f0bfa

saied commited on

Saving weights and logs of step 2500
1a4b666

saied commited on

change run.sh
70704f2

saied commited on

pushing tokenizer
c36ebf7

saied commited on

Add runner, fix some bugs
31bf2aa

m3hrdadfi commited on

Merge remote-tracking branch 'origin/saied' into develop
8918872

m3hrdadfi commited on

Remove junks
a749413

m3hrdadfi commited on

adding remove add and remove tag functions
a32918a

saied commited on

Remove extra file
4350a5a

m3hrdadfi commited on

Add normalization steps, fix som bugs, add tfboard tracker
1809a17

m3hrdadfi commited on

Merge remote-tracking branch 'origin/saied' into develop
9eca64d

m3hrdadfi commited on

Refine saied code
09f9c26

m3hrdadfi commited on

Add normalization steps
a90e731

m3hrdadfi commited on

Add normalization steps
74e88fc

m3hrdadfi commited on

some modification in preprocessing/urls removing
ad582b6

saied commited on

some modification in preprocessing
79fa2a7

saied commited on

editted data_utils-url,html,streched alphabet
95cd35a

saied commited on

Add notebook for data flaws
ec2c00e

m3hrdadfi commited on

Fix rm files
bce7e0a

m3hrdadfi commited on

Add training script with checkpoint and preprocessing + merge scripts
7cfca48

m3hrdadfi commited on

Merge remote-tracking branch 'origin/hooman' into develop
8812e32

m3hrdadfi commited on

adding dataset prepration module
73d5951

saied commited on

adding training demo notebook-flax/jax
be67d26

saied commited on

pushing a template clm training script for gpt2
01ae861

Hooman Sedghamiz commited on

adding a demo for using dataset features
3a36a39

saied commited on

Update readme
6040dc3

m3hrdadfi commited on

Hello gpt2-persian
21d29cb

m3hrdadfi commited on

initial commit
e9ad52d

system HF staff commited on