2 contributors

History: 10 commits

vitouphy

update lm

c5ea119 over 2 years ago

language_model
update lm over 2 years ago
.gitattributes

1.26 kB

initial commit over 2 years ago
.gitignore

61 Bytes

add trained model over 2 years ago
README.md

3.25 kB

add result over 2 years ago
added_tokens.json

23 Bytes

add trained model over 2 years ago
alphabet.json

763 Bytes

add language model over 2 years ago
build_lm_processor.ipynb

5.14 kB

update lm over 2 years ago
config.json

2.07 kB

add trained model over 2 years ago
eval.py

4.96 kB

add trained model over 2 years ago
eval.sh

118 Bytes

add lm info over 2 years ago
inference.ipynb

6.31 kB

add trained model over 2 years ago
log_openslr_km_test_predictions.txt
37.7 kB

update lm over 2 years ago
log_openslr_km_test_targets.txt

38.5 kB

add trained model over 2 years ago
openslr_km_test_eval_results.txt
49 Bytes

update lm over 2 years ago
preprocessor_config.json

262 Bytes

add lm info over 2 years ago
pytorch_model.bin
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
3.85 GB
LFS

add trained model over 2 years ago
special_tokens_map.json

1.08 kB

update unigram over 2 years ago
tokenizer_config.json

326 Bytes

update unigram over 2 years ago
train_kh.ipynb

425 kB

add trained model over 2 years ago
training_args.bin
Detected Pickle imports (6)
- "transformers.trainer_utils.HubStrategy",
- "transformers.trainer_utils.IntervalStrategy",
- "torch.device",
- "transformers.training_args.TrainingArguments",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.SchedulerType"
How to fix it?
2.99 kB
LFS

add trained model over 2 years ago
vocab.json

795 Bytes

add trained model over 2 years ago

Detected Pickle imports (3)

Detected Pickle imports (6)