Models with 536M parameters trained with 9.0B tokens.

StepLaw
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
StepLaw is an open-source project by StepFun AI (https://huggingface.co/stepfun-ai) featuring thousands of models for optimal hyperparameter research.
GitHub: https://github.com/step-law
Website: https://step-law.github.io/
Collections
38
models
1704

StepLaw/StepLaw-N_429M-D_1.0B-LR3.906e-03-BS524288
Text Generation
•
Updated

StepLaw/StepLaw-N_429M-D_1.0B-LR3.906e-03-BS32768
Text Generation
•
Updated

StepLaw/StepLaw-N_429M-D_1.0B-LR3.906e-03-BS262144
Text Generation
•
Updated

StepLaw/StepLaw-N_429M-D_1.0B-LR3.453e-04-BS131072
Text Generation
•
Updated

StepLaw/StepLaw-N_429M-D_1.0B-LR3.453e-04-BS65536
Text Generation
•
Updated

StepLaw/StepLaw-N_429M-D_1.0B-LR3.453e-04-BS524288
Text Generation
•
Updated

StepLaw/StepLaw-N_429M-D_1.0B-LR3.453e-04-BS32768
Text Generation
•
Updated

StepLaw/StepLaw-N_429M-D_1.0B-LR3.453e-04-BS262144
Text Generation
•
Updated

StepLaw/StepLaw-N_429M-D_1.0B-LR2.762e-03-BS131072
Text Generation
•
Updated

StepLaw/StepLaw-N_429M-D_1.0B-LR2.762e-03-BS65536
Text Generation
•
Updated
datasets
None public yet