This model is my starting point zero for trying to finetune model based on bitnet architecture. I just added new layers with random weights to the finished model.

Maybe it can be broken.

It is not recommended for use: the results show an improvement in test results at the margin of error.

Downloads last month
31
Safetensors
Model size
5.06B params
Tensor type
FP16
·
F32
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.