Text Generation
KerasHub
Keras
English
opt_125m_en / config.json
mattdangerw's picture
Upload folder using huggingface_hub
e522f36 verified
raw
history blame contribute delete
428 Bytes
{
"module": "keras_hub.src.models.opt.opt_backbone",
"class_name": "OPTBackbone",
"config": {
"name": "opt_backbone_1",
"trainable": true,
"vocabulary_size": 50272,
"num_layers": 12,
"num_heads": 12,
"hidden_dim": 768,
"intermediate_dim": 3072,
"dropout": 0.1,
"max_sequence_length": 2048
},
"registered_name": "keras_hub>OPTBackbone"
}