KaleiNeely
/

fr-models

Model card Files Files and versions Community

fr-models / RWKV-5-World-0.1B-v1-20230803-ctx4096 /ncnn /int8 /RWKV-5-World-0.1B-v1-20230803-ctx4096-ncnn-int8.config

KaleiNeely's picture

reorg

02382cd over 1 year ago

history blame contribute delete

107 Bytes

	version: 5
	act_dtype: fp32
	weight_dtype: int8
	head_size: 12
	n_layer: 12
	n_embd: 768
	n_att: 768
	n_ffn: 3072