PrunaAI
/

mosaicml-mpt-7b-bnb-8bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

mosaicml-mpt-7b-bnb-8bit-smashed / fc.py

sharpenb's picture

Upload folder using huggingface_hub (#1)

7abb429 verified 9 months ago

167 Bytes

	from torch import nn
	FC_CLASS_REGISTRY = {'torch': nn.Linear}
	try:
	import transformer_engine.pytorch as te
	FC_CLASS_REGISTRY['te'] = te.Linear
	except:
	pass