gretelai
/

mpt-7b

Text Generation

StreamingDatasets

text-generation-inference

Model card Files Files and versions Community

mpt-7b / fc.py

sami-t's picture

Update to Latest Mosaic Version (#2)

c5e05a7 verified 11 months ago

167 Bytes

	from torch import nn
	FC_CLASS_REGISTRY = {'torch': nn.Linear}
	try:
	import transformer_engine.pytorch as te
	FC_CLASS_REGISTRY['te'] = te.Linear
	except:
	pass