fakezeta
/

Phi-3.5-mini-instruct-ov-int4

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Phi-3.5-mini-instruct-ov-int4 / model.yaml

fakezeta's picture

Upload folder using huggingface_hub

fbed355 verified about 2 months ago

No virus

211 Bytes

	name: phi3.5-medium
	backend: transformers
	parameters:
	model: fakezeta/Phi-3.5-mini-instruct-ov-int4
	context_size: 8192
	type: OVModelForCausalLM
	trust_remote_code: true
	template:
	use_tokenizer_template: true