JoPmt
/

MinLlama-3-8B-instruct-pass

Text Generation

NousResearch/Meta-Llama-3-8B-Instruct

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

MinLlama-3-8B-instruct-pass / mergekit_config.yml

JoPmt's picture

Upload folder using huggingface_hub

674d40c verified 7 months ago

676 Bytes


	slices:
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [0, 8]
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [10, 12]
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [14, 18]
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [20, 22]
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [24, 26]
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [28, 32]
	merge_method: passthrough
	base_model: NousResearch/Meta-Llama-3-8B-Instruct
	dtype: bfloat16