yahavb
/

nxd_vllm_1b

Model card Files Files and versions Community

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

yahavb's picture

Add NxD compiled model yahavb/nxd_vllm_1b for vLLM

7a96251 verified about 22 hours ago

weights
Add NxD compiled model yahavb/nxd_vllm_1b for vLLM about 22 hours ago
.gitattributes

1.52 kB

initial commit about 22 hours ago
model.pt
Detected Pickle imports (9)
- "__torch__.torch.classes.neuron.LayoutTransformation",
- "torch.jit._pickle.restore_type_tag",
- "__torch__.neuronx_distributed.trace.spmd.NxDModel",
- "__torch__.neuronx_distributed.trace.spmd.NxDModelExecutor",
- "torch.jit._pickle.restore_type_tag",
- "torch.IntStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
13.6 MB
LFS

Add NxD compiled model yahavb/nxd_vllm_1b for vLLM about 22 hours ago
neuron_config.json

5.22 kB

Add NxD compiled model yahavb/nxd_vllm_1b for vLLM about 22 hours ago