sartifyllc

/

deltaq-min

like 1

Follow

Sartify LLC 6

• "torch.nn.modules.container.ModuleList",
• "collections.OrderedDict",
• "__builtin__.set",
• "torch.nn.modules.container.Sequential",
• "__main__.SwiGLU",
• "__main__.DeltaqBlock",
• "__main__.RMSNorm",
• "torch.nn.modules.linear.Linear",
• "torch.nn.modules.sparse.Embedding",
• "torch._utils._rebuild_parameter",
• "torch.nn.modules.dropout.Dropout",
• "torch._utils._rebuild_tensor_v2",
• "__main__.RoPEMaskedMultiheadAttention",
• "torch.FloatStorage",
• "__main__.Deltaq",
• "__main__.RoPEAttentionHead"

How to fix it?