hanguo

/

lq-lora

like 3

• "models.quantization_utils.QuantScheme",
• "collections.OrderedDict",
• "models.quantization_utils_2.NFDoubleQuantizedTensorContainer",
• "torch.BFloat16Storage",
• "torch.bfloat16",
• "models.quantization_utils_2.FloatTensorContainer",
• "torch.device",
• "models.tensor_container_utils.QuantizedTensor",
• "torch._tensor._rebuild_from_type_v2",
• "torch.float16",
• "torch.HalfStorage",
• "torch.float32",
• "torch._utils._rebuild_wrapper_subclass",
• "torch.serialization._get_layout",
• "torch._utils._rebuild_tensor_v2",
• "models.quantization_utils_2.UIntQuantizedTensorContainer",
• "models.quantization_utils_2.PackedQuantizedTensorContainer",
• "torch.int64",
• "torch.ByteStorage",
• "torch.FloatStorage"

How to fix it?

• "transformers.trainer_utils.IntervalStrategy",
• "accelerate.state.PartialState",
• "accelerate.utils.dataclasses.DistributedType",
• "transformers.training_args.OptimizerNames",
• "torch.device",
• "transformers.trainer_utils.HubStrategy",
• "transformers.training_args.TrainingArguments",
• "transformers.trainer_utils.SchedulerType"

How to fix it?