/nfs/production/literature/amina-mardiyyah/envs/llm-prompt/lib/python3.11/site-packages/accelerate/accelerator.py:488: FutureWarning: `torch.cuda.amp.GradScaler(args...)` is deprecated. Please use `torch.amp.GradScaler('cuda', args...)` instead. self.scaler = torch.cuda.amp.GradScaler(**kwargs) Detected kernel version 4.18.0, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher. wandb: WARNING The `run_name` is currently set to the same value as `TrainingArguments.output_dir`. If this was not intended, please specify a different run name by setting the `TrainingArguments.run_name` parameter. Classification Report: precision recall f1-score support DNA 0.73 0.81 0.77 2494 RNA 0.71 0.70 0.70 238 cell_line 0.73 0.78 0.76 1050 cell_type 0.63 0.75 0.69 775 protein 0.86 0.87 0.87 6196 micro avg 0.79 0.84 0.81 10753 macro avg 0.73 0.78 0.76 10753 weighted avg 0.80 0.84 0.82 10753 Classification Report: precision recall f1-score support DNA 0.78 0.80 0.79 2494 RNA 0.77 0.79 0.78 238 cell_line 0.77 0.80 0.78 1050 cell_type 0.66 0.77 0.71 775 protein 0.86 0.91 0.88 6196 micro avg 0.81 0.86 0.83 10753 macro avg 0.77 0.81 0.79 10753 weighted avg 0.81 0.86 0.84 10753 Classification Report: precision recall f1-score support DNA 0.74 0.87 0.80 2494 RNA 0.78 0.87 0.82 238 cell_line 0.80 0.80 0.80 1050 cell_type 0.68 0.77 0.72 775 protein 0.88 0.89 0.88 6196 micro avg 0.82 0.86 0.84 10753 macro avg 0.78 0.84 0.81 10753 weighted avg 0.82 0.86 0.84 10753 Classification Report: precision recall f1-score support DNA 0.78 0.81 0.80 2494 RNA 0.79 0.88 0.83 238 cell_line 0.80 0.81 0.81 1050 cell_type 0.68 0.79 0.73 775 protein 0.87 0.90 0.89 6196 micro avg 0.83 0.87 0.84 10753 macro avg 0.78 0.84 0.81 10753 weighted avg 0.83 0.87 0.85 10753 Classification Report: precision recall f1-score support DNA 0.77 0.85 0.81 2494 RNA 0.84 0.87 0.85 238 cell_line 0.81 0.84 0.82 1050 cell_type 0.74 0.78 0.76 775 protein 0.88 0.90 0.89 6196 micro avg 0.83 0.87 0.85 10753 macro avg 0.81 0.85 0.83 10753 weighted avg 0.84 0.87 0.85 10753 Classification Report: precision recall f1-score support DNA 0.79 0.83 0.81 2494 RNA 0.83 0.86 0.84 238 cell_line 0.80 0.83 0.81 1050 cell_type 0.71 0.78 0.74 775 protein 0.88 0.90 0.89 6196 micro avg 0.84 0.87 0.85 10753 macro avg 0.80 0.84 0.82 10753 weighted avg 0.84 0.87 0.85 10753 Classification Report: precision recall f1-score support DNA 0.78 0.84 0.81 2494 RNA 0.84 0.89 0.86 238 cell_line 0.81 0.86 0.83 1050 cell_type 0.73 0.80 0.76 775 protein 0.88 0.90 0.89 6196 micro avg 0.84 0.87 0.85 10753 macro avg 0.81 0.86 0.83 10753 weighted avg 0.84 0.87 0.85 10753 Classification Report: precision recall f1-score support DNA 0.78 0.83 0.81 2494 RNA 0.84 0.87 0.86 238 cell_line 0.81 0.86 0.83 1050 cell_type 0.75 0.79 0.77 775 protein 0.88 0.90 0.89 6196 micro avg 0.84 0.87 0.85 10753 macro avg 0.81 0.85 0.83 10753 weighted avg 0.84 0.87 0.85 10753 Classification Report: precision recall f1-score support DNA 0.78 0.84 0.81 2494 RNA 0.83 0.89 0.86 238 cell_line 0.81 0.85 0.83 1050 cell_type 0.74 0.79 0.77 775 protein 0.88 0.90 0.89 6196 micro avg 0.84 0.87 0.86 10753 macro avg 0.81 0.86 0.83 10753 weighted avg 0.84 0.87 0.86 10753 Classification Report: precision recall f1-score support DNA 0.78 0.84 0.81 2494 RNA 0.83 0.87 0.85 238 cell_line 0.81 0.85 0.83 1050 cell_type 0.75 0.78 0.76 775 protein 0.88 0.90 0.89 6196 micro avg 0.84 0.87 0.86 10753 macro avg 0.81 0.85 0.83 10753 weighted avg 0.84 0.87 0.86 10753 Classification Report: precision recall f1-score support DNA 0.74 0.79 0.76 2210 RNA 0.73 0.76 0.75 287 cell_line 0.50 0.76 0.61 1057 cell_type 0.75 0.68 0.71 2761 protein 0.72 0.87 0.79 10082 micro avg 0.71 0.82 0.76 16397 macro avg 0.69 0.77 0.72 16397 weighted avg 0.72 0.82 0.76 16397 Test Set Results: {'eval_loss': 0.25901132822036743, 'eval_f1': 0.7609269081317186, 'eval_precision': 0.7112407211028632, 'eval_recall': 0.8180764774044033, 'eval_accuracy': 0.9229162898531661, 'eval_runtime': 8.311, 'eval_samples_per_second': 463.961, 'eval_steps_per_second': 57.995, 'epoch': 9.971126082771896}