File size: 5,341 Bytes
9ff6a7b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 |
---
extra_gated_prompt: |-
By accessing TabPFN, you agree to:
1. Not use the model in ways that could harm individuals or communities
2. Comply with all applicable laws and regulations
3. Properly cite the model and its creators in any resulting publications
4. Report any discovered vulnerabilities or safety concerns to Prior Labs
extra_gated_fields:
Organization:
type: text
required: true
description: Company or institution you represent
Role:
type: text
required: true
description: Your role in the organization
Country:
type: country
required: true
description: Country where you or your organization is based
Intended Use:
type: select
required: true
options:
- Academic Research
- Education/Teaching
- Commercial Evaluation
- Non-profit Use
- Personal Learning
- label: Other
value: other
description: Primary intended use of TabPFN
Industry:
type: select
required: true
options:
- Healthcare/Life Sciences
- Financial Services
- Technology
- Education
- Manufacturing
- Research Institution
- label: Other
value: other
description: Your industry sector
Dataset Size:
type: select
required: true
options:
- <1000 rows
- 1000-10000 rows
- 10000-100000 rows
- '>100000 rows'
description: Typical size of datasets you plan to use
License Agreement:
type: checkbox
required: true
label: >-
I agree to the terms of the non-commercial license for research and
evaluation
Contact Permission:
type: checkbox
required: false
label: Prior Labs may contact me about my use case and provide support (optional)
pipeline_tag: tabular-classification
---
# Model Card for TabPFN-v2
TabPFN is a transformer-based foundation model for tabular data that leverages prior-data based learning to achieve strong performance on small tabular datasets without requiring task-specific training.
## Model Details
### Model Description
TabPFN is a novel approach to tabular data modeling that uses transformer architectures combined with prior knowledge injection to create a foundation model specifically designed for tabular data tasks.
- **Developed by:** Prior Labs
- **Model type:** Transformer-based foundation model for tabular data
- **Language(s):** Python
- **License:** Dual licensing - Open source for research/non-commercial use
- **Finetuned from model:** Custom architecture, trained from scratch
### Model Sources
- **Repository:** https://github.com/priorlabs/tabpfn
- **Paper:** [More Information Needed]
- **Demo:** Available via API access
## Uses
### Direct Use
TabPFN can be directly used for:
- Classification tasks on small to medium-sized tabular datasets
- Automated machine learning workflows
- Quick prototyping and baseline model creation
- Transfer learning applications for tabular data
### Downstream Use
The model can be used as:
- A feature extractor for downstream tasks
- A foundation for transfer learning on domain-specific tabular data
- A component in automated ML pipelines
- A baseline model for benchmarking
### Out-of-Scope Use
- The model is not designed for:
- Very large datasets (currently optimized for smaller datasets)
- Non-tabular data formats
- Time series forecasting
- Direct regression tasks
## Bias, Risks, and Limitations
- Performance may vary based on dataset size and characteristics
- Model behavior heavily depends on the quality and representativeness of training data
- May not perform optimally on highly imbalanced datasets
- Resource intensive for very large datasets
### Recommendations
- Use on datasets with clear structure and well-defined features
- Validate model outputs especially for sensitive applications
- Consider dataset size limitations when applying the model
- Monitor performance across different subgroups in the data
## How to Get Started with the Model
```python
from tabpfn import TabPFNClassifier
# Initialize model
classifier = TabPFNClassifier()
# Fit and predict
classifier.fit(X_train, y_train)
predictions = classifier.predict(X_test)
```
## Training Details
### Training Data
[More Information Needed]
### Training Procedure
#### Training Hyperparameters
- **Training regime:** Mixed precision training
## Evaluation
### Testing Data, Factors & Metrics
#### Metrics
- Classification accuracy
- F1 score
- ROC-AUC
- Precision-Recall curves
### Results
[More Information Needed]
## Environmental Impact
- **Hardware Type:** [More Information Needed]
- **Hours used:** [More Information Needed]
- **Cloud Provider:** [More Information Needed]
- **Compute Region:** [More Information Needed]
- **Carbon Emitted:** [More Information Needed]
## Technical Specifications
### Model Architecture and Objective
TabPFN uses a transformer-based architecture specifically designed for tabular data processing, with modifications to handle varying input sizes and feature types.
### Compute Infrastructure
#### Hardware
Recommended minimum specifications:
- CPU: Modern multi-core processor
- RAM: 16GB+
- GPU: Optional, CPU inference supported
#### Software
- Python 3.7+
- Key dependencies: PyTorch, NumPy, Pandas
## Model Card Contact
For more information, contact Prior Labs. |