|
"""Guide content for the Quizbowl platform.""" |
|
|
|
GUIDE_MARKDOWN = """ |
|
# π― Quizbowl Bot Guide |
|
|
|
## Quick Start |
|
1. Choose between Tossup or Bonus mode |
|
2. Design your pipeline |
|
3. Test on example questions |
|
4. Submit for evaluation |
|
|
|
## Competition Rules |
|
|
|
### π§ Tossup Questions |
|
- **Format**: Individual questions with progressive difficulty |
|
- **Scoring**: |
|
- Correct early buzz: +10 points |
|
- Incorrect early buzz: -5 points |
|
- Correct after full read: +10 points |
|
- **Required Outputs**: |
|
- `answer`: Your predicted answer |
|
- `confidence`: Score between 0-1 |
|
- Buzz threshold: When to attempt answering |
|
|
|
### π Bonus Questions |
|
- **Format**: Three-part questions (10 points each) |
|
- **Scoring**: +10 points per correct part (max 30) |
|
- **Required Outputs**: |
|
- `answer`: Your predicted answer |
|
- `confidence`: Score between 0-1 |
|
- `explanation`: Brief justification for human collaboration |
|
|
|
## Building Your First Pipeline |
|
|
|
### 1. Simple Pipeline (Recommended for First Submission) |
|
- Single model step |
|
- Configure: |
|
- Model selection |
|
- Temperature (0.0-1.0) |
|
- System prompt |
|
- Required outputs |
|
|
|
### 2. Testing Your Pipeline |
|
1. Select an example question |
|
2. For Tossup: |
|
- Set buzz threshold (0.5-1.0) |
|
- Enable early stopping |
|
3. Run and check: |
|
- Answer accuracy |
|
- Confidence scores |
|
- Performance metrics |
|
|
|
### 3. Evaluation |
|
- Test on multiple questions |
|
- Monitor: |
|
- Accuracy |
|
- Confidence patterns |
|
- Response times |
|
|
|
### 4. Submission |
|
1. Log in |
|
2. Name your model |
|
3. Add description |
|
4. Submit for evaluation |
|
|
|
## Tips for Success |
|
- Start with simple pipeline |
|
- Test thoroughly before submission |
|
- Use appropriate temperature (0.3-0.7 recommended) |
|
- Monitor confidence scores |
|
- Check example submissions |
|
|
|
## Need Help? |
|
- Review example submissions |
|
- Check documentation |
|
- Contact support |
|
""" |
|
|