Thank you for your interest in AACR-Bench! We welcome contributions of all kinds, including but not limited to:
- 🐛 Reporting issues and suggestions
- 📝 Improving documentation
- 🔧 Submitting code fixes
- ✨ Adding new features
- 🌐 Contributing new evaluation data
- 🧪 Improving test coverage
- Search existing issues to check if the problem has already been reported
- Create a new issue using the appropriate issue template
- Provide as much detail as possible:
- Environment information (OS, Python version, etc.)
- Steps to reproduce
- Expected behavior vs actual behavior
- Relevant logs or screenshots
- Start by discussing your idea in Discussions
- After receiving community feedback, create a feature request issue
- If you're willing to implement the feature, please indicate so and wait for maintainer confirmation
If you'd like to contribute new PR data, please ensure:
- Data Quality
- PRs are from active open-source projects
- Contains meaningful code changes
- Has high-quality human reviews
- Data Format
- Conforms to the specified JSON schema
- Includes complete metadata
- Has been properly anonymized
- Annotation Requirements
- Reviewed by at least 2 experts
- Covers various issue types
- Place data in the
data/contributions/directory - Create a PR and explain the data source
Thank you to all contributors for their dedication! Your contributions make AACR-Bench better.
Happy Contributing! 🎉