Preconference Day: Summits & Workshops - GMT (Greenwich Mean Time, GMTZ)
2025 hackathon topic below - 2026 coming soon!
Description:
Hackathon participants will work to create prompts that prevent cognitive biases of AI from affecting the result across four categories of tasks.
Each task will be designed to trigger one or more of the cognitive biases and psychological effects in AI.
Biases and Psychological Effects:
The participants will design an approach to counter the following biases and psychological effects in AI:
- Confirmation Bias
- Truth Bias
- Framing Effect
- Priming Effect
- Informational Anchoring
- Priming-Induced Anchoring
Categories
1. Sentiment Analysis (predict the impact of a news headline on stock prices)
2. Regulatory Compliance (determine compliance or noncompliance with a regulatory clause)
3. Document Evaluation (evaluate the quality of a paragraph on the scale from 0 to 100)
4. Classification (assign one of several possible classes based on class descriptions)
Prizes:
There will be a prize for the best result in each category, as well as the Grand Prize that will be awarded to the best result across all four categories.
Notes:
The winning entries will be profiled in Alexander Sokol's AI workshop on Tuesday.
Scoring:
Before the competition, 50% of the tasks will be randomly assigned to the public dataset for use during the hackathon, and the other 50% will be used for scoring. Participants will use the public dataset to create a prompt for each of the competition categories they choose to participate in.
For scoring, each task in the scoring dataset will be presented in a way that triggers one of the cognitive biases and psychological effects in AI. The participant's prompt will be combined with the task, and the results will then be scored by running statistical analysis for the magnitude of bias.
Participants are free to use coding or any external tools (including proprietary tools) for prompt development, or develop their prompts using ChatGPT or any other software.
A tool from CompatibL for scoring the public dataset will be made available during the hackathon online and as an open source package on GitHub. The use of this tool is optional.
To prepare:
The participants are encouraged to review the book "Thinking, Fast and Slow" by Daniel Kahneman and other literature on cognitive biases and psychological effects.
- Alexander Sokol - Executive Chairman, CompatibL