Ai2 finds AI novelty judges can change verdicts when the framing changes
Ai2’s novelty benchmark tests how prompts, labels and retrieval affect judgments of research ideas. Here is how to interpret the results and use the released tools.
Ai2
Accessibility Adjustments
Use these optional tools to adjust reading and display preferences. These tools cannot resolve every accessibility barrier. Please contact the website owner if you need assistance.
Ai2’s novelty benchmark tests how prompts, labels and retrieval affect judgments of research ideas. Here is how to interpret the results and use the released tools.
