A GPT-4 Capability Forecasting Challenge
Date : 2023-07-15

Presentation

This is a game that tests your ability to predict ("forecast") how well GPT-4 will perform at various types of questions. (In case you've been living under a rock these last few months, GPT-4 is a state-of-the-art "AI" language model that can solve all kinds of tasks.)

Many people speak very confidently about what capabilities large language models do and do not have (and sometimes even could or could never have). Nicholas Carlini built this game as he got the impression that most people who make such claims don't even know what current models can do. So: put yourself to the test.

How likely do you think GPT-4 is to answer the question below correctly? Try it out here, and learn how models work

Link
We care about your privacy so we do not store nor use any cookie unless it is stricly necessary to make the website to work
Got it
Learn more