Will AI image generating models score >= 90% on Winoground by June 1, 2025?
Plus
21
Ṁ8452025
81%
chance
1D
1W
1M
ALL
Based on the recent discussions between Gary Marcus and @ScottAlexander, this market resolves as follows:
IF any AI image generating model (such as DALL-E, Imagen, Stable Diffusion, etc) scores 90% or more on the Winoground image composition test, this market resolves YES.
ELSE this market resolves NO.
Relevant Links:
Scott's post: https://astralcodexten.substack.com/p/i-won-my-three-year-ai-progress-bet
Gary's post: https://garymarcus.substack.com/p/did-googleai-just-snooker-one-of
Winoground: https://arxiv.org/pdf/2204.03162v2.pdf
This question is managed and resolved by Manifold.
Get
1,000
and3.00
Related questions
Related questions
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
53% chance
Will AI be able to generate correct images of a chess game in 2024?
29% chance
Will AI pass the Winograd schema challenge by the end of 2024?
66% chance
Will there be a model that has a 75% win rate against the latest iteration of GPT-4 as of January 1st, 2025?
70% chance
Will an AI agent system be able to score at least 40% on level 3 tasks in the GAIA benchmark before 2025.
36% chance
Will an AI score over 10% on FrontierMath Benchmark in 2025
67% chance
Will an AI SWE model score higher than 50% on SWE-bench in 2024?
20% chance
Will open-source AI win (through 2025)?
33% chance
Will any image-generation AI be able to consistently draw simple polygons by the end of 2024?
19% chance
Will any AI by OpenAI be able create images of analog clock showing the correct time by 2024 end?
14% chance