By EOY 2025, will the model with the lowest perplexity on Common Crawl will not be based on transformers? | Manifold

By EOY 2025, will the model with the lowest perplexity on Common Crawl will not be based on transformers?

Plus

32

Ṁ3701

2025

27%

chance

1D

1W

1M

ALL

If perplexity on Common Crawl is not available for models, I will use other benchmarks as a surrogate. This will inherently be a judgement process. If a model has not been announced by EOY 2025 and no benchmarks have been posted publicly, it will not be counted for the purpose of this market.

"Based on transformers" for the purpose of this question will be anything with multi-headed self-attention that feeds into an MLP.

This question is managed and resolved by Manifold.

Get

1,000

and

3.00

Sort by:

predictedNO

A MoE of transformer model still counts as "based on transformers" right?

predictedNO

Just to be clear here, if we think that it will be based on transformers, then we should vote No?

predictedNO

@jonsimon correct

@jonsimon wish they didn't not write the title with not so many double negatives

predictedNO

@ConnorMcCormick oh yeah that's definitely confusing people. We'll, better for us who do understand it :)

and thanks for the exit gigacasting! $1 -> $68 in five minutes

predictedNO

there are few situations where you want to buy a new market from 50% to 99.2%, you're just giving free money away, use limit oreders pls

lmao i beat michael's bot in buying shares

predictedNO

giving me a solid +2892.5% profit for m$1

i'mt not entirely sure what NO means on this market though

@jacksonpolack The API only refreshes the data every 15 seconds, so if you're quick on the draw, it's totally doable.

predictedNO

i'mt not entirely sure what NO means on this market though

Lol, me neither.

Related questions

When will a non-Transformer model become the top open source LLM?

Will OpenAI release an image model better than DALL-E 3 in 2024?

Will Transformer based architectures still be SOTA for language modelling by 2026?

By EOY 2026, will it seem as if deep learning hit a wall by EOY 2025?

Who will have the best Text-to-Image Model at the end of 2024 (as decided by the Artificial Analysis Leaderboard)?

Will Anthropic, Google, xAI or Meta release a model that thinks before it responds like o1 from OpenAI by EOY 2024?

-6% 1d27% chance

Will any open-source Transformers LLM model that function as a dense mixture of experts be released by end of 2024?

Will openAI have the most accurate LLM across most benchmarks by EOY 2024?

Will any image model available to the public be able to generate arbitrary non-adversarial text before 2025?

On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmark

Related questions

When will a non-Transformer model become the top open source LLM?

Will Anthropic, Google, xAI or Meta release a model that thinks before it responds like o1 from OpenAI by EOY 2024?

Will OpenAI release an image model better than DALL-E 3 in 2024?

Will any open-source Transformers LLM model that function as a dense mixture of experts be released by end of 2024?

Will Transformer based architectures still be SOTA for language modelling by 2026?

Will openAI have the most accurate LLM across most benchmarks by EOY 2024?

By EOY 2026, will it seem as if deep learning hit a wall by EOY 2025?

Will any image model available to the public be able to generate arbitrary non-adversarial text before 2025?

Who will have the best Text-to-Image Model at the end of 2024 (as decided by the Artificial Analysis Leaderboard)?

On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmark

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules