Will second-order optimizers displace first-order optimizers for training LLMs by 2030? | Manifold

Will second-order optimizers displace first-order optimizers for training LLMs by 2030?

Plus

26

Ṁ1759

2029

42%

chance

1D

1W

1M

ALL

Will something like Shampoo become the default instead of Adam?

This question is managed and resolved by Manifold.

Get

1,000

and

3.00

Sort by:

Seems possible but <50%? Why do you think it's so high?

Related questions

Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?

Will the best LLM in 2024 have <1 trillion parameters?

Will LLMs be better than typical white-collar workers on all computer tasks before 2026?

Will a LLM beat human experts on GPQA by Jan 1, 2025?

Will Inflection AI claim to have the best LLM in the world before 2025?

Will LLMs mostly overcome the Reversal Curse by the end of 2025?

Will reinforcement learning overtake LMs on math before 2028?

Will Google have a better LLM than OpenAI by 2025?

Will the best public LLM at the end of 2025 solve more than 5 of the first 10 Project Euler problems published in 2026?

LLMs widely used in economics modeling by the end of 2026?

Related questions

Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?

Will LLMs mostly overcome the Reversal Curse by the end of 2025?

Will the best LLM in 2024 have <1 trillion parameters?

Will reinforcement learning overtake LMs on math before 2028?

Will LLMs be better than typical white-collar workers on all computer tasks before 2026?

Will Google have a better LLM than OpenAI by 2025?

Will a LLM beat human experts on GPQA by Jan 1, 2025?

Will the best public LLM at the end of 2025 solve more than 5 of the first 10 Project Euler problems published in 2026?

Will Inflection AI claim to have the best LLM in the world before 2025?

LLMs widely used in economics modeling by the end of 2026?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules