xAI is Elon Musk's new AI startup, founded in Mar 2023. It's rumored that they have already bought thousands of GPUs. Musk probably has the capital and charisma to poach top engineers. https://www.theverge.com/2023/4/14/23684005/elon-musk-new-ai-company-x
1,000
3.00@Ryannn what is the criterion by which you are going to resolve this question? The leaderboard for BIG-Bench Lite hasn't been updated in a long while, and does not list either model. The BigCodeBench Leaderboard (hard) is regularly updated, it currently lists an un-specified model "Grok-Beta". Does the BigCodeBench leaderboard suffice for market resolution?
@Ryannn any guidance on how you might want to resolve this?
@Ryannn I can outline what informed my bet: in the family of BIG-Bench scores, I could only find the leaderboard on CodeBench I referred to in my earlier comment. There Grok is behind, hence my bet on NO. I could not find other BIG-Bench leaderboards that includes both models, but maybe I have missed them. For example, this leaderboard has BIG-Bench Hard as a benchmark but does not feature GPT4-Turbo, nor Grok-2.
That said, I would ask other traders / mods for guidance on the resolution, given that a BIG-Bench score as you may have intended at the time of creating this market does not appear to exist for Grok-2.
Well they claim Grok 2 beats gpt 4 turbo on mmlu. We will need to wait for API access to do an evaluation on big bench.
https://www.ft.com/content/19cce4b5-b2dd-4c1e-a109-b500e504dbb6
What is this?
What is Manifold?
Are our predictions accurate?
How do I win cash prizes?
and can't be cashed out. to participate and winners can withdraw sweepcash as a cash prize. You can filter for sweepstakes markets on the browse page.1.00Related questions
What is this?
What is Manifold?
Are our predictions accurate?
How do I win cash prizes?
and can't be cashed out. to participate and winners can withdraw sweepcash as a cash prize. You can filter for sweepstakes markets on the browse page.1.00