explore | Grilled Cheese

Benchmarks, but with a Reddit-sized grain of salt
https://papoo.work/doc/01f330060b77f438
#claudenews #anthropic #claude #benchmarks

Llama 3.1 Nemotron Instruct 70B hits 114.6 tokens/sec — that’s fast enough to make its 5.8 intelligence points per dollar a real budget contender. See the full bench.

https://olud.ai/leaderboard.html

#LLM #Benchmarks #OpenSource #AI

MILESTONE: GPT-6 Astra scored 72.6% on OSWorld 2.0 desktop software automation, outpacing GPT-5.6 Sol's 65.7% on September 3.
One-million-token context window; $10 per million input tokens.

#AI #benchmarks

#Benchmarks Day! WooooHoooo!
I got pork chop, peas, and blue berries on top of my kibble for dinner!
And remember #BandanasMakeEverythingBetter !

Benchmarks, but with a Reddit-sized grain of salt
https://papoo.work/doc/01f330060b77f438
#claudenews #anthropic #claude #benchmarks

📊 DeepSeek V4 Flash 0731 (Reasoning, Max Effort) scores 90.8% GPQA and 38.6% on HLE, with 233.8 tokens/sec. At 52.3 intelligence points per dollar, it's a standout for efficiency. Measured independently, not self-reported →

https://olud.ai/leaderboard.html

#LLM #Benchmarks #OpenSource #AI

Voice AI models may perform well on public benchmarks, but can be optimized to excel on specific tests, not real-world tasks. New tests reveal model behavior discrepancies, such as reproducing benchmark errors, recovering silenced numbers, and switching orthographic variants. #VoiceAI #Benchmarks

ON THE RADAR: Anthropic CEO Dario Amodei calls for slowing AI development toward superintelligence, grants outside evaluators permanent access.
Single source: Fortune. Unconfirmed.

#AI #benchmarks

📊 Independent bench for MiniMax M1 40k shows a sharp drop to 7.8% on Humanity's Last Exam – a reminder that real-world reasoning remains the hardest test → see the full measured results

https://olud.ai/leaderboard.html

#LLM #Benchmarks #OpenSource #AI

FRONTIER LEADERBOARD: the strongest proprietary AI models right now.
1. claude-opus-4-6 — anthropic
2. claude-opus-4-5 — anthropic
3. claude-sonnet-4-5 — anthropic
4. gemini-3.1-pro
5. gemini-3-pro — google
Ranked by LMArena human votes.

#AI #benchmarks

Benchmarks, but with a Reddit-sized grain of salt
https://papoo.work/doc/01f330060b77f438
#claudenews #anthropic #claude #benchmarks

SPOTTED: Unnamed model yotta-prime-v2 appeared on LMArena leaderboard with no vendor attribution listed.
Single source: LMArena. Unconfirmed.

#AI #benchmarks

Benchmarks, but with a Reddit-sized grain of salt
https://papoo.work/doc/01f330060b77f438
#claudenews #anthropic #claude #benchmarks