Very excited that this is now also officially out!
We should also have results on more sophisticated agents, agents with recent open source LLMs, and more tasks soon.
🧪Can AI agents take a scientific paper and write a meaningful follow-up to it?
We introduce Into the Unknown, an AI agent benchmark of 15 open scientific research problems. Each problem comes from a scientist currently or formerly at US DOE National Labs:
@LosAlamosNatLab
Congrats to everyone with papers accepted to #NeurIPS.
I am thrilled to share that we successfully withdrew one of our #ICLR submissions, because we caught a serious evaluation error before submitting the #slop.
Story: We used Codex/Claude Code to help design and debug LLM
An example for why the p(doom) debate is imo so bad for achieving meaningful regulation. As we are discussing whether non-existent models -- that may not even be physically possible -- will kill us, there are lobbying efforts happening to shape regulation for many current issues.
🇪🇺 The EC stated it would introduce only minor simplifications within the #DigitalOmnibus, whilst maintaining a “high level of protection” for citizens. But a recently leaked doc appears to prioritise interests of #BigTech. @maxschrems takes a closer look. youtu.be/GsNCyS0algg
