ARCathon Continues!

ARCathon

Announcement

ARCathon continues!

The wait is over — the ARCathon resumes now. We celebrate a new milestone with a world record of 34% achieved on the private test set. Moreover, we’ve refined our methods for knowledge sharing, ensuring more effective insights transfer. Excitingly, significant changes are in the making to elevate ARC to its deserved prominence.

📅 April 16, 2024

Dear ARC Community,

The ARCathon continues today!

We have experienced some thrilling months, and if you haven’t been updated yet, here’s the most important news:

Jack Cole and his team MindsAI have surpassed the previous ARC world record, held by Michael Hodel at 31%, by achieving a new record of 34%! Their solution, an LLM specifically trained for ARC tasks, not only broke the record but also shows promise of reaching even higher scores. Read about Jack’s world record journey and his future plans in this interview.

In recognition of this milestone — surpassing the world record by 3% — Lab42 is pleased to award Jack Cole $3,000, which breaks down to $1,000 for each percentage point. Although this record was set after ARCathon 2023 concluded, and thus did not qualify for the prize money, Lab42 remains committed to celebrating and supporting the remarkable achievements of AI enthusiasts advancing the ARC.

Further exciting developments are underway. In March 2024, François Chollet and last year’s ARC Novelty Prize winners convened for a week-long workshop at Lab42, set against the stunning backdrop of the Swiss Alps in Davos, Switzerland. They explored potential ARC solutions and discussed groundbreaking approaches that could revolutionize not just ARC, but the entire AI field.

To accelerate progress, we’re creating a new exclusive ARC community circle with a “Solve ARC” mailing list, special events, and monthly ARC calls. Based on insights from ARCathon 2023 and ARC Week 2024, our focus has shifted from financial rewards to fostering active, collaborative participation and showcasing successes broadly. Participants delivering exceptional solutions — whether through high scores or innovative approaches — will benefit from the following rewards:

Exclusive Membership: Join the exclusive Solve ARC circle and mailing list to collaborate with fellow AI enthusiasts on solving ARC and achieve broader AI advancements.
Best Teams Video Conferences: Engage in monthly calls with the best ARC teams worldwide to share your progress. Directly interact with François Chollet and other AI experts, addressing any questions or ideas you wish to discuss.
Swiss Global AI Award: Gain recognition across the field of AI through features on Lab42 channels and prominent news outlets. The best teams will be honored at the annual Swiss Global AI Awards.
Engraved for Time: The first three teams to reach 42% of the private test with a unique solution can have their names engraved in a stone in or above Davos.
Join the Team: Gain the chance to collaborate with Lab42 on pioneering human-level AI research, either remotely or in Davos.

The ARCathon resumes today! Participants may submit up to three solutions per week, which will be evaluated on the private test set. Your results will be included in the official ARC all-time leaderboard, maintained by Lab42. In response to requests from teams who have launched startups and wish to keep their results confidential for now, we are offering the option to publish high scores anonymously.

Lastly, we are working hard on significant changes and exciting updates. While we can’t share the details just yet, rest assured that we are highly motivated to give you — and ARC — the focus it truly deserves!

Looking forward to another groundbreaking year,

Your Lab42 team