ARCathon
News & ARC Publications
ARCathon News
With a dual career spanning clinical psychology and software development, Jack Cole and his team have brought a unique perspective to tackling the ARC Challenge.
Leveraging cognitive insights and advanced machine learning techniques, the team’s approach stands out for its novel use of test-time fine-tuning and synthetic data enhancement.
The wait is over and the ARCathon is underway again. Make up to three submissions per week and join the ARC circle mailing list and monthly calls.
All information can be found in the announcement letter linked here.
The ARCathon 2023 is a wrap! We want to thank all 265 participating teams and are excited about all the innovative submissions. Take a look at our final standings and podium.
But the ARCathon journey does not end here. Stay tuned!
Win a trip to Lab42 in Davos, Switzerland, for a multi-day workshop alongside François Chollet! Travel expenses are covered and accommodations are provided by Lab42. To enter, submit an explanation of your ARC approach along with your code. The top three teams meeting the judging criteria will be selected at the conclusion of ARCathon 2023. Click the title link for more details.
Two-time Essay Competition winner and ARCathon participant Simon Ouellette discusses the intricacies of deep learning in the context of the ARC challenge. He highlights its difficulties in classifying prime numbers and underscores the limitations of both purely deep learning and DSL-based methods. He then proposes a modular architecture as a potential bridge between these two methodologies.
We are excited to welcome François Chollet for an exclusive Q&A session on October 18 at 6 p.m. CEST (GMT +2)! To kick things off, our moderators, Michael Hodel and Simon Ouellette, will discuss François's insights on the challenges of ARC. Afterward, we'll open the floor for audience questions.
ARCathon participants Jack Cole and Mohamed Osman discuss their strategy to tackle ARC with large language models and resources from Google's TPU Research Cloud. They emphasized the benefits of diverse datasets and meta-learning, discovering that test-time fine-tuning significantly boosted their model's performance.
Since September 10, teams from over 60 countries from 6 continents have registered. We are just waiting for you, Antarctica...
We have reached a total of over 200 teams in the ARCathon 2023! The Lab42 crew wishes all teams the best of luck in breaking the ARC world record of 30.5%!
In 2019, François Chollet published his paper "On the Measure of Intelligence" along where he introduced the Abstraction and Reasoning Corpus. Almost four years later, after a competition on Kaggle and with Lab42's second ARCathon in progress, the time is ripe to take a look at where we stand today, including an update from seven devoted ARC specialists.
As the year is progressing and the ARCathon has passed its halfway mark, we'd love to hear from you again! In a 5-6 minutes survey, let us know how you are progressing with your ARC solution and what we can offer to make your efforts more successful.
If you haven't yet submitted your ARC solution for the ARCathon leaderboard, we may be able to help. There is now a link to a test submission form on our ARCathon submission page. After submission, you will receive full feedback with log files and error messages!
The ARCathon evaluation is designed to be flexible and is deliberately based on Docker. Nevertheless, some have found the step of integrating their code into a Docker image a hurdle. For this reason, our ARCathon participant Taka has kindly published a repo with a ready-to-use Docker image. Fork this repo to submit your algorithms in the ARCathon with minimal hassle!
Simon Ouellette, the previous winner of the Principles of Intelligence essay competition, has done it again. In our latest essay competition, which ended in May, Simon detailed in 26 well-written pages how he intends to solve the ARC problem! Read his full essay to immerse yourself in the thought process of an ARC enthusiast, or simply read his executive summary for inspiration.
We have revised and debugged our ARC Playground and Editor. Become a pioneer and build the next global benchmark for AI of tommorow. Build your own ARC tasks and submit them to ARC 2 in the ARC Editor.
Join the Lab42 Discord server to discuss human-level AI and the ARC challenge. Here you will find over 5 different ARC discussion channels to share your thoughts, ask questions and discuss how to proceed with your solution finding processes.
ARC Publications
For Humankind
Villa Fontana Obere Strasse 22B 7270 Davos, Switzerland
Powered by 
