ChatGPT Scores AIR 4 in JEE Advanced Mock Test

In yet another case of artificial intelligence matching human intellect, ChatGPT o3, OpenAI’s latest version of the chatbot, has achieved a jaw-dropping 327 out of 360 in a mock test for JEE Advanced 2025. ChatGPT o3’s brilliance translates to an all India rank of 4. The IIT JEE Advanced is considered one of the most difficult to crack in India for aspiring engineers.

An IIT Kharagpur graduate named Anushka Aashvi experimented with ChatGPT o3, giving it prompts to solve the mock test, and was blown away by the results. To ensure fairness, Anushka gave a prompt to ChatGPT o3, asking it to solve the test with the mindset of an IIT aspirant. Anushka also asked the chatbot to not take any assistance from external tools such as Google search or Python.

Coming to the mock test solving on ChatGPT o3, Anushka addressed each question in a new chat session to prevent memory bias. In addition, no hints or corrections were given throughout the mock test. Despite these challenges, ChatGPT o3 surprised Anushka by scoring perfect 60s in mathematics and chemistry in the second phase while missing just a few marks in physics.

Demonstrating marvelous problem-solving skills in topics such as complex calculus and multi-concept physics problems, ChatGPT o3’s step-by-step methodical approach was similar to that of a well-prepared JEE aspirant. The chatbot even solved difficult questions in chemistry, involving skeletal chemical structures with impressive accuracy.

However, ChatGPT o3 had its share of flaws. The AI struggled to solve the questions that demanded interpreting graphs and visual tools like the Vernier scale, displaying its shortcomings in processing tactile and visual data.

Incidentally, ChatGPT-4’s performance in a similar test a few years ago would have ranked it in the 10,000s. However, this time, ChatGPT o3’s phenomenal achievement once again highlights the future of AI in the education sector. Each year, over 15 lakh aspirants take the JEE Advanced in a highly competitive environment to join the country’s prestigious IITs, with only the top 17,000 making the cut.