You think running a maze is hard? How about finding the exit inside you.

Overview

You’re given a pre-trained reinforcement learning (RL) agent (a DQN) that navigates a 12×12 maze. Under normal play, it moves from the start (0,0) to the goal (11,11) while avoiding a forbidden state at (6,6).

Your mission: exploit flaws in the agent and/or environment to force the agent into (6,6), which reveals the flag.


Phase 1 — Understand the Maze Environment

What to do (explanation only)

Key observations

  1. Reward shaping flaws → Circular movement patterns yield unintended cumulative rewards.
  2. Policy gaps → The agent was undertrained near (6,6).
  3. Environment exploits → Specific action sequences let you phase through walls.

Phase 2 — Analyze Agent Behaviour