tutorials

NASA Perseverance Makes History: First AI-Planned Drive on Mars

Bob Jiang

February 6, 2026

7 min read•Featured

On December 8 and 10, 2025, something remarkable happened on Mars. For the first time in history, NASA's Perseverance rover drove across the Martian surface following routes planned entirely by artificial intelligence—specifically, using vision-language models (VLMs) rather than human operators.

This historic demonstration marks a pivotal moment in both space exploration and autonomous robotics, showcasing how generative AI is evolving from experimental technology to mission-critical systems capable of navigating one of the most challenging environments in our solar system.

The Challenge: Navigating Mars from 140 Million Miles Away

Mars presents unique challenges for robotic navigation. The planet is, on average, 140 million miles (225 million kilometers) from Earth. This vast distance creates a significant communication lag—messages take between 4 and 24 minutes to travel one way, depending on the planets' positions.

This lag makes real-time remote control impossible. You can't "joystick" a rover on Mars the way you might pilot a drone on Earth. Instead, for the past 28 years across multiple missions, NASA has relied on human "rover planners" who:

  1. Analyze terrain data from orbital imagery and rover sensors
  2. Sketch safe routes using waypoints (typically spaced no more than 330 feet or 100 meters apart)
  3. Send commands via NASA's Deep Space Network
  4. Wait for the rover to execute the plan and report back

This process works, but it's time-intensive and limits how far rovers can travel in a single Martian day (sol). Enter generative AI.

Vision-Language Models: AI That Sees and Reasons

The technology behind Perseverance's autonomous drives is a vision-language model (VLM)—specifically, Anthropic's Claude. But what exactly is a VLM, and why is it suited for Mars navigation?

What Are Vision-Language Models?

Vision-language models combine two powerful AI capabilities:

  • Computer vision: Understanding images, identifying objects, and analyzing spatial relationships
  • Natural language processing: Reasoning about goals, constraints, and context

Unlike traditional computer vision systems that simply detect objects ("rock at coordinates X,Y"), VLMs can reason about what they see in context: "There's a boulder field ahead that the rover should avoid. A safer route would arc to the south where the terrain looks flatter based on the shadows and surface texture."

The Architecture

Modern VLMs work by:

  1. Processing visual input through convolutional neural networks or vision transformers
  2. Encoding visual features into embeddings that capture spatial and semantic information
  3. Fusing visual and textual data through cross-modal attention mechanisms
  4. Generating outputs that can include text descriptions, waypoint coordinates, or action plans

For navigation tasks, VLMs excel at:

  • Terrain classification: Distinguishing bedrock from sand, stable ground from hazards
  • Obstacle identification: Spotting rocks, craters, slopes, and other dangers
  • Spatial reasoning: Planning paths that balance efficiency with safety
  • Contextual understanding: Incorporating mission constraints and vehicle capabilities

How NASA Used AI to Plan Perseverance's Route

For the December 2025 demonstration, NASA's Jet Propulsion Laboratory (JPL) followed a carefully orchestrated process:

Step 1: Data Preparation

The team provided Claude Code (Anthropic's programming agent) with:

  • High-resolution orbital imagery from the HiRISE (High Resolution Imaging Science Experiment) camera aboard NASA's Mars Reconnaissance Orbiter
  • Digital elevation models showing terrain slopes and topography
  • Historical mission data representing "years" of contextual information about rover operations
  • Mission constraints including safe traverse slopes, obstacle clearance requirements, and target destinations

Step 2: AI Analysis and Planning

Using its vision capabilities, Claude:

  1. Analyzed overhead images to identify terrain features:

    • Bedrock outcrops
    • Boulder fields
    • Sand ripples
    • Potential hazards
  2. Generated waypoints by:

    • Creating 10-meter segments
    • Iterating point-by-point to build a continuous path
    • Balancing route efficiency with safety margins
  3. Produced drive commands compatible with Perseverance's flight software

Step 3: Validation Through Digital Twin

Before sending anything to Mars, the engineering team:

  • Processed commands through JPL's "digital twin" (a virtual replica of Perseverance)
  • Verified over 500,000 telemetry variables
  • Ensured complete compatibility with the rover's onboard systems

This validation step is crucial. In space exploration, you can't deploy a software patch if something goes wrong 140 million miles away.

Step 4: Execution on Mars

On Sol 1,707 (December 8), Perseverance drove 689 feet (210 meters) following AI-generated waypoints.

Two days later on Sol 1,709, it drove 807 feet (246 meters).

Both drives succeeded without human intervention in the planning phase.

What Makes This Different from Previous Autonomy

Perseverance already had autonomous navigation capabilities through AutoNav, which allows the rover to make real-time adjustments around obstacles. So what's new?

Human Planning vs. AI Planning

Traditional approach (1997-2025):

  • Humans analyze imagery and telemetry
  • Humans decide where waypoints should be
  • Rover executes and makes minor course corrections

New approach (2025+):

  • AI analyzes the same imagery and telemetry
  • AI generates waypoint locations and paths
  • Humans validate before transmission
  • Rover executes with AutoNav backup

The key difference: Strategic planning is now AI-assisted, not just tactical obstacle avoidance.

The Three Pillars of Autonomous Navigation

As JPL space roboticist Vandi Verma explains, generative AI is showing promise across all three pillars:

  1. Perception: Seeing rocks, ripples, and terrain features
  2. Localization: Knowing precisely where the rover is
  3. Planning and Control: Deciding and executing the safest path

Previous autonomous systems excelled at perception and localization but required human judgment for high-level planning. VLMs are closing that gap.

Implications for Future Space Exploration

This demonstration has profound implications for missions beyond Mars:

Increased Efficiency

"We are moving towards a day where generative AI and other smart tools will help our surface rovers handle kilometer-scale drives while minimizing operator workload," says Verma.

Instead of multiple planning sessions for short drives, rovers could traverse much longer distances between human check-ins.

Enhanced Science Return

VLMs could flag interesting surface features by analyzing huge volumes of rover images automatically, alerting human scientists to promising targets they might have missed.

Deep Space Missions

As NASA Administrator Jared Isaacman notes: "Autonomous technologies like this can help missions operate more efficiently, respond to challenging terrain, and increase science return as distance from Earth grows."

For missions to:

  • Jupiter's moons (communication delay: 35-52 minutes one way)
  • Saturn's moons (66-90 minutes)
  • Interstellar space (hours to days)

Autonomous AI planning isn't just convenient—it's essential.

Lunar Infrastructure

Matt Wallace, manager of JPL's Exploration Systems Office, envisions: "Intelligent systems not only on the ground at Earth, but also in edge applications in our rovers, helicopters, drones, and other surface elements trained with the collective wisdom of our NASA engineers, scientists, and astronauts."

This technology could support:

  • Automated lunar construction
  • Autonomous resource extraction
  • Self-managing habitat systems

All critical for establishing a permanent human presence on the Moon and eventual crewed missions to Mars.

Technical Challenges and Considerations

While the demonstration succeeded, several challenges remain:

Edge Computing Constraints

Current VLMs require significant computational resources. For spacecraft and rovers with limited power and processing capabilities:

  • Model compression: Smaller "smol-VLM" models (1B-10B parameters) sacrifice some accuracy for edge deployment
  • Specialized hardware: Chips optimized for inference (like NVIDIA Jetson Orin) enable sub-100ms responses
  • Selective processing: Running complex analysis only when needed, using simpler systems for routine operations

Safety and Verification

As demonstrated by NASA's 500,000 variable validation:

  • Formal verification methods must ensure AI outputs won't damage hardware
  • Redundant systems provide backups if AI planning fails
  • Human oversight remains critical for high-stakes decisions

Environmental Adaptability

Research shows VLMs perform differently based on environment:

  • Better in smaller, structured spaces
  • Performance can drop in large open areas
  • May struggle with novel terrain types not in training data

NASA will need to build robust models trained on diverse planetary environments.

The Road Ahead

This demonstration is just the beginning. The next steps likely include:

  1. Extended autonomous operations: Longer drives with less human oversight
  2. Multi-robot coordination: VLMs managing fleets of rovers, helicopters, and drones
  3. Adaptive learning: Systems that improve their planning based on mission experience
  4. Real-time scientific decision-making: AI identifying and prioritizing scientific targets autonomously

Conclusion: AI as Mission Partner

NASA's successful AI-planned Mars drives represent more than a technical milestone. They demonstrate a fundamental shift in how we explore space—from humans as constant overseers to humans as strategic partners with intelligent autonomous systems.

Vision-language models are proving capable of the kind of contextual reasoning and spatial planning previously requiring human judgment. As these systems mature, they'll extend humanity's reach to destinations where real-time control is impossible and autonomous decision-making is essential.

The Perseverance rover's December drives were short—less than a kilometer each. But they marked the beginning of a much longer journey: one where AI and human explorers work together to unlock the mysteries of our solar system and beyond.


The technology demonstrated in NASA's Mars missions often finds applications on Earth. The same vision-language model approaches used for Mars navigation are being adapted for autonomous vehicles, warehouse robots, and search-and-rescue systems operating in GPS-denied environments.

References

Share this article:

Tags:

#NASA#autonomous navigation#vision-language models#Mars exploration#space robotics#AI#generative AI

About Bob Jiang

Robotics engineer and AI researcher with 10+ years experience in agile software management, AI, and machine learning.

Related Articles