Evolve, Don't Retrain? Safety Adapters for Frozen World Models

Sachin Mohan
University of the Witwatersrand
Top: four sketches of a path with a hazard clear of it, grazing it, on it and on the goal. Bottom: the same four levels on recorded runs of TwoRoom, PushT, Reacher and a 3-D render of the Meta-World basketball scene with the robot arm and four keep-out boxes.

We place a hazard against a frozen planner's own path at four levels, from clear of the path to an unavoidable one on the goal, and ask whether a small evolved adapter beside the planner avoids it. The planner never sees the hazard.

Abstract

A small evolved adapter can make a frozen planner safer without retraining it. We evolve two kinds, each starting as an exact copy of the planner. Steer is a residual: it adds a sideways push to each move, away from the hazard. Choose is a re-ranker: it reorders the planner's own candidate plans and swaps in a clearer one when the planner's choice comes too close. Hazards are placed against the planner's path at four graded levels, from clear of the path to an unavoidable one on the goal. A noticeable result we found was that the adapters transfer. Evolved on three systems driven by two different planners, they ran unchanged on a fourth system that search never saw: every selected adapter beat the planner alone, and the best rose from 6 to 16/18 with no case lost. Untrained adapters gained there too, so it is the design that transfers. On the training systems, safe finishes rose from 18 of 54 to between 23 and 34 (11 of 12 significant). The price is some unfinished tasks. CMA-ES held a slight edge over random search, all of it on the unseen system, yet one untrained adapter did nearly as well as both: the design, not the optimizer, did most of the work. On Block Plucking, an arm task, search matched the planner alone.

The four hazard levels, in motion

Each video replays one recorded run of the planner alone, with the hazard placed at each of the four levels. The planner never sees the hazard, so it drives the same path every time: clear of level 1, and through levels 2 to 4.

TwoRoom

PushT

Reacher (unseen)

Basketball

The design transfers

One adapter is shared across TwoRoom, PushT (LeWM) and Meta-World basketball (TD-MPC2). Reacher is held out of search entirely and used only in the test, where the adapters ran unchanged.

Unseen system, best

6 → 16

safe finishes of 18; no case lost

Unseen system

12 / 12

selected adapters beat the planner alone

Training systems, best

18 → 34

safe finishes of 54

Training systems

11 / 12

significant gains over the planner alone

Results at a glance

Safe finishes on the test cases for every selected adapter, per system, against a dashed line for the planner alone.

The dashed line is the planner alone. Nearly every selected adapter sits to its right on every system, including Reacher, which search never saw. Blue: CMA-ES; orange: random search; grey squares: untrained adapters.

Going around the hazard

Five recorded paths in which Steer from CMA-ES goes around the hazard while the planner alone touches it.

Recorded paths, one test case per panel; a red × marks the first touch. In the first four panels Steer from CMA-ES goes around the hazard and finishes safely; in the last, Choose does.

BibTeX

@misc{mohan2026evolve,
  title  = {Evolve, Don't Retrain? Safety Adapters for Frozen World Models},
  author = {Mohan, Sachin},
  year   = {2026},
  note   = {University of the Witwatersrand},
  url    = {https://sachin2911.github.io/evolveDontRetrain/}
}