Georgia Tech's MO-Playground Trains Robots 271x Faster With Open-Source GPU Tool

Researchers at Georgia Tech’s Dynamic Mobility Lab and the Army Research Laboratory have released MO-Playground, an open-source, pip-installable suite for multi-objective reinforcement learning on GPU physics engines. Its MORLAX algorithm learns policy families spanning competing goals such as energy use, smoothness, velocity tracking, and arm motion. Engineers can select a trade-off after training, avoiding another training cycle when deployment priorities change.

The accompanying research paper, published in IEEE Robotics and Automation Letters, reports wall-clock speedups of 21× to 271× over HYPER-MORL, the previous state of the art. On several continuous-control benchmarks, MORLAX also produces Pareto sets with greater hypervolume, meaning they cover more useful combinations of objectives.

Scalar rewards freeze decisions early

Conventional reinforcement learning commonly collapses every goal into one scalar reward. Engineers assign coefficients to terms such as speed, stability, smoothness, and power consumption, fixing their relative priorities before training. Changing those coefficients later usually requires a new run.

Multi-objective reinforcement learning keeps the reward as a vector with one component per objective. Training seeks a Pareto set: policies for which improving one objective would degrade at least one other. That set allows a system designer or operator to choose among supported trade-offs after training.

Many existing MORL implementations rely on CPU simulation and require hours or days to approximate a useful Pareto set. MORLAX combines JAX vectorization with MuJoCo MJX, allowing thousands of physics environments and multiple policy configurations to run concurrently on a GPU.