CPSLab Cyber-Physical Systems Lab, Boston University

Publications Neural Network Control

Closing the Intent-to-Reality Gap via Fulfillment Priority Logic

Bassel El Mabsout, Abdelrahman Abdelgawad, Renato Mancuso

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2025), 2025, Hangzhou, China

Read the PDF Cite

Fig. 1: The top figures show violin plots indicating the distribution of timesteps required to reach performance thresholds across 10 random seeds. The red horizontal line separates seeds failing to reach the threshold. In the bottom figures, we show a smoothed training progress of rewards versus environment steps for each algorithm. Shaded regions represent standard deviation across seeds, and the dashed lines indicate the placement of reward thresholds for each environment.

Abstract

Practitioners designing reinforcement learning policies face a fundamental challenge: translating intended behavioral objectives into representative reward functions. This challenge stems from behavioral intent requiring simultaneous achievement of multiple competing objectives, typically addressed through labor-intensive linear reward composition that yields brittle results. Consider the ubiquitous robotics scenario where performance maximization directly conflicts with energy conservation. Such competitive dynamics are resistant to simple linear reward combinations. In this paper, we present the concept of objective fulfillment upon which we build Fulfillment Priority Logic (FPL). FPL allows practitioners to define logical formulae representing their intentions and priorities within multi-objective reinforcement learning. Our novel Balanced Policy Gradient algorithm leverages FPL specifications to achieve up to 500% better sample efficiency compared to Soft Actor Critic. Notably, this work constitutes the first implementation of a non-linear utility scalarization design, intended explicitly for continuous control problems.

Cite this paper

@inproceedings{FPL_IROS25,
  title     = {{Closing the Intent-to-Reality Gap via Fulfillment Priority Logic}},
  author    = {El Mabsout, Bassel and Abdelgawad, Abdelrahman and Mancuso, Renato},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2025)},
  year      = 2025,
  address   = {Hangzhou, China},
  url       = {https://cs-people.bu.edu/rmancuso/files/papers/FPL_IROS25.pdf}
}

Download .bib