Text this: Dynamical constraints on pseudo-gauge transformations