Exactly what it says in the title - when enabling auto-pilot to upgrade entities, underground belts only get one part upgraded. The other one remains marked for upgrade, but the auto-pilot moves ignores them and moves to the next entity.
Also, when you disable the auto-pilot and re-enable it on the unupgraded underground belt, the character just approaches it for a moment, but it doesn't get upgraded and the character moves on.