This definitely seems like a bug within Factorio, but it's complicated enough that I can't quickly make a small enough reproducible example. For now, I've swapped the newer "enter as remote view" behavior into a setting and defaulted it back to the old approach of "enter as a god," since this does not happen. Remote View still works, of course.