Firstly, I should note that you can disable parallax in settings if you primarily use dragging to move around.
See the mod page Parallax section, quoted below:
Dragging the camera won't update the planet's parallax position until letting go of drag. This is an issue for other kinds of mods too, and afaik there isn't a fix available in this version of Factorio. WASD works fine, but if you primarily use dragging in remote view then you may want to disable parallax.
And also see some of the already posted discussions regarding this topic:
https://mods.factorio.com/mod/visible-planets/discussion/674d95c619fd2ff1dd9d2850
https://mods.factorio.com/mod/visible-planets/discussion/675028fbd8da9663d9dd393e
And also a bunch of comments mentioning this on Reddit. (Though this one isn't fair because why would someone look there before posting a bug report.)
It's a known issue for multiple mods, and Factorio needs an API update to let us fix it. Hopefully it gets added in the future.