This doesn't occur for all tags. I am using the Mod Resource Map Label Marker which automatically marks resources. When those fields are depleted I remove the tag. For some tags, QMTT gives the following error:

The mod Quick Map Tag Teleport (0.2.4) caused a non-recoverable error.
Please report this error to the mod author.

Error while running event QuickMapTagTeleport::on_chart_tag_removed (ID 157)
LuaCustomChartTag API call when LuaCustomChartTag was invalid.
stack traceback:
[C]: in function 'index'
__QuickMapTagTeleport/wct_utils.lua:110: in function 'find_element_idx_by_position'
QuickMapTagTeleport/scripts/gui/qmtt.lua:207: in function 'remove_chart_tag_at_position'
QuickMapTagTeleport/control.lua:290: in function 'remove_tag_at_position'
QuickMapTagTeleport/scripts/gui/qmtt.lua:136: in function 'handle_chart_tag_removal'
QuickMapTagTeleport/control.lua:216: in function <QuickMapTagTeleport/control.lua:215>

I love your mod btw. It is one of my "game is unplayable without" mods. I have never gone as far as I have now in a Factorio game and this mod is a large contributor to that, as large bases just get annoying to travel after a while.

I put some guards in to help protect against errors and will publish in the next release. Hopefully that fixes the problem.
I am glad you like the mod, I felt the same way using MapTagTeleport and QuickMapTag prior to 2.0
I've been playing this game for years. I don't need to spend more time running :)