If you explore into new territory, there will be new biters there. Once there are some new biter nests, they should start spreading again.
I don't know if it's feasible to create some spawners in far away territory when the mod is removed. I can investigate that if the first solution isn't enough, though.