Yes, you can purify the dirty water by unlocking a technology later down the tech tree.
The technology to purify water is later in the tech tree to force you to store the pollution for a while. There is no easy way to get rid of the pollution for balance reason.
Once you reach that level of technology, you need about 1.5 chemical plant to fully clean 1 pollution plant of dirty water.
