Yeah, I think I messed up while debugging or just got lucky. I think the problem is the mod "Water Ores".
It seems that Cargo Ships and Water Ores both can generate oil deposits on water. These deposits also have different sprites, the Cargo Ships deposits have more of a blue tint to them, but Water Ores deposits have the default sprite.
The Cargo Ships deposits can be extracted with oil rigs, but the Water Ores deposits have to be landfilled over and used up with pumpjacks.
Sorry for causing any trouble, I guess I have to look harder for a better oil deposit now and improve my debugging for the future.