I have no immediate plans for an upgraded tier of floating drill, both because I'm having a hard time creating a model for the existing one (let alone a new one) and because I'd like to keep the mod largely "vanilla plus" in style; it's not entirely off the table, but not a high priority.
With regards to belts, floating belts are deliberately somewhat basic in function since they need to stay lightweight for flotation, and they're not intended to be a substitute for other kinds of long-distance, high-volume overwater logistics. Refined concrete platforms are your main way to get higher throughput and more functionality on the water.
I do like the idea of a lamp buoy, and I may take a poke at that sometime in the near future.