Oh... It was my mistake. As I went through everything again to record a gif, I noticed I had an inserter just before the warp belt, obviously causing the bottleneck. Just me being stupid, thanks for replying though!
I was running 0.0.13, there was no garden floor there. But I see it was introduced later. Research it in the tech tree after upgrading the mod to 0.0.16.
Thanks!