The default setting is 2 stacks per buffer chest, and there are 2 buffers per connector, one above ground and one below ground, so yes, 4 stacks is correct. You can change the stacks per chest to 1 in the mod settings, which would make it "only" 20,000 soil.
Why 4 stacks? Because default stacks for ore are 50 items, and blue belts move items at 40/second, so in the 5 seconds (by default) between transfers, that's 200 items. Come to think of it, it should probably be 4 stacks per chest, for a total of 8 stacks.
Since everything is adjustable by settings, you can adjust for most mod setups, but there's not much I can do about this issue when using 10x stacks with items that by default already stack to 1,000.