I created a machine that attempts to load pallets as fast as possible, and even with 11 fully upgraded stack inserters I still experience short stalls:
http://steamcommunity.com/sharedfiles/filedetails/?id=1344373331
So, 1 second is definitely too small a crafting time, purely from a game mechanics standpoint. :-)