Hello,
I cannot replicate the bug you encounter.
It might be that the activation area is some time hard to stand on (the circle in the middle of the building) or it might be that another mod changes the “turret entity” that this building uses to detect the player entity.
Can you show me the problem and also what mod list are you using?