Yes, both options are worth considering... "Apply changes" can be a reminder to also save/update settings (it is for me :-) ), but simply using "E" is, as you said, more consistent to the whole game... Good thing is: there's no "wrong or right" or "good or bad". It's up to you :-))
You could also let users decide how to handle it with a mod setting... :-)