All vanilla windows can also be closed with either E or Escape. Meanwhile todo list can only be closed with its keyboard shortcut which makes it feel like its very difficult to close. Personally when I play I only open it using the button in the top left of the screen (because I don't need to open it that often), but I'm very used to closing everything with E so the todo list ends up being very annoying as it is the only window in the whole game that I have to use 'x' button to close.