That’s a topic for discussion, because it depends on the playstyle. Ask 100 people, and you’ll get 100 different opinions on how it should be.
But to keep it brief: those last few quality levels are really for those who want the absolute maximum. For standard gameplay, the first few are sufficient.
Those final quality levels are intended more for those who are bored and want to push the quality settings to the absolute limit, even after finishing the game.