When the arrivals of new lenses dwindle to just a handful each year, you are through the worst and can relax.
Book-keeping and storing the ones you already have can be a major headache, I grant you that. Then we haven't entered the topic of locating and retrieving them once an item is required.