I can give you another view on this. If you are limiting your question to the normal average community type tanks, then likely you can never go too big in terms of it being a healthier tank. However, If you breed fish or you have fish that breed and their babies survive, you will eventually need to catch them and rehome them (sell, trade or give away).
And then space matters. I can guarantee you that catching a tetra in a 100 gal. tank is a lot harder than catching one in a 50 gal. tank. And this is even more true when there is a lot of decor or heavy planting. And it is not only breeding which many necessitate catching fish, illness can also make this necessary. If you need to catch a sick or injured fish so you can move it to a Hospital tank to be treated, the same consideration applies.
I can tell you that in my very first tank, a 45 gal. which ultimately was also well planted, I had been sold flying foxes when I was trying to purchase Siamese Algae Eaters. So the Foxes had to go. I had to maake a bottle trap to catch them. However one refused to be trapped. It took me many months before i got it. And then it was dumb luck. I looked into the tank one day and saw that Fox inside the cave I had for plecos. So I grabbed a net, slipped it over the cave mouth and caught the fish.