I usually feel very similar. Tennis Fever gets a pass from me because I find using them as a plot point to justify Mario, Luigi, Peach, Wario and Waluigi relearning their skills, aka likely leveling up, pretty clever. In general I don't like them when they are just roster fillers, like Baby Daisy and Baby Rosalina in Mario Kart, but they can serve a purpose.