Never had any problems with a mid-size SUV - and that's for 3 or 4 adults PLUS 3 cases and hand luggage. Had a Jeep Patriot, Ford Edge and of course the good old Pacifica - they've stopped making them unfortunately! Might be a tight squeeze with a toddler as you'll need to have a booster seat as well.
Jean