An A36 or a Saratoga would be great but at least twice the price of an M20J. I flew in an A36 for years with my dad and love to catch a ride in one whenever I can. It brings back lots of great memories. However, about 90% of my flying is alone or with one other person. There will only be a few times a year I will have my entire family in the airplane. The longest trip we will take together is between 300 to 350 miles. Flying from Memphis to Destin, FL in my Cherokee took from 3 to 3 1/2 hours. I calculate that at 155 knots the 201 can do it that same trip in just over 2 hours. With ipads in hand, 2 hours 10 min. is very tolerable.
A little trick I learned years ago on how to travel light. If you are taking a family trip and you have a bunch of luggage that will not fit in the airplane, you can always mail the cloths to your destination. It's really easy. I just take a big box, load it with cloths, and drop it off at a UPS store a week before I leave. Have it shipped either to your destination or to another UPS store near your destination. It will be there waiting for you. I know you wouldnt want to do that all the time but in a pinch it works.