No. There's nothing wrong with marriage, provided there is just one in the family who wears the pants.
8 seconds sound clip from the Mister Ed - Season 1, Ep. 5 - Stable For Three TV Series.
You can hear this line at 00:13:33 in the DVD version of the movie.
Quote context
[...]
- Besides, this isn't really a stable. This is my office.
- Oh, sure, sure. And I see you've engaged a secretary to take shorthand.
- My boy, do you know where you made your first mistake?
- Oh, no, Wilbur. This is Kay.
- Yes. Your pants is on the phone.
[...]