That's not true, Albert.
4 seconds sound clip from the Mr. Topaze (1961) movie soundboard.
You can hear this line at 01:14:30 in the Blu-ray version of the movie.
Quote context
[...]
- Oh. Hello, Albert. How wonderful to see you.
- I've just been speaking to Regis about you.
- Please don't pretend, madam. I overheard some of your conversation.
- And does it make you feel any happier?
- You are a cruel and deceitful woman.
- I'm your friend, and that's why I chose you.
- Because I had such a manly face.
- Because you are so kind. Because I saw you were poor.
- Why should a poor man interest you?
- Because I've known poverty myself.
[...]