Don't believe a word of it.
3 seconds sound clip from the Beat the Devil (1953) movie soundboard.
You can hear this line at 00:03:20 in the Blu-ray version of the movie.
Quote context
[...]
- They cared for nothing except to have me off their hands.
- They'd have sold me on the slave market if they hadn't been afraid of scandal.
- Besides, my father was incompetent.
- I don't suppose he knew just how to contact the slave people...
- Common people are quite fond of you really.
- You'll be sorry if we run into bad luck just because we didn't take proper precaution.
[...]