I was laughing because they're exactly the words that old Brer Rabbit used the time that he lit out from his briar patch.
7 seconds sound clip from the Song of the South (1946) movie soundboard.
You can hear this line at 00:14:52.150 in the Blu-ray version of the movie.
Quote context
[...]
- Gimme your hand. I need your young eyes in the dark.
- Sort of late in the day to be starting on such a long trip, ain't it?
- Well, you don't have to go... Just 'cause you said you would.
- Well, now, I ain't heard nobody say nothing about not going. Of course I'll go.
- And I ain't never coming back neither!
- Yes, sir, those were his very words.
- Well, I reckon I better be getting my things together so we can be leaving.
- What did you say about Brer Rabbit?
- Which Brer Rabbit was that, honey?
- Why, you said something about Brer Rabbit.
[...]