It looks like it works around a swivel, so the center pieces never move. So if it's yellow in the center, that's the yellow side. If it's red in the center, that's the red side.
15 seconds sound clip from the The Pursuit of Happyness movie soundboard.
You can hear this line at 00:25:41 in the Blu-ray version of the movie.
Quote context
[...]
- No. I'm pretty sure I can do it.
- Let me see it. Give it here.
- Oh, yeah. Oh. Wow, you... You, uh, really messed it up.
- Uh, listen, we can drive around all day. I don't believe you can do this.
- No, you can't. I'm telling you, no one can. It's tough.
[...]