Kavinsky is not actually trying to get Adam to lose anything. He's just driving, same as always, because there are just some constants in the world and Kavinsky driving like an asshole is one of them.

Kavinsky being an asshole used to be a constant, but that's been more of a wavering thing as of late, and when he sees Adam get all tense and squirrely, he slows down just a little. "What?"