From what I've noticed is that the arrows are his health status or similar.
He have to retire when the Career bar is ful, but you'll change him before that since he starts to drive worse at the end.
I think it's count measured because my other drivers which are fairly close in level have about 1/15 of the Career bar while the one that I've done over 170 races with have come almost half way through.