I can understand that, I had a similar thing with GT I used to mainly play it just to win the cars and occasionally would try to race clean and nice. Over the years I developed some horrible bad habits such as late braking and well the thing is bought a Playseat and a DFGT wheel a few months ago now and that completely changed the way I see and play the game. I took all assists off, except for ABS which I am sort of learning now.
Now what a week ago I bought my Xbone with Forza 5 and yes it takes a bit of time to get used to, especially on the controller (I'm waiting for my TX to arrive
) but the thing is in Forza 5 you do have the option to turn damage on or off in career mode. You also have the same driving aids as in GT (TC, ABS, etc), so if it is too hard you can dial it down.