Gran Turismo: Self Driving Car

[PR1VATEJ0KER]

Yesterday I was bored at home over easter and was playing with some examples of lane detection in dash cam videos(OpenCV). I had the idea to use a webcam and point it at gt5, and after some configuration I saw what I thought was useful data.

I remembered reading about a library for arduino(microcontroller) that could turn it into a ps3 joystick(unojoy). The only difficulty is when the arduino is a joystick the USB port is occupied.

So, how could I tell the arduino what button inputs I wanted. I decided my only available approach was another arduino. I eventually managed to get the I2C comms to work for accurate multi-byte message sending.

At this point I have data about gt5 on my laptop and a way to manipulate the controls on ps3.

This is the result of 8 hours of blood, sweat and tears.
Here is the first exhilarating drive.

Webcam providing feedback

Spoiler

Laptop->Arduino->Arduino->Ps3

Spoiler

 

[R5]

So you've put Navmesh into GT6 rather than pathnodes?

That's pretty damn awesome!

 

[GTPorsche]

Wouldn't the driving line being on interfere with it's lane keeping ability?

Impressive that it does work though, even if it looks like it still needs some work.

 

[JMoney]

That's awesome! I'd give it an easier course to go around though, maybe Daytona or Indy.

 

[eran0004]

Looks like a good start Perhaps the banked turn was too much for it to handle?

 

[TenEightyOne]

Epic. Love it