How to record telemetry data of AI-driven cars

[rlx]

Looking for a way to somewhat objectively measure the performance of cars in GT7, I realized the following.

When you select Time Trial, pick a car, but don't start the race, the game will cycle through a number of scenic shots of the course, and you can occasionally see your car, which is actually racing the track, controlled by AI. With a little Python script (see https://github.com/Bornhall/gt7telemetry, for example), you can now record telemetry data, like lap times, top speeds, tyre temps, etc.

Of course, wind direction and track temperature still vary between runs, so the results are not 100% unbiased, but when it comes to gathering objective performance data, it's still better than any other way I could think of.

Below, as an example, is a list of lap times (fastest lap out of 10) on Daytona Tri-Oval. All cars on Racing Softs, fully tuned, set up for max Performance Points, with adjusted suspension for a few cars that the 1.31 AI tends to crash.

  1 00:32.617 Bugatti Chiron '16
  2 00:32.711 Bugatti VGT
  3 00:33.332 Nissan Silvia Q's (S13) '88
  4 00:34.189 Bugatti Veyron 16.4 '13
  5 00:35.176 Lamborghini Aventador LP 750-4 SV '15
  6 00:35.243 Ferrari Enzo Ferrari '02
  7 00:35.594 Chevrolet Corvette C7 '14
  8 00:35.612 Lamborghini Veneno '14
  9 00:35.689 Chevrolet Corvette C7 ZR1 '19
 10 00:36.109 Pagani Huayra '13
 11 00:36.286 Ferrari F8 Tributo '19
 12 00:36.310 Ferrari F12berlinetta '12
 13 00:36.396 Nissan GT-R NISMO '17
 14 00:36.717 Chevrolet Corvette ZR1 (C6) '09
 15 00:36.762 McLaren F1 '94
 16 00:36.855 Aston Martin One-77 '11
 17 00:36.980 Mercedes-AMG GT Black Series '20
 18 00:37.120 Nissan GT-R '17
 19 00:37.361 Dodge Viper GTS '13
 20 00:37.388 Lamborghini Aventador LP 700-4 '11
 21 00:37.412 Eckert's Rod & Customs Mach Forty
 22 00:37.619 Mercedes-AMG SLS '10
 23 00:37.795 Mercedes-Benz SLR McLaren '09
 24 00:37.894 Chevrolet Camaro ZL1 1LE Package '18
 25 00:37.941 Lamborghini Murciélago LP 640 '09
 26 00:38.267 Mercedes-AMG GT R '17
 27 00:38.335 Ferrari LaFerrari '13
 28 00:38.409 Porsche 959 '87
 29 00:38.458 Chaparral 2J '70
 30 00:38.473 Dodge Viper GTS '02
 31 00:38.505 Chevrolet Corvette C8 '20
 32 00:38.744 Ferrari GTO '84
 33 00:38.848 Ford GT '06
 34 00:38.895 Shelby Cobra 427 '66
 35 00:38.905 Chevrolet Corvette Stingray Racer Concept '59
 36 00:38.925 Jaguar VGT Coupé
 37 00:38.962 Nissan R34 GT-R V-spec II Nür '02
 38 00:38.993 Porsche 917 LIVING LEGEND
 39 00:39.028 Honda NSX '17
 40 00:39.059 Audi R8 4.2 '07
 41 00:39.062 Ford GT '17
 42 00:39.063 Nissan R33 GT-R V-spec '97
 43 00:39.116 Porsche 918 Spyder '13
 44 00:39.141 Ferrari 458 Italia '09
 45 00:39.214 Dodge Viper SRT10 Coupe '06
 46 00:39.256 Mercedes-AMG GT S '15
 47 00:39.305 McLaren MP4-12C '10
 48 00:39.420 Dodge Charger SRT Hellcat '15
 49 00:39.450 Lamborghini Diablo GT '00
 50 00:39.512 Lamborghini Huracán LP 610-4 '15
 51 00:39.713 Alfa Romeo Giulia GTAm '20
 52 00:39.821 Porsche Carrera GT '04
 53 00:39.930 Ferrari F40 '92
 54 00:39.941 Chevrolet Corvette ZR-1 (C4) '89
 55 00:39.947 Toyota GR Supra RZ '20
 56 00:39.958 McLaren 650S '14
 57 00:40.193 RUF CTR3 '07
 58 00:40.254 Aston Martin DB11 '16
 59 00:40.254 Lamborghini Miura P400 Bertone Prototype '67
 60 00:40.301 Lamborghini V12 VGT
 61 00:40.436 Jaguar F-type R '14
 62 00:40.523 Porsche 917K '70
 63 00:40.658 Porsche 911 GT1 Strassenversion '97
 64 00:40.675 Lamborghini Countach 25th Anniversary '88
 65 00:40.742 CHC 1967 Chevy Nova
 66 00:40.794 Roadster Shop Rampage
 67 00:40.800 Chevrolet Corvette (C2) '63
 68 00:41.046 Plymouth Superbird '70
 69 00:41.172 Ferrari Testarossa '91
 70 00:41.259 Ferrari F50 '95
 71 00:41.333 Lamborghini Countach LP400 '74
 72 00:41.391 Aston Martin V8 Vantage S '15
 73 00:41.698 Aston Martin Vulcan '16
 74 00:41.777 Pagani Zonda R '09
 75 00:41.777 Porsche 911 GT3 (997) '09
 76 00:41.831 Alfa Romeo 8C Competizione '08
 77 00:41.935 McLaren P1 GTR '16
 78 00:41.988 Ferrari FXX K '14
 79 00:42.142 Porsche 911 GT3 RS (991) '16
 80 00:42.180 Ford Shelby GT350R '16
 81 00:42.285 Maserati GranTurismo S '08
 82 00:42.334 Honda NSX Type R '02
 83 00:42.525 Honda NSX Type R '92
 84 00:42.566 Jaguar XJ13 '66
 85 00:42.580 Ferrari F430 '06
 86 00:42.613 Chevrolet Corvette Stingray (C3) '69
 87 00:42.744 Ferrari VGT
 88 00:42.747 Ferrari 512 BB '76
 89 00:42.876 Nissan R32 GT-R V-spec II '94
 90 00:43.107 Ferrari 365 GTB4 '71
 91 00:43.128 BMW M2 Competition '18
 92 00:43.254 Ford GT40 Mark I '66
 93 00:43.642 Porsche 911 Turbo (930) '81
 94 00:45.101 Shelby Cobra Daytona Coupe '64
 95 00:45.194 De Tomaso Mangusta '69
 96 00:46.291 Aston Martin DB5 '64
 97 00:46.309 Porsche VGT
 98 00:47.096 Porsche Carrera GTS (904) '64
 99 00:48.619 Ferrari 308 GTB '75
100 00:51.239 Volkswagen ID.R '19

 

[Meythia]

Nicely done.
Question: how close are these times to the times the AI would drive during an actual race?
It should already be obvious that the "solo race AI" you used here is faster because of tyre advantage, but if you put them on the stock tyres and compare them against each other?

 

[rlx]

Nicely done.
Question: how close are these times to the times the AI would drive during an actual race?
It should already be obvious that the "solo race AI" you used here is faster because of tyre advantage, but if you put them on the stock tyres and compare them against each other?

My guess is that there wouldn't be any difference, but I haven't tested it.

And if I understand correctly, to test this, I would need to record times on RHs, because that's what the AI is using in races?

 

[Meythia]

My guess is that there wouldn't be any difference, but I haven't tested it.

And if I understand correctly, to test this, I would need to record times on RHs, because that's what the AI is using in races?

It depends on the car: all Gr.4 and Gr.3 cars default to RH, the road cars either are on SH or CS (I think instead of H)

 

[rlx]

Nordschleife results - pretty interesting!

One lap per car, otherwise just as above.

  1 05:14.870 Audi R18 TDI '11
  2 05:16.637 Peugeot 908 HDi FAP '10
  3 05:17.516 Mazda LM55 VGT (Gr.1)
  4 05:20.684 Bugatti VGT (Gr.1)
  5 05:25.406 Dodge SRT Tomahawk VGT (Gr.1)
  6 05:26.017 Hyundai N 2025 VGT (Gr.1)
  7 05:26.056 Jaguar XRJ-9 '88
  8 05:26.066 Mazda 787B '91
  9 05:27.306 Alpine VGT '17
 10 05:27.641 Nissan R92CP '92
 11 05:28.834 Mercedes-Benz Sauber C9 '89
 12 05:29.017 Porsche 962 C '88
 13 05:29.951 Nissan GT-R LM NISMO '15
 14 05:31.566 Peugeot L750R Hybrid VGT 2017
 15 05:32.130 Audi VGT
 16 05:32.555 Ferrari VGT
 17 05:33.053 Toyota TS030 Hybrid '12
 18 05:33.568 Porsche 919 Hybrid '16
 19 05:34.017 Toyota GR010 Hybrid '21
 20 05:38.509 McLaren VGT (Gr.1)
 21 05:39.866 Audi R18 '16
 22 05:40.363 Chaparral 2J '70
 23 05:40.735 Toyota TS050 Hybrid '16
 24 05:42.055 Bugatti VGT
 25 05:47.566 Audi RS 5 Turbo DTM '19
 26 05:48.948 Honda NSX CONCEPT-GT '16
 27 05:49.508 Nissan GT-R NISMO GT500 '16
 28 05:49.550 Lexus RC F GT500 '16
 29 05:49.633 BMW McLaren F1 GTR Race Car '97
 30 05:51.537 Volkswagen ID.R '19
 31 05:55.126 Honda NSX GT500 '08
 32 05:55.918 Mercedes-Benz CLK-LM '98
 33 05:56.372 Suzuki V6 Escudo Pikes Peak Special '98
 34 05:57.706 Nissan GT-R GT500 '08
 35 06:00.898 Lexus LF-LC GT VGT
 36 06:03.499 Audi e-tron VGT
 37 06:06.309 Porsche 917 LIVING LEGEND
 38 06:06.345 Pagani Zonda R '09
 39 06:06.380 Peugeot VGT
 40 06:08.328 Lamborghini V12 VGT
 41 06:08.450 Lexus SC430 GT500 '08
 42 06:09.388 Italdesign VGT Street Mode
 43 06:13.373 McLaren F1 GTR BMW '95
 44 06:14.779 Porsche VGT
 45 06:19.050 McLaren P1 GTR '16
 46 06:20.294 Nissan GT-R GT500 '99
 47 06:20.522 Toyota FT-1 VGT
 48 06:21.017 Renault R.S.01 '16
 49 06:21.301 Toyota Supra GT500 '97
 50 06:21.369 Aston Martin Vulcan '16
 51 06:21.403 Nissan Skyline Super Silhouette '84
 52 06:24.319 Ferrari FXX K '14
 53 06:26.199 McLaren F1 '94
 54 06:27.208 Jaguar VGT Coupé
 55 06:28.114 Mercedes-AMG VGT Racing Series
 56 06:28.315 Ferrari 330 P4 '67
 57 06:31.903 Porsche 917K '70
 58 06:33.184 BMW VGT
 59 06:33.592 Jaguar XJ13 '66
 60 06:34.268 Ford Mark IV Race Car '67
 61 06:39.830 Ford GT40 Mark I '66
 62 06:39.954 Shelby Cobra 427 '66
 63 06:43.034 Alfa Romeo 155 2.5 V6 TI '93
 64 06:44.628 Peugeot 205 Turbo 16 Evolution 2 '86
 65 06:46.005 Alpine A220 Race Car '68
 66 06:56.968 Shelby Cobra Daytona Coupe '64
 67 06:59.916 Audi Sport quattro S1 Pikes Peak '87
 68 07:03.491 Chevrolet Corvette Stingray Racer Concept '59
 69 07:22.028 Mercedes-AMG 300 SEL 6.8 '71
 70 07:23.188 Ferrari 250 GTO '62
 71 07:33.080 Porsche Spyder type 550/1500RS '55
 72 07:44.082 Mercedes-Benz 300 SL (W194) '52

 

[hyperspeed980]

Nordschleife results - pretty interesting!

One lap per car, otherwise just as above.

This pace is insane. I had no idea the Human Comedy 8 AI were driving in the pre-race menu.