Are you using performance or graphics mode? I can't help wondering if the difference in responsiveness between 30fps and 60fps increases the difficulty in controlling the game at the limit, or perhaps the difference between Xbox Series S and X generally.
I'm sure PG playtest these challenges on all platforms before setting the target speed but having taken
@-Fred-'s advice on using a (non evo) FE 599XX and selecting a tune with as high a lateral grip as I could find while keeping the speed up was the only way I could make the trap speed relatively easily with a 182mph+ speed (on Series X). I think I entered from the north though as there wasn't enough run up from the other side for me. I wonder how Xbox One X and lower end PC users did.
I struggle with some speed traps myself and am too lazy or dumb to tune my own cars so forums like this are valuable to avoid hair pulling frustration or just giving up. Not sure whether I can be bothered with doing the Open drift challenge for the extra 2 points though, personally.