Surprised to hear the Subaru being decreed the more fun of the pair - typically in the UK people think it's the other way around, though in reality unless you drive them back-to-back you'd not be able to tell either way.
The Subaru is set up a bit firmer at the front and a little softer at the rear, and vice-versa for the Toyota (and I imagine the FR-S). So you get a little more turn-in precision from the Subaru, but the Toyota's back end is slightly more mobile.
But overall... both are quite firmly set up. Both are very nicely balanced indeed. Both have great steering. Both can feel just a little edgy sometimes on the standard low-grip tyres. Both have one of the best driving positions of any modern car. Both have a slightly naff interior. Both have the torque dip (which I'm led to believe is fixable with a few tweaks). Both should be fairly economical by most standards - last time I tested the 86 I averaged 30mpg imperial (25mpg US) but that included a significant proportion of fairly hard driving. I think to and from the test it had done nearer 40mpg UK (33mpg US), and in steady highway driving it'd probably do a little more.
In other words, test drive to see if it'll do the job, and buy whichever one is cheaper or closer and in the best condition. Or whichever one you prefer the badge of.