Which is why you don't see many "green connection" servers. But this shouldn't be an issue, as long as the connection is stable they can have a 200-400 ping and it will still be fine, it's when the ping is jumping around that it's an issue. I was racing online last night with a buddy in the UK and another in Spain, me in the U.S., we all had red connection indicators but I never saw even a hit of lag or any other issues. Color coding based on ping is a misleading way to do it IMO, when AC switched to that a few updates ago suddenly all the guys I regularly race with were all showing as red even though I've raced with them dozens of times and never have any problems, and still haven't had any problems since they started showing as red. In AC I race weekly with people from Australia, China, Germany, UK, Murica all in the same server, most of us show as a red connection but we never have any issues at all. So just ignore the colors and join the server.
Also, if you join a server with only a few people in it eventually others will join. You see three people and think it won't be fun, but you join and now the next guy sees four people and decides to check it out, then the next guy sees five people, etc. until the server is full. It's known as the "sim sheep effect".