Only do one concurrent fetch per server in keyring (#16894)

Otherwise if we've stacked a bunch of requests for the keys of a server,
we'll end up sending lots of concurrent requests for its keys,
needlessly.