Correctly retry all hosts returned from SRV when we fail to connect.