retryAfter in whole milliseconds, for Java, which can't call a getter that returns a Duration.
Duration