429 Too Many Requests: How to Fix LLM API Rate Limit Errors
Got a 429 from an LLM API? Read the headers to tell RPM, TPM and quota limits apart, back off using Retry-After, and tell 429 from 529 and 503.
Blog
#retry strategy
与「retry strategy」相关的文章。
Blog
与「retry strategy」相关的文章。
Got a 429 from an LLM API? Read the headers to tell RPM, TPM and quota limits apart, back off using Retry-After, and tell 429 from 529 and 503.
A cross-provider cheat sheet for LLM API errors 400, 401, 403, 429, 500, 502, 503, 504, 524 and 529: whose fault it is, whether to retry, and how long to wait.