Open
Description
Is your feature request related to a problem? Please describe.
Devika will stop after an HTTP 429 response
Describe the solution you'd like
sleep for 60 seconds on an HTTP 429 response and then retry again
Describe alternatives you've considered
redo the entire project
Additional context
24.05.02 19:16:04: root: ERROR : Error code: 429 - {'error': {'message': 'Rate limit reached for model
mixtral-8x7b-32768in organization
PLACEHOLDER on tokens per minute (TPM): Limit 5000, Used 0, Requested ~5597. Please try again in 7.164s. Visit https://console.groq.com/docs/rate-limits for more information.', 'type': 'tokens', 'code': 'rate_limit_exceeded'}}
Metadata
Metadata
Assignees
Labels
No labels