System design
Design a scalable system for a token-generation service used by an LLM that needs to handle up to 100,000 requests per second.
Top community answer
No community answers yet.
Contribute an answerHave a better answer?
Share your experience and earn credits toward your next interview session.
Contribute an answer