I threw 1000+ LLM calls. Here is how VernLLM handled it.

VernLLM is the LLM call framework for TypeScript. This video tests out its features, which includes adaptive AIMD rate-limiting, advanced circuit-breakers, multi provider fallbacks, developed retries with budget and observability. Open source with MIT license. Website: https://vernllm.dev GitHub: https://github.com/LakBud/vernLLM npm: https://www.npmjs.com/package/vern-llm