...
CogCache offers complete flexibility with no monthly commitments required. You can pay only for what you need with monthly subscriptions.
How many flavours of CogCache are?
There are two flavours of CogCache:
CogCache with Caching only
You can purchase a caching only plan and you get all the benefits of CogCache, but without the LLMs. CogCache will require to bring your own Azure OpenAI deployment. In this case we have 3 dedicated plans where you can purchase bundled cache items.
CogCache with Caching and Azure OpenAI LLMs
This is the recommend way to purchase CogCache benefiting the additional cost reductions that goes with using our discounted Azure OpenAI PTU-level deployments. The charging happens for the number of generated tokens with better discounts as the usage within the month grows. In this case we have a single plan with no upfront commitment and you will only pay for what you use at the end of the month.
How quickly can I get started with CogCache?
...