Design a customized communication approach by setting limits, throttling, and retries to gain access to any C4AI service through EES.
EEC, short for Elastic Endpoint Configuration, introduces a dynamic Elastic Endpoint service empowering you to dictate how you engage with C4AI services. This includes the definition of throttling mechanisms, limits, and response strategies, affording you full control over the AI execution process.
EEC provides a unified endpoint accessible for interaction with various services like AAC, AIL, KDB, and CDB. This versatility enables the creation of an unlimited number of endpoints, allowing you to segregate tools for each AI connector or Lambda, all while maintaining precise control over your application's performance.
Two major communication strategies are at your disposal: sync and async. If you require synchronous responses via a simple HTTP API, the sync option is ideal. However, for scenarios where priority-based execution and cost savings on AI task executions matter more than immediate responses, the async strategy is a superior choice. In this scenario, the EES service automatically triggers your registered webhook with generation results once processing is complete.
Each endpoint is assigned a unique ID, simplifying differentiation when dealing with multiple registered endpoints, enhancing overall manageability.
Leverage EEC's capabilities to tailor your AI service interactions precisely to your requirements, optimizing performance, cost-efficiency, and response timing.
You can configure such parameters as: request limit, number of requests per unit of time, retry strategy, options for obtaining results.
Yes, sure. Just like with the AAC service, it is possible to build an architecture in which you will use third-party APIs not only for AI tasks.
For example, if you need to comply with the restrictions of a third-party API, you can easily use this service.
At the moment only HTTP is fully available, however if you need to use any more specific protocols, please contact us and we will be happy to help you.