Continuum AI is now public. Try out the first confidential LLM platform!
Case study: Kauz.ai
Kauz.ai is the provider of aiStudio, a self-service platform for managing and training simple and complex AI assistants. The company integrates various large language models with its own developed NLU (Natural Language Understanding) engine. With Kauz.ai the response behavior of the AI assistants is context-based and expandable, making AI efficient and easy to use for all types of organizations.
Intelligent chatbots that leverage Generative AI and large language models (LLMs), such as ChatGPT, offer significant opportunities for innovation and efficiency. However, due to stringent IT security and data privacy requirements, many organizations, especially in banking and financial services, currently cannot leverage AI technologies at scale. Due to these restrictions, the challenge for Kauz.ai was: How can we offer our customers powerful chatbots with state-of-the-art LLMs, while ensuring data security and privacy?
Continuum AI is the perfect solution for this problem. Continuum is a framework for deploying LLMs and other AI models with end-to-end encryption powered by confidential computing. Confidential computing is a technology that allows for encryption of data even during processing. In addition, the technology comes with remote attestation, making the integrity of a protected workload verifiable to the user. With the latest Nvidia H100 GPUs, confidential computing is also possible for setups that require AI accelerators.
Continuum enables the creation of ChatGPT-style services where both user prompts and model weights are shielded throughout, ensuring that neither the infrastructure nor the service provider can access any user data in plaintext. In short, it works by running the model in a confidential computing environment (CCE) where data stays encrypted in memory. The inference code that processes prompts operates in a sandbox to prevent data leaks. You can try out the public preview of Continuum here: https://ai.confidential.cloud/. For more technical information, visit the documentation.
Continuum can also be integrated easily into existing AI solutions like chatbots via API. Contact us if you want to learn more.
A confidential version of aiStudio offers Kauz.ai’s customers in regulated sectors, such as banks and insurance companies, an additional layer of security. By leveraging the confidential-computing capabilities of Continuum, the combined solution ensures that user prompts and responses remain encrypted during processing, eliminating the risk of data leaks to infrastructure or model providers.
By offering this option, Kauz.ai demonstrates its commitment to addressing the unique security needs of customers with sensitive data and personal identifiable information (PII). With confidential aiStudio, these organizations will be able to confidently adopt AI assistants to streamline their operations and enhance customer experiences, while maintaining the utmost security and compliance.
Please fill out the form and our experts will be in contact with you.
The form failed to load. Sign up by sending an empty email to contact@edgeless.systems. Loading likely fails because you are using privacy settings or ad blocks.
