Securiti launches Gencore AI, a holistic solution to build Safe Enterprise AI with proprietary data - easily

View

Our HPE partnership to help organizations build Safe Enterprise AI in Private Clouds

Published November 19, 2024

Listen to the content

Most of the large global enterprise customers we serve have data spread across on-premise systems, private clouds, public cloud and SaaS. Enterprises have a huge desire to transform themselves with generative AI (GenAI). To enable such GenAI transformation with their on-premise data, they have the choice to either bring the data into the public clouds or they can bring the best of the GenAI models and technologies into their private environments. Some data can be brought to the public clouds while the rest will take a long time to be migrated to the public clouds for a variety of corporate policies, operational cost or regulatory reasons.  Similarly, some of our global customers prefer to have their GenAI workloads be processed within their geographic regions in private or sovereign clouds.  

Many global organizations are looking towards private cloud as an attractive option for having more control of their GenAI projects, with proprietary data.

To enable GenAI innovation with proprietary data in private and sovereign clouds, I am excited to share that we are partnering with HPE and their Private Cloud AI.  HPE Private Cloud AI is designed to meet these requirements, providing a scalable, pretested, AI-optimized private cloud that gives AI and IT teams the freedom to experiment and scale AI projects.

We will be presenting our gencore AI on the main stage with HPE and NVIDIA leadership on Nov 20th at HPE Discover Barcelona, 2024.  You can see a brief promo video here.

 

To enable rapid GenAI innovation with proprietary data at scale, four key considerations have to be accounted for.

1) Easy to build and operate Safe AI Systems:

A typical enterprise has dozens or hundreds of GenAI use cases to be implemented and operated. To implement, deploy and operate these genAI projects at scale, software tooling is needed that makes it easy to utilize unstructured and structured data in diverse systems with GenAI models.

gencore AI makes it easy to connect to unstructured data or structured data in diverse data systems and utilize any GenAI model on HPE Private Cloud AI.

AI teams can configure and operationalize these systems in minutes.

2) Embedded Data Security & Governance in AI Systems:

Security, governance and safe use of proprietary data is the top need and baseline requirement for CIOs and CISOs for GenAI projects.  It's a key concern in moving from proof of concepts to production enterprise-grade systems. This is not surprising, because at the end of the day, AI is fueled by data, and it is not possible to build safe AI systems without diligent oversight of that data. In a recent survey of senior leaders by Deloitte, top concerns include using sensitive data in models, managing data security privacy related issues and complying with regulations. 

Other surveys reflect similar concerns. What is particularly challenging is that most of the data used for building GenAI systems will be from unstructured data systems, as it represents 80% to 90% of an organization's data estate. While an ecosystem in the industry has evolved for managing structured and semi-structured data over the years, governing unstructured data is generally uncharted territory.

gencore AI aligns with OWASP Top 10 for LLMs to help embed data security and governance at every important stage of the AI System, from data ingestion to AI consumption layers

gencore AI automatically sanitizes data at ingestion, enforces entitlements at AI consumption, protects activity on embeddings in vector DBs, and inspects and controls prompts and responses.

Operating within HPE Private Cloud AI, gencore AI provides continuous protection of all AI interactions with conversation-aware LLM firewalls. These protections include monitoring user prompts to the AI system, data retrievals from the LLMs to the vector databases, and responses prepared by the LLM back to the user prompts. With full context of sensitive data and access entitlements to data sources, gencore AI ensures responses align with corporate policies and controls, protects sensitive data from leaked, and prevents malicious attacks such as prompt injections and jailbreaking instructions.

3) Full Provenance of AI System:

A GenAI system is often made up of a variety of building blocks and a myriad of complex relationships between ever changing data objects like files, user permissions, AI models, AI agents, vector databases and user endpoints.  It's important to have a full provenance view of the entire AI system, down to the level of each data object and file.  Such visibility is also required by various AI regulations.

gencore AI, powered by Data Command Graph uniquely provides the full provenance view of the entire AI System.

Therefore it is critical to have full visibility into provenance at a granular level. What data systems are feeding a particular LLM? Which files within this data system are being used? What users have access entitlements to these files? If I change a vector database in the system, what data systems are impacted? gencore AI is powered by a unique knowledge graph that maintains granular contextual insights about data and AI systems. Not only does this support real time controls - it also provides comprehensive traceability of the entire AI system, including data and AI usage, down to the level of each file, user, AI model and usage end-points. 

4) Compliance with AI Regulations for each AI System:

The incredible transformational power of GenAI has also propelled AI regulations in various regions and jurisdictions, such as EU AI Act and NIST AI RMF.  There are dozens of other regional AI regulations being drafted globally.  Organizations not only have to meet with base data protection regulation like GDPR for their AI Systems, but now also have to ensure compliance with new AI regulations.

gencore AI uniquely provides compliance checks for each of the AI Systems being operationalized in it.

gencore AI combined with HPE Private Cloud AI delivers a robust AI development environment with comprehensive security and privacy controls.

Typical Use Cases with gencore AI:

Organizations can use gencore AI operating within HPE Private Cloud AI to quickly and easily build safe end-to-end AI systems, or to provide key building blocks of GenAI projects. Key capabilities include:

At Securiti, our mission is to enable enterprises to safely harness the incredible power of data and AI. Partnering with HPE Private Cloud AI provides enterprise organizations compelling solutions to help accelerate deployment of high-performance AI systems within a controlled environment.

If you are interested to see a demo, hit us up with a demo request at gencore.AI

Join Our Newsletter

Get all the latest information, law updates and more delivered to your inbox


Share


More Stories that May Interest You

What's
New