Our HPE partnership to help organizations build Safe Enterprise AI in Private Clouds

1) Easy to build and operate Safe AI Systems:

A typical enterprise has dozens or hundreds of GenAI use cases to be implemented and operated. To implement, deploy and operate these genAI projects at scale, software tooling is needed that makes it easy to utilize unstructured and structured data in diverse systems with GenAI models.

Gencore AI makes it easy to connect to unstructured data or structured data in diverse data systems and utilize any GenAI model on HPE Private Cloud AI.

AI teams can configure and operationalize these systems in minutes.

2) Embedded Data Security & Governance in AI Systems:

Security, governance and safe use of proprietary data is the top need and baseline requirement for CIOs and CISOs for GenAI projects.  It's a key concern in moving from proof of concepts to production enterprise-grade systems. This is not surprising, because at the end of the day, AI is fueled by data, and it is not possible to build safe AI systems without diligent oversight of that data. In a recent survey of senior leaders by Deloitte, top concerns include using sensitive data in models, managing data security privacy related issues and complying with regulations. 

Other surveys reflect similar concerns. What is particularly challenging is that most of the data used for building GenAI systems will be from unstructured data systems, as it represents 80% to 90% of an organization's data estate. While an ecosystem in the industry has evolved for managing structured and semi-structured data over the years, governing unstructured data is generally uncharted territory.

Gencore AI aligns with OWASP Top 10 for LLMs to help embed data security and governance at every important stage of the AI System, from data ingestion to AI consumption layers

Gencore AI automatically sanitizes data at ingestion, enforces entitlements at AI consumption, protects activity on embeddings in vector DBs, and inspects and controls prompts and responses.

Operating within HPE Private Cloud AI, Gencore AI provides continuous protection of all AI interactions with conversation-aware LLM firewalls. These protections include monitoring user prompts to the AI system, data retrievals from the LLMs to the vector databases, and responses prepared by the LLM back to the user prompts. With full context of sensitive data and access entitlements to data sources, Gencore AI ensures responses align with corporate policies and controls, protects sensitive data from leaked, and prevents malicious attacks such as prompt injections and jailbreaking instructions.

3) Full Provenance of AI System:

A GenAI system is often made up of a variety of building blocks and a myriad of complex relationships between ever changing data objects like files, user permissions, AI models, AI agents, vector databases and user endpoints.  It's important to have a full provenance view of the entire AI system, down to the level of each data object and file.  Such visibility is also required by various AI regulations.

Gencore AI, powered by Data Command Graph uniquely provides the full provenance view of the entire AI System.

Therefore it is critical to have full visibility into provenance at a granular level. What data systems are feeding a particular LLM? Which files within this data system are being used? What users have access entitlements to these files? If I change a vector database in the system, what data systems are impacted? Gencore AI is powered by a unique knowledge graph that maintains granular contextual insights about data and AI systems. Not only does this support real time controls - it also provides comprehensive traceability of the entire AI system, including data and AI usage, down to the level of each file, user, AI model and usage end-points. 

4) Compliance with AI Regulations for each AI System:

The incredible transformational power of GenAI has also propelled AI regulations in various regions and jurisdictions, such as EU AI Act and NIST AI RMF.  There are dozens of other regional AI regulations being drafted globally.  Organizations not only have to meet with base data protection regulation like GDPR for their AI Systems, but now also have to ensure compliance with new AI regulations.

Gencore AI uniquely provides compliance checks for each of the AI Systems being operationalized in it.