Waterloo, ON–August 22, 2023 – eSentire, Inc., the Authority in Managed Detection and Response (MDR), today announced that its new innovation hub, eSentire Labs, has introduced an open-source implementation framework to help security teams globally improve how they govern and monitor the use of Large Language Models (LLMs) internally. eSentire’s LLM Gateway is available now for download on GitHub.
"We are in the midst of a technology revolution where Generative AI is democratizing innovation across organizations of all sizes. But having the right controls is imperative to tap into its power, securely,” said Alexander Feick, VP of eSentire Labs. “We are helping security practitioners take the first step to gaining visibility and control over this exciting innovation with the eSentire LLM Gateway.”
eSentire Labs is a place where innovation occurs within eSentire. Ideas, originating from every team across the organization, including eSentire’s Threat Response Unit (TRU), Security Operations Center (SOC) and engineering teams, are validated, prototyped and evaluated for complete productization, partnership or open-source projects. The introduction of eSentire’s LLM Gateway as an open-source framework was an ideal introductory launch for the Labs team given its commitment to helping organizations scale their use of Generative AI, securely.
eSentire first developed its LLM Gateway for internal purposes to govern and monitor corporate usage of ChatGPT, Google Bard and other LLMs. Over time, eSentire Labs enhanced the Gateway with additional controls and business policies specific to eSentire. Recognizing that its LLM Gateway could be leveraged as a reference implementation for IT administrators to access this important product category with confidence as they evaluate future full-scale gateway solutions, eSentire has elected to open source its initial implementation framework.
Benefits of the eSentire LLM Gateway include:
- Creates a protective layer between corporate data and open AI applications including ChatGPT
- All LLM interactions are logged, enhancing monitoring & security control, while also surfacing core use cases from functional and power users
- As an open-source framework, security practitioners can integrate and apply their own security controls including corporate policies, usage rules and prompts, and contribute suggestions to further collaboration with the broader cybersecurity community
- Basic recommendations on how to visualize and track LLM usage are included within the eSentire LLM Gateway’s initial plug-ins
Chris Turek, Senior Managing Director and CIO for Evercore, a premier global independent investment banking advisory firm, partnered with eSentire to trial its LLM Gateway and was able to accelerate his team’s Generative AI strategy as a result. “Evercore is very interested in Generative AI and believes it will further enhance our differentiated capabilities that lead to superior client results. However, Evercore always puts our clients and the privacy and the confidentiality of their data first. Partnering with eSentire, and in particular the team at eSentire Labs, allows us to do both. eSentire has been a cornerstone in our information security program for over 10 years and with their work on Generative AI they have proven they will be for years to come.”
eSentire Labs is thrilled with the LLM Gateway’s initial testing and has launched its framework organization-wide across the team of 650 eSentire employees. “The telemetry that we’re tracking will give our SOC and Threat Response Unit experts the advantage in identifying LLM-based attacks, far beyond the sophisticated phishing and impersonation scams being reported market-wide today,” confirmed Feick. “We plan to introduce a complete MDR for LLM service offering, extending eSentire’s service promise of preventing business disruption across this new attack surface, as the MDR leader in Generative AI security.”
Access eSentire’s open-source LLM Gateway on GitHub here.
About eSentire
eSentire, Inc., the Authority in Managed Detection and Response (MDR), protects the critical data and applications of 2000+ organizations in 80+ countries across 35 industries from known and unknown cyber threats by providing Exposure Management, Managed Detection and Response and Incident Response services designed to build an organization's cyber resilience & prevent business disruption. Founded in 2001, eSentire protects the world's most targeted organizations, with 65% of its global base recognized as critical infrastructure, vital to economic health and stability. By combining open XDR platform technology, 24/7 threat hunting, and proven security operations leadership, eSentire's award-winning MDR services and team of experts help organizations anticipate, withstand and recover from cyberattacks. For more information, visit: www.esentire.com and follow @eSentire.
Media Contact
Elizabeth Clarke
eSentire
[email protected]
