What we are
PII Detection & Synthetic Data
We focus on PII detection and synthetic data generation. Our goal is to enhance data privacy and security.
GenAI Security
We concentrate on the security of AI agents, aiming to prevent unauthorized access and malicious use.
LLM Security
We develop strategies to protect large language models from jailbreak and prompt injection attacks.
AI Ethics
Our research focuses on the ethical use of AI, aiming to prevent toxic content and harmful behaviors.
Blog Posts
Arbitrary File Read (AFR) vulnerability in LangChain JS library...
Open Devin is a fully autonomous AI agent...
Prompt injection dataset
Data Exfiltration and Backdoor Risks...
GPT-4 Vision Prompt Injection...
Our projects
The Prompt Firewall Chrome Extension is a browser add-on designed to safeguard sensitive personal information, including PII, for both individuals and businesses.
This extension offers several features specifically tailored to improve the privacy of data processed by large language models (LLMs), including pseudonymization or blocking functions.
