{AI Security Research Lab}
What we are
PII Detection & Synthetic Data
We focus on PII detection and synthetic data generation. Our goal is to enhance data privacy and security.
GenAI Security
We concentrate on the security of AI agents, aiming to prevent unauthorized access and malicious use.
LLM Security
We develop strategies to protect large language models from jailbreak and prompt injection attacks.
AI Ethics
Our research focuses on the ethical use of AI, aiming to prevent toxic content and harmful behaviors.
Blog Posts
LangChain JS Arbitrary File Read Vulnerability
Arbitrary File Read (AFR) vulnerability in LangChain JS library...
Memory Pollution in LLMs: Understanding New AI Security Concerns
This article explores the concept of memory pollution in Large Language Models (LLMs)...
Multiple Vulnerabilities in Open Devin
Open Devin is a fully autonomous AI agent...
Turkish Prompt Injection [Huggingface]
Prompt injection dataset
What is the GPT-4 Vision (GPT-4V) Prompt Injection?
ChatGPT Security
Our projects
The Prompt Firewall Chrome Extension is a browser add-on designed to safeguard sensitive personal information, including PII, for both individuals and businesses.
This extension offers several features specifically tailored to improve the privacy of data processed by large language models (LLMs), including pseudonymization or blocking functions.
LangTsunami is a tool designed to facilitate various text manipulation tasks such as scrambling and code-switching in multiple languages.
It offers insights into undesirable LLM behaviors for red teamers and researchers focusing on multi-lingual contexts.
