privacy proxy

  • LLM-Shield: Privacy Proxy for Cloud LLMs


    LLM-Shield: Privacy proxy - masks PII or routes to local LLMLLM-Shield is a privacy proxy designed for those using cloud-based language models while concerned about client data privacy. It offers two modes: Mask Mode, which anonymizes personal identifiable information (PII) such as emails and names before sending data to OpenAI, and Route Mode, which keeps PII local by routing it to a local language model. The tool supports various PII types across 24 languages with automatic detection, utilizing Microsoft Presidio. Easily integrated with applications using the OpenAI API, LLM-Shield is open-sourced and includes a dashboard for monitoring. Future enhancements include a Chrome extension for ChatGPT and PDF/attachment masking. This matters because it provides a solution for maintaining data privacy when leveraging powerful cloud-based AI tools.

    Read Full Article: LLM-Shield: Privacy Proxy for Cloud LLMs