Garak: Open-source LLM Vulnerability Scanner

0
8

LLMs can make mistakes, leak data, or be tricked into doing things they were not meant to do. Garak is a free, open-source tool designed to test these weaknesses. It checks for problems like hallucinations, prompt injections, jailbreaks, and toxic outputs. By running different tests, it helps developers understand where a model might fail and how to make it safer.

LEAVE A REPLY

Please enter your comment!
Please enter your name here