EasyJailbreak / EasyJailbreak Star 466 Code Issues Pull requests An easy-to-use Python framework to generate adversarial jailbreak prompts. jailbreak discrete-optimization large-language-model llm-security llm-safety-benchmark jailbreak-framework Updated Sep 2, 2024 Python
Babelscape / ALERT Star 32 Code Issues Pull requests Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming" nlp benchmark ai artificial-intelligence nlp-machine-learning red-teaming bias-detection safety-monitoring transformers-models llm llm-evaluation llm-safety llm-safety-benchmark Updated Sep 20, 2024 Python
declare-lab / resta Star 26 Code Issues Pull requests Restore safety in fine-tuned language models through task arithmetic alignment safety alignment-algorithm llm llms llm-safety llms-benchmarking llm-safety-benchmark Updated Mar 28, 2024 Python