Watch and track your favorite playlist.
Curated by: The Linux Foundation (287 videos)
Don't miss out! Join us at the next Open Source Summit in Seoul, South Korea (November 4-5). Join us at the premier vendor-neutral open source conference, where developers and technologists come together to collaborate, share knowledge, and explore the latest innovations and advancements in open source technology. Learn more at https://events.linuxfoundation.org/ Open Source Tools To Empower Ethical and Robust AI Systems - Alberto Rodríguez, ControlPlane & Miguel Fontanilla, sennder In this talk, we will present open-source tools for evaluating and securing AI models which are key in building responsible AI systems. We'll start with an overview of these tools and their use cases, organized through a simple ontology to help classify them. We'll cover: - Tools that assess bias and fairness, such as AIF360 - Evaluation tools like Garak, which offers comprehensive security and safety assessments for LLMs; Promptfoo, which supports prompt engineering and testing; and Giskard, which allows the use of custom evaluation datasets - Guardrail tools for LLM systems, like NeMo Guardrails - Tools that focus on prompt security and insights, such as LLMGuard and LangKit - Tools for traditional ML model security, like the Adversarial Robustness Toolbox The main goal of the talk is to give attendees a clear overview of the wide range of open-source tools available for securing AI models and provide examples and insights about them that can help in making an informed decision on which one to use.