Responsible AI Testing of Large Language Models
Builders and buyers of AI systems are required to test and show that their systems comply with legislation – on safety, discrimination, privacy, transparency, and accountability. This talk covers recent regulation in this space, limitations that current Generative AI models have, and an automated testing framework that mitigates them.
We describe the open-source LangTest library, which can automate the generation and execution of more than 100 types of Responsible AI tests. We then introduce Pacific AI, which provides a no-code interface for this capability for domain experts, as well as automating many of the best practices on how these tools should be used.
David Talby
CTO at John Snow Labs
David Talby is the Chief Technology Officer at John Snow Labs, helping companies apply artificial intelligence to solve real-world problems in healthcare and life science.
David is the creator of Spark NLP – the world’s most widely used natural language processing library in the enterprise. He has extensive experience building and running web-scale software platforms and teams – in startups, for Microsoft’s Bing in the US and Europe, and to scale Amazon’s financial systems in Seattle and the UK.
David holds a Ph.D. in Computer Science and Master’s degrees in both Computer Science and Business Administration. He was named USA CTO of the Year by the Global 100 Awards in 2022 and Game Changers Awards in 2023.
