Summary

Global AI Assurance Pilot

Together with its parent IMDA, the AIVF launched the Global AI Assurance Pilot in February 2025, to help codify emerging norms and best practices around technical testing of Generative AI (“GenAI”) applications. Existing, real-world GenAI applications were put to the test, pairing organisations that had deployed them with specialist AI testing firms.

View Main Report

Targeted outcomes

001

Testing Norms and Practices

Inputs into future standards for technical testing of GenAI applications

002

Foundations for a Viable Assurance Market

Greater awareness of the ways in which external assurance can help create trust in AI systems and enable adoption at scale

003

Inputs Into AI Testing Tool Roadmaps


Inputs into open source and proprietary testing tools for GenAI applications

Timeline 2025

Feb

Expression of Interest and confirmation of participation (closed)

Mar - Apr

Technical Testing of Generative AI Application

May

Consolidate insights and showcase at 
Asia Tech x Singapore 2025

Our Pilot Participants

Pilot Use Cases

Use Case Details

How are LLMs used in the application?

# (of use cases: top 5 archetypes only)

Summarisation

/ 15

Retrieval augmented generation

/ 13

Data extraction from unstructured source

/ 12

Multi-turn chatbot

/ 10

Classification or recommendation

/ 08

Testing Approaches

Test datasets

Evaluators

What’s next

IMDA Starter Kit for safety testing of LLM-based applications – Consultation

Enhancements to AIVF open source GenAI testing toolkit roadmap

Future Pilot Cohorts

Testing Real World GenAI Systems

Case Study Compendium