Singapore has put forward a new international standard, ISO/IEC 42119-8, to standardize the testing methodology for Generative AI systems, aimed at strengthening the foundation for trustworthy artificial intelligence (AI) testing.

This is the first international standard of its kind for the testing of Generative AI systems and will be discussed at the 17th ISO/IEC JTC 1/SC 42 plenary meeting1, held in Singapore from 20-24 April, the Infocomm Media Development Authority (IMDA) said in a statement.

Co-organized by the IMDA and Enterprise Singapore (EnterpriseSG) and hosted in the ASEAN region for the first time, the bi-annual plenary will gather more than 35 national bodies and over 250 AI experts from around the world, including the United States, United Kingdom, China, Japan, Germany, France, and the Republic of Korea.

It is noted that with the rapid development and pervasiveness of AI across ecosystems, it is crucial that there are globally recognized AI standards to ensure AI is used in a reliable and safe way.

Specifically, Singapore has put forth a new ISO/IEC 42119-8 standard with a focus on benchmarking and red teaming methodologies for Generative AI systems with standardized testing approaches.

Overall, it establishes an important framework for AI testing that enhances the reproducibility and comparability of results.

This, in turn, will drive assurance and overall trust in AI systems and enable safer, more reliable adoption by AI deployers and users.

The ISO/IEC 42119-8 builds on IMDA’s past work in developing domestic testing frameworks, including our AI Verify Toolkit and the Starter Kit for Testing of large language model (LLM)-Based Applications for Safety and Reliability and in the nascent field of assurance through the Global AI Assurance Sandbox.

It is part of Singapore’s broader commitment to international AI standards, as seen in the national adoption and accreditation program of ISO/IEC 42001 led by EnterpriseSG, and the contribution of real-world use cases to support ISO/IEC TR 24030’s documentation of AI applications in practice.

Together, these efforts lay the groundwork for trustworthy AI implementation.

IMDA and EnterpriseSG are also hosting a series of capacity building initiatives on the sidelines of the plenary meeting.

Firstly, Broad-Based Foundational Training Workshop is organized in partnership with the American National Standards Institute (ANSI) to strengthen AI standards capability of ASEAN member states in AI Standards.

Secondly, AI Standards and Policy Workshop, a third global workshop organized by ISO and targeted at national standards bodies and AI policy makers from 15 countries.

The workshop focuses on practical applications of key ISO/IEC AI standards for governance.

Thirdly, AI Assurance Exchange – AI Standards in Action, organized by Singapore’s AI Verify Foundation with a gathering of participants from global standard-setters, policymakers, and industry leaders to discuss the evolving landscape of AI standards.

Participants will take part in three panels – opportunities and gaps in AI standards, standards for the region and translating AI Standards into practice through the Global AI Assurance Sandbox.

“Singapore is committed to developing a trusted AI ecosystem through our AI Safety Institute (AISI), leadership in the ASEAN Working Group on AI Governance (WG-AI), and our role as lead ASEAN member for the AI Priority Area under the ASEAN Digital Trade Standards and Conformance Working Group (DTSCWG)，

”This close cooperation advances our shared goal of ensuring AI is built and deployed in a trustworthy manner for individuals and enterprises alike,” said IMDA.

IMDA ramps up support for fresh graduates pursuing tech careers in Singapore