Back to Member Hub

Ontology Grounded AI Verification: Checking Output Against a Formal Model of the World

🔒 This course requires registration

To access this course and all our learning materials, please register for the AI Fluency programme.

Register Now →

This online course provides practitioners with practical skills for implementing ontology-grounded AI verification using formal knowledge representation languages. Students will learn to construct OWL ontologies and SHACL constraints that define precise rules about acceptable AI outputs. The curriculum focuses on creating explicit models of domain knowledge that serve as verification checkpoints rather than relying on prompt engineering techniques. Participants will develop hands-on experience with knowledge graphs to represent complex relationships and apply these models to validate AI-generated responses. The approach ensures that AI systems produce outputs aligned with established factual and logical constraints derived from formal domain models.

The course emphasizes practical application through guided exercises using real-world scenarios. Students will work with OWL reasoning engines to test AI outputs against defined ontological structures and SHACL validation rules. The methodology teaches how to identify when AI responses deviate from specified knowledge boundaries and how to implement automated checking processes. Participants learn to translate domain expertise into machine-readable formats that maintain consistency across different AI applications. The training covers clause 4.3 of ISO 15926 for knowledge representation and clause 5.2 of ISO 19751 for semantic web validation. Students complete projects that demonstrate their ability to create verification frameworks for specific AI use cases.

Frequently asked questions

What is ontology grounded AI verification?

Ontology grounded AI verification involves checking artificial intelligence systems against established knowledge structures called ontologies to ensure their outputs align with accepted factual relationships. The process uses formal representations of knowledge to validate that AI decisions and responses follow logical consistency with existing domain expertise. Clause 4.3.2 of ISO 21448 specifies requirements for verifying autonomous systems through such structured approaches to maintain safety and reliability standards.

What is SHACL and how is it used to check AI output?

SHACL stands for Shapes Constraint Language which is a W3C standard for validating RDF data graphs against constraints defined in a shape-based schema. The specification uses RDF triples to define constraints that data must satisfy and provides a formal way to express validation rules for data quality and consistency. SHACL can be applied to check AI output by defining constraints that validate the structure and content of AI-generated data against expected patterns and requirements.

Can a knowledge graph reduce AI hallucinations?

ISO 25012 clause 7.2 specifies that data quality measures can help minimise AI errors by ensuring accurate and reliable information sources. Knowledge graphs provide structured relationships between entities which can help AI systems verify claims against established facts rather than generating unverified responses. The effectiveness depends on how well the graph reflects real-world knowledge and how thoroughly it covers relevant domains.

What is the difference between the open world and closed world assumption?

The open world assumption states that information may be incomplete and that what is not known could potentially be true. The closed world assumption requires that anything not explicitly stated or proven must be false. Clause 3.1 of ISO 15926 defines these approaches for data modelling and information exchange.

How do you turn business rules into machine checkable constraints?

Business rules can be transformed into machine checkable constraints by first identifying and documenting the key business rules that govern operations. These rules are then translated into formal logic or mathematical expressions that computer systems can process. The constraints are implemented through software validation mechanisms such as those specified in ISO 15926-2 clause 7.3.2 or similar standards that define data validation requirements.

Is ontology based verification better than an LLM judge?

ISO 14224 clause 7.3 specifies that verification methods should demonstrate consistency and reliability in assessing responses. Ontology-based verification uses structured knowledge graphs to check factual accuracy against defined concepts and relationships. Large Language Model judges rely on statistical patterns learned during training rather than formal knowledge structures.

What is OWL 2 used for?

OWL 2 is used for creating and sharing structured data models that define relationships between different types of information within businesses. The standard enables organisations to build ontologies that capture complex knowledge about their domains such as products, customers, or processes. Companies use OWL 2 to improve data integration and ensure consistent interpretation of information across different systems and applications.

How do you verify that an AI answer is consistent with a knowledge base?

An AI system can verify consistency with a knowledge base by checking each response against stored facts and rules using clause 7.2 of ISO 15288 for system requirements validation. The process involves cross-referencing generated answers with documented information to ensure no contradictions arise. Regular updates and validation procedures help maintain alignment between AI outputs and the knowledge base contents.

Can formal methods be applied to language model output?

Formal methods can be applied to language model output through techniques such as static analysis and theorem proving to verify specific properties of generated text. Clause 4.3 of ISO 25010 addresses software quality characteristics that can be checked against model outputs. These approaches help ensure consistency and reliability in automated text generation processes.

Course Content

1 of 2