X Test Harness

XTH (X Test Harness) is a Test Harness framework for executing the Test Suites produced by the W3C XQuery and XSLT (nee: XSL) Working Groups, and the QT4 Community Group.

This software was initiated as part of a Research Paper published by the XML Prague 2026 conference: XTH - An Implementation Agnostic Test Suite Runner.

XTH is a modular system that allows Parsers, Connectors, and Reporters to be contributed to allow for the parsing, execution, and reporting of any Test Suite against any vendor's product that attempts an implementation of the standards produced by the Working/Community Groups.

We welcome external contributions by Pull Request, you may wish to open an issue first to discuss your ideas. Please note that at this time we cannot accept code generated by AI (LLM).

Available Modules

• Command Line Interface
• QT3 Tests Parser
• Saxon Connector
• Console Reporter
• OTR (Open Test Reporting) Reporter - Events XML and HTML Report

Compiling from Source

Requires:

• Java 25
• Apache Maven 3

Unix/Linux/macOS:

git clone https://github.com/evolvedbinary/xth.git
cd xth
./mvnw package

Windows

git clone https://github.com/evolvedbinary/xth.git
cd xth
mvnw package

After compilation, you can find a folder with a complete distribution of the Command Line Interface version of XTH at: xth-cli/xth-1.0.0-SNAPSHOT/lib

Running XTH from the Terminal / Command Line

From inside a folder containing an XTH distribution:

Unix/Linux/macOS:

./bin/xth.sh

Windows

bin\xth.bat

By default, XTH will execute the QT3 Tests against Saxon, and produces reports to the console and Open Test Reporting XML Events and HTML output files.

If you want to do something different you can pass --help, as an argument to see the usage.