aliz-ai/jarvis ↗
Created Feb 16, 2021 · View the aliz-ai/jarvis repository page
An animated time-lapse of how aliz-ai/jarvis was built, commit by commit.
Want this for your repo?
Render a free sample of any GitHub repo in seconds.
Contributors
5
Lines of Code
753
From
Jul 29, 2020
To
Feb 4, 2021
About aliz-ai/jarvis
Jarvis is a Java-based test runner application designed to validate data pipelines and transformations across multiple database and cloud platforms. The application uses Spring Boot and Maven for packaging and can be executed as a standalone JAR file.
The test runner operates through three distinct phases: initiation (preparing the test environment), execution (running the actual tests), and assertion (validating results). It supports multiple context types including BigQuery, MySQL, MSSQL, SFTP, and TalendAPI, each configured through a contexts.json file that defines connection parameters and optional substitution variables. Tests are organized in a folder structure with pre and assert directories that contain the SQL queries, JSON data files, and configuration needed for each test case.
The framework is particularly suited for testing data warehouse operations, supporting both direct query execution and data loading scenarios. Users define test suites through jarvisTestSuite.json configuration files that specify which contexts to use, queries to execute, and assertion rules. It includes advanced features like dataset name prefixes for swapping between environments, automatic metadata addition during initialization, and the ability to exclude previously inserted rows from assertions.
