Task script conventions

Task script conventions overview

This section outlines our guidelines for developing task scripts in the common namespace. The strategies outlined here have been refined through years of artifact development by the Tetra Data team, and have been found to help streamline task script development, code review, as well as future debugging and updates.

Primary model: An in-memory structure which closely models the structure of the raw file, and is used to validate the input file structure is as expected.

Intermediate Data Schema (IDS): A JSON schema which defines the structure of the output data.

High-level task script design pattern

• Design a primary model of the input data

• Parse the raw file into the primary model

• Map the primary model to the IDS