Abstract artwork of horizontal amber and copper bars on a dark slate background, the last bar in red past a white deadline line.
Products

ARQS Tablewright Flow tells data teams when last night’s pipeline will finish, which deadline it will miss and what to rerun first

The KODE-414 browser tool turns a job list and run log into a dependency-ordered plan with projected finish times, the critical path, blocked jobs and a recovery queue.

Illustration: original artwork generated for ARQS with Python and Pillow.

ARQS has released Tablewright Flow, catalogued as KODE-414, a browser tool for small data and analytics teams that run a nightly chain of import, cleaning and reporting jobs and need to know whether the morning dashboard will be ready on time.

Users import a job list with each job’s ID, the jobs it depends on, its planned minutes and, optionally, an owner and a finish-by time, plus a run log with the job, date, status and minutes. Exports from Airflow, dbt, cron logs or a spreadsheet are recognised; a later row for the same job and day is treated as a retry.

Tablewright Flow orders the jobs by their dependencies and catches cycles and references to jobs that do not exist. It then projects when each job will start and finish, using the median of its recent successful runs, flags any job that will miss its deadline and by how many minutes, and shows the chain of jobs that sets the finish time.

For any date the tool shows which jobs succeeded, failed, were blocked by an upstream failure or never ran, and lists the failed and blocked jobs in the order to rerun them, with what each one unblocks. Failure streaks and jobs running much slower than planned are also flagged. It does not connect to or trigger any scheduler, and every import is kept in a hash-chained journal in the browser.

Plans are listed at US$99 a month or US$990 a year. Online checkout is not open yet; buyers request access by email.

Details are on the Tablewright Flow page, with pricing on the access page.

From our partners

Partner content

More from our network: ARQS, TOWNLINE, Jason's Place and Ackerman.