Smarter Week

How to automate it

How to automate “review SQL and pipeline pull requests”

Here is the best way to spend less time on this, best first. Each comes with steps you can follow today.

30 min
typically, a few times a week
40%
of the time can be automated
Some setup
to set up

Fix 1 of 1

Automation

Let CI and an AI reviewer check data PRs before you do

Linting, slim dbt CI builds, data diffs and an AI reviewer catch style issues, broken models and unexpected row changes, so human review focuses on logic.

Typically saves about 35% of the time3 h to set up
  1. 1Add SQLFluff linting and a dbt build of changed models (slim CI) to every PR.
  2. 2Add a data diff (Datafold or dbt's compare) to show how results change.
  3. 3Add an AI reviewer such as Copilot code review or CodeRabbit with your conventions.
  4. 4Review only after checks pass.

Tools: SQLFluff · dbt Cloud CI · Datafold · GitHub Copilot code review · CodeRabbit

Who does this task

Roles in our library that list this as one of their common tasks. Each guide covers the rest of that role’s week.

Data engineerData scientist

HourLeak · the 8-minute work audit

How many hours does this cost you?

The free 8-minute check works out where your week goes and gives you your top fixes. The team scan does the same for everyone and adds it up, so you know which leaks to fix first.

Take the free check Scan my team, $49

Answers are anonymous. Leaders only see team totals.

Other common tasks for Data engineers