"Hello World" for DBT Analytical Transformation Workflows

[collectoss-issue-migrator]

Note

Migrated from augurlabs/augur#2295
Originally opened by @sgoggins on 2023-04-06

---

Querying Augur requires a certain degree of learning time, and although there are a number of queries available for starting out in https://github.com/chaoss/augur-community-reports and blog posts, something like "DBT" could make this more systematic.

Overview: https://github.com/chipzx92/DataEngineeringI320/blob/main/docs/presentations/dbt_intro/index.md

Documentation Introduction: https://docs.getdbt.com/docs/introduction

This is issue is ONLY about creating a "Hello World" with these tools.

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @jameshowison on 2023-04-06

---

dbt can help with transformations, so augur could have additional schemas which are built as downstream "data products" to make access to different views possible. It is also useful when you have complex queries with a lot of CTEs, sub-queries, or unions, to make the sub parts more easily reusable and testable.

It requires a place to run, and write access to the schemas. I think that one can get started soonest using dbt cloud, but you can also install locally https://docs.getdbt.com/docs/quickstarts/dbt-core/quickstart

It works fine with postgres and while its SQL native you can also have python tasks, so it becomes more of a complete dag (e.g., the sentiment analysis or the email addresses entity resolution, can run at the right point in a pipeline.

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @sgoggins on 2023-07-18

---

@jameshowison : Does anyone on your team happen to have tried this with Augur? I am guessing not since it requires table creation permissions, it seems.

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @AHB102 on 2023-11-05

---

I am new to open source, can I work on this issue?

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @Joshua-Tihabwangye on 2025-03-12

---

I am new to open source i want to work on this issue

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @HimasreeKolathur24 on 2026-02-08

---

Hi @sgoggins / @jameshowison,
I’d love to work on this issue if it’s still available.
My understanding is that the goal is to create a simple “Hello World” dbt setup that demonstrates how dbt can be used for analytical transformations on Augur data (without going deep into production-level pipelines).
Before I start, I wanted to ask:

• Is a local dbt-core setup with Postgres acceptable for this, or is dbt Cloud preferred?

• Are there any constraints around schema/table creation that I should be aware of?

Happy to start small, document assumptions clearly, and iterate based on feedback. Thanks!

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @MoralCode on 2026-02-08

---

I have a feeling that this issue may not be a good first issue if it requires such deep access to Augur that it involves creating new DB tables.

I have shared this issue with a related group on the CHAOSS slack who may be interested in it and would have the Data engineering background to help Augur evaluate whether this is a good step forward or not.

I will remove the good first issues tags

[collectoss-issue-migrator]

Note

Migrated comment from original
Originally posted by @HimasreeKolathur24 on 2026-02-08

---

Thanks for the clarification.