Developer guidelines are a set of principles and recommendations that help software developers create high-quality, consistent, and maintainable code. I would like to share with you my experience as to what worked best for me over the years. Audience This blog is primarily aimed at backend developers, although individuals from other…

DBT is an incredible tool worth exploring. If you’re unfamiliar with it, I encourage you to search for it online, give it a try, and then return here. In a nutshell: DBT is a abstract platform for generating sql etls on multiple vendors. …

Having been assigned the task of delivering a lightning talk on Benthos, I decided to have a look around to see what else is in the ETL arena. I have worked in the past with Jenkins, airflow and argo workflow. I have read about apache nifi, Airbyte, Stitch, and Fivetran…

As you know I love DBT (https://www.getdbt.com/) and I am a very big advocate for building a self-service data platform using DBT as the ELT block. …

Data has become one of the most valuable assets for businesses in the digital age. With the increasing amount of data being generated and stored, it’s crucial for organizations to have a clear plan for managing this information. This is where a Data Management Roadmap comes into play. A Data…

DBT Is an excellent tool, but “With great power comes great responsibility”. Any build system that respects itself has to have a way of importing dependencies, and DBT is no different. So what are the basic options that DBT gives you for defining dependencies? All dependencies are defined in the…

Facts vs Dimensions Before we describe the design issue, we need to first start with some clarification on what facts vs dimensions are.

As you know from my previous stories, I am a DBT advocate. DBT has done so many good things in the ELT area. If you are new to DBT see DBT get started. There are other areas where DBT has not yet decided to take a stand as to what…

DBT is a great tool for transforming data within you data warehouse. No tool is perfect, and like any tool out there, you usually need to add your custom code, so that it fits better into your organization. DBT code comes in two flavors. You have DBT Cloud, a SAS…