Join us live September 9th for an inside look into Compass, Data-driven decisions, right in Slack
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
All Blogs
Releases
Engineering
Product
October 25, 2022
Build a poor man’s data lake from scratch with DuckDB
DuckDB is so hot right now. Learn how to build a data lake from dbt using DuckDB for SQL transformations, along with Python, Dagster, and Parquet files.
Pete Hunt
October 19, 2022
The Unreasonable Effectiveness of Data Pipeline Smoke Tests
Data practitioners waste time writing unit tests to catch bugs they could have caught with smoke tests.
Sandy Ryza
October 17, 2022
Web Workers are not the Answer
A tale of overstretched logs, counterintuitive web worker behavior, and ultimately a troublesome cursor issue.
Jordan Sanders
October 16, 2022
Dagster at all 5 Steps of the Development Lifecycle
Dagster facilitates a data engineers work across all five steps in the development lifecycle.
No items found.
October 6, 2022
A Dagster Crash Course
If you are looking to get up and running with Dagster in 10 minutes or less, this is a good place to start. Buckle up.
Pete Hunt
October 4, 2022
Postgres: a Better Message Queue than Kafka?
When lots of event logs must be stored and indexed, Kafka is the obvious choice. Naturally, our queue runs on Postgres.
Pete Hunt
August 17, 2022
Spend Less Time Debugging with Dagster
It’s not uncommon for a data engineer to devote 80% of their day to debugging. Dagster radically improves on this.
Sandy Ryza
August 5, 2022
Introducing Dagster 1.0: Hello
Announcing Dagster 1.0. - a stable foundation for building the orchestration layer for modern data platforms.