A few months ago, we were tasked with migrating the data workflow of a property management company, which was heavily based on Excel Sheets, into a modern Data Warehouse. In…
Docker has revolutionized the way applications are developed, tested, and deployed. It addresses several common problems in software development, including inconsistent environments, difficulty in scaling applications, and issues with dependency…
In my last blog, I briefly described Dagster. In data engineering, effective orchestration tools are essential for managing increasingly complex data workflows. Among the most popular solutions are Apache Airflow…
Dagster is an innovative open-source data orchestrator which offers a robust solution for designing, testing, and running data pipelines. This blog post explores Dagster's unique features through practical, non-code examples,…
