Atheer AlabdullatifinTweeq EngineeringTweeq Data Platform: Journey and Lessons Learned: Clickhouse, dbt, Dagster, and SupersetIn this article we will go through Tweeq data platform journey starting from requirements that led to certain design choices and the…4 min read·1 day ago--1
Hussein JundiinTowards Data ScienceData Engineering: Towards Sustainable PatternsEngineers, scientists, and analysts have the potential to greatly reduce carbon emissions by introducing sustainable, efficient, and robust…·13 min read·3 days ago--3
Lorena GonganginData Engineer ThingsHow I build an ETL pipeline with AWS Glue, Lambda, and TerraformA Step-by-Step Guide·12 min read·5 days ago--3--3
Raju GatlaYoutube Data Pipeline using Airflow in Docker ContainerIn this article we will go through a data pipeline, which will capture youtube video comments and replies, process and ingest it into AWS…4 min read·12 hours ago----
Krzysztof K. ZdebinTowards Data ScienceBest Practices for Technical Columns in Database DesignWhen architecting a transactional database or a data warehouse, it’s important not to forget about various types of technical columns…·15 min read·6 days ago--1--1
Atheer AlabdullatifinTweeq EngineeringTweeq Data Platform: Journey and Lessons Learned: Clickhouse, dbt, Dagster, and SupersetIn this article we will go through Tweeq data platform journey starting from requirements that led to certain design choices and the…4 min read·1 day ago--1
Hussein JundiinTowards Data ScienceData Engineering: Towards Sustainable PatternsEngineers, scientists, and analysts have the potential to greatly reduce carbon emissions by introducing sustainable, efficient, and robust…·13 min read·3 days ago--3
Lorena GonganginData Engineer ThingsHow I build an ETL pipeline with AWS Glue, Lambda, and TerraformA Step-by-Step Guide·12 min read·5 days ago--3
Raju GatlaYoutube Data Pipeline using Airflow in Docker ContainerIn this article we will go through a data pipeline, which will capture youtube video comments and replies, process and ingest it into AWS…4 min read·12 hours ago--
Krzysztof K. ZdebinTowards Data ScienceBest Practices for Technical Columns in Database DesignWhen architecting a transactional database or a data warehouse, it’s important not to forget about various types of technical columns…·15 min read·6 days ago--1
Vu TrinhinData Engineer ThingsHow does Uber build real-time infrastructure to handle petabytes of data every day?All insights from the paper: Real-time data infrastructure at Uber19 min read·Mar 23, 2024--14
Sasha KorovkinainTowards Data ScienceSQL Server’s Secret Feature — Run Python and Add-Ons Natively In SQL Server.Import Python libraries, manipulate and output SQL tables and more, all without leaving SQL server.8 min read·2 days ago--4
Niels ClaeysindatamindedbeThe building blocks of successful Data TeamsBased on my experience I will elaborate on key criteria for building successful data teams7 min read·May 3, 2024--4