Data tools comparison
This project aims to test and compare different databases for data engineering.
The project was done by a team of four people during my 3rd year of Bachelor. Our goal was to test, deploy, and evaluate the benefits of different database systems for data engineering tasks.
To do this, we compared ClickHouse, Google Cloud’s BigQuery, and PostgreSQL. We also used dbt as our framework to build and run queries to better simulate a data engineering environment. We used the same data and the same queries for a fair comparison.
Since we already wrote blog posts about this project, I’ll point you to them here. Please note that the blog posts are entirely written in French.
You can also access the repository if you are curious about the code.