Uniform test data
Today’s post is a short one. I’ve been working on a project that required supporting multiple data backends. To simplify…
Author: Bart Zwemmer
A curious Data Engineer
UV, Pre-commit and no global python
Working on different projects in the same time, I aim to keep my development environment minimal, predictable, and free of…
Testing SQL functions
The world of Data Engineering – and LinkedIn as a consequence – is full with the latest and greatest tools…
DuckDB Vector Tiles Demo
This is a demo of serving spatial data as vector tiles directly from DuckDB using the spatial extension and showing it on a map in a Flask app.
PySpark OOP UDF
Snippets and tips to create a PySpark UDF
Kubernetes network debugging pod
Learn how to run a throw-away pod in your Kubernetes cluster for easy debugging.