👋 Welcome to my technical blog!
I write about Data Engineering, Rust, Go, Python and open source technologies.
Exploring lakehouse architectures, real-time streaming and the modern data world.
Designing a Data Profiler Around Apache Arrow: Lessons from dataprof
A design story of dataprof: why I built a profiler around Apache Arrow, how it changed the architecture, and how this journey led to contributions to arrow-rs’ Parquet reader.
Async in Python and Rust: Two Worlds, One Keyword
A technical exploration of async/await in Python and Rust: how the same syntax hides completely different execution models, with practical examples from contributions to Tokio and Python projects.
Mosaico: The Data Platform for Robotics and Physical AI Written in Rust
A deep dive into Mosaico, the robotics data platform written in Rust: client-server architecture, semantic ontologies, data-oriented debugging, my journey within it, and the integration with Data Contract Engine.
Ceres: Semantic Search for Open Data
Ceres is a semantic search engine for CKAN portals. Built in Rust with Tokio and PostgreSQL+pgvector, it bridges the gap between how people search and how public administrations name their datasets.
Closing the Rust Circle: High-Performance Data Analysis with Polars
Polars completes the Rust data engineering ecosystem: lazy evaluation, Apache Arrow, and native Iceberg V3 integration for performant analytics that compete with distributed clusters. The third pillar of the RisingWave + Lakekeeper + Polars stack.
Lakekeeper: The Apache Iceberg REST Catalog Written in Rust
An exploration of Lakekeeper, the Iceberg REST catalog in Rust that completes the data engineering ecosystem: enterprise security with vended credentials, multi-tenancy, and RisingWave integration to build streaming lakehouses without JVM
RisingWave and Iceberg-Rust: When Real-Time Streaming Meets Modern Data Lake
The partnership between RisingWave and Iceberg-Rust represents a window into where modern data engineering is heading: real-time CDC streaming, intelligent hybrid delete strategy, and a performant Rust ecosystem challenging JVM dominance.