Beschreibung

Your data pipelines shouldn't break at 3 AM.

I'm a Data Engineer with 10+ years of experience designing bulletproof data platforms for companies processing billions of events daily. From Walmart Labs to Zalando to Lidl, I've built the infrastructure that powers real-time analytics, e-commerce, and customer-facing products at scale.

What I bring to your project:

→ Streaming Expertise – Kafka, Flink, Spark Streaming. I design event-driven architectures that handle traffic spikes without breaking a sweat.

→ Modern Data Stacks – Delta Lake, Databricks, dbt. Whether you're migrating to a lakehouse or optimizing what you have, I've done it.

→ Production Mindset – I don't just build pipelines; I build systems that your team can maintain, monitor, and trust.

Certified: Confluent Data Streaming | Databricks

I'm the right fit if you need:

A data platform built from scratch

Migration from batch to real-time processing

Schema design and data modeling for complex domains

Hands-on delivery, not just architecture diagrams

Based in Germany 🇩🇪 | Available for remote projects across the EU

Sprachen

Englisch
Muttersprachlich oder zweisprachig
Deutsch
Grundkenntnisse
Hindi
Konversationssicher

Arbeitsortpräferenzen

Nur remote

Führt Projekte hauptsächlich remote aus

Lidl e-commerce,
Consultant Data Engineer (Data Platform)
E-COMMERCE
Juli 2022 - Heute (3 Jahre und 11 Monate)
Berlin, Germany
• • Building and maintaining data pipelines for Lidl Plus and e-commerce in a cross-cloud (GCP, Azure), cross-functional team; CI/CD with DevOps, Airflow scheduling, Spark tuning
• • Architecting event-driven pipelines consuming from GCP Pubsub, SAP, and Snowflake into Delta Lake medallion architecture; processing up to 6M records per event daily
• • Built real-time stock notification system using Spark Streaming to alert customers when products are back in stock, generating €1.5M additional revenue
• • Maintaining Spring Boot API ingestion apps; driving architecture simplification and cost optimization; exploring Apache Flink, Lakeflow, and Apache Arrow for platform evolution
• • Driving innovation: evaluating AI/LLM tools (Claude Code, Gemini CLI) for CI/CD automation; Golang-based Franz for cost-efficient Kafka consumption; published technical blogs
Apache Kafka Apache Spark Infra als Code Microsoft Azure
Zalando Payments,
Data Engineer (Sole DE in Team)
September 2020 - Januar 2022 (1 Jahr und 4 Monate)
Berlin, Germany
• • Owned end-to-end data engineering: onboarded 160+ payment and order events, processing up to 1.5 TB daily on Databricks from Nakadi (Kafka), Snowflake, Redshift, and SAP HANA
• • Maintained Redshift data warehouse; collaborated with analysts and scientists; monitored pipelines during high-traffic events like Cyber Friday
Databricks Apache Kafka Datenbereinigung & Vorverarbeitung SQL Data Engineer
Walmart Labs,
Software Engineer III (Data Platform
November 2019 - September 2020 (10 Monate)
Bengaluru, Karnataka, India
• • Canada: Built real-time vehicle tracking system for product returns; worked with data scientists on profit/loss prediction for returns, generating $2M additional revenue annually
• • UK: Built and maintained data pipeline for ASDA stores to calculate hourly discounts; optimized existing ETL components