You're seeing this page as if you were . The main menu is still yours, though. Exit from immersion
Darshan SinghDS

Darshan Singh

Senior Data Architect Databricks Snowflake Expert

840 €/Tag
Frankfurt am Main, DE
15+ Jahre

Durchschnittliche Reaktionszeit: 1h

Über Darshan

Senior Data Architect | Databricks & Snowflake Specialist | 20+ Years Experience

I help enterprises build data platforms that deliver reliable, on-time data for BI and ML—and I fix the fragile ones that don’t.

With over 20 years of experience as a Senior Data Architect and Lead Engineer, I specialize in architecting greenfield cloud lakehouses and executing high-stakes migrations from legacy systems to modern stacks. My recent track record includes delivering mission-critical platforms for global leaders such as Sanofi, JP Morgan, Zalando, E.ON, Hilti, and Adevinta.

What I deliver (Project Deliverables):

Cloud Lakehouse Architecture: End-to-end design and implementation on Databricks (Delta Lake), Snowflake, AWS, and Azure.

Enterprise-Grade Migrations: Seamless transformation of legacy environments (SQL Server, Oracle, Sybase, Redshift) to modern cloud platforms.

Streaming & Real-time Data: High-availability pipelines using Kafka, Spark Structured Streaming, and Snowflake Streams.

Cloud Cost Optimization: Reducing monthly compute spend by up to 30%+ through strategic clustering, right-sizing, Z-ordering, and Photon optimization.

Reliability & Governance: Implementing robust monitoring (Airflow SLA alerting), quality gates, and enterprise security frameworks (Unity Catalog, Snowflake RBAC, HIPAA/GDPR).

Production-Grade Engineering: Building modular, scalable pipelines using dbt (staging/core/mart), PySpark, and CI/CD best practices.

About Me:
I am a German Citizen available for 100% remote work across the EU, UK, and CH. I am fluent in English and proficient in German (B1/B2).

The Bottom Line: I write production code—I don't just draw architecture diagrams. I focus on building systems that are stable, cost-effective, and ready to scale with your business.
  • Hindi

    Muttersprachlich oder zweisprachig

  • Englisch

    Verhandlungssicher

  • Deutsch

    Konversationssicher

Vor Ort möglich
Frankfurt am Main (bis zu 50 km), Berlin (bis zu 50 km), Munich (bis zu 50 km), Hamburg (bis zu 50 km), Cologne (bis zu 50 km)

Projekt- und Berufserfahrung

  • DKV Analytics
    Senior Data Architect / Data Engineer
    Juli 2025 - Heute (11 Monate)
    Kelkheim, Deutschland
    • • Architected a scalable Snowflake-centric lakehouse (10+ sources, claims/policy/member domains), driving critical ML and reporting workloads; reduced compute costs significantly and improved query execution speeds through strategic clustering keys and warehouse autoscaling.
    • • Resolved delivery bottlenecks by deploying ADF pipeline monitoring and alerting — reducing pipeline failures and ensuring business-critical reports were consistently available on time.
    • • Secured enterprise data governance via Databricks Unity Catalog (RBAC, automated lineage, column masking, row filters) and dbt slim CI/CD, establishing audit-ready access controls across all domains.
    SQL Snowflake DBT ADF Databricks
  • Adevinta (Online Classifieds)
    Senior Data Engineer
    Juli 2024 - Juni 2025 (11 Monate)
    Kelkheim, Deutschland
    AWS
    • · Databricks
    ◦ · dbt
    ◦ · Airflow
    ◦ · Unity Catalog
    ◦ · Kafka
    ◦ · Athena
    ◦ · GitHub Actions
    ◦ · Power BI
    ◦ · Tableau
    Engineered Pipeline: Airflow (Salesforce / SAP / BigQuery / PostgreSQL) → Raw (Delta Lake) →Athena →Power BI / Tableau
    • • Spearheaded the re-architecture of a fragile legacy PySpark platform (8+ sources) into a governed AWS lakehouse on Databricks and dbt; improved reporting layer query performance and eliminated a class of pipeline failures that had previously caused data gaps across the business.
    • • Engineered a comprehensive dbt transformation layer — staging, core, and mart models with SCD snapshots and incremental models — handling complex multi-source data history across the classifieds platform.
    • • Unified previously siloed cross-team data access through Unity Catalog RBAC, Delta Sharing, and dynamic column masking, establishing consistent governance across a previously ungoverned platform.
    Databricks Airflow DBT Pyspark Python
  • Sanofi (Global Pharmaceuticals)
    Senior Data Engineer
    November 2023 - Juni 2024 (7 Monate)
    • • Directed the global migration of supply chain analytics (15+ sources) from AWS Athena/Glue to Snowflake; achieved 30%+ improvement in reporting query performance through clustering keys, materialised views, and warehouse right-sizing — directly reducing compute costs at scale.
    • • Replaced brittle legacy Glue jobs with chained Snowflake Scripting task flows and Snowpark Python procedures, substantially lowering pipeline latency and stabilising supply chain data delivery.
    • • Built a quality gate framework via dbt test severity levels and Airflow alerting, catching data anomalies before they reached business dashboards and ensuring reliable OTIF reporting.
    Snowflake Python (Programming Language) Microsoft Azure DBT SQL

Empfehlungen

Sei die erste Person, die Darshan empfiehlt

Teile Deine Erfahrung aus der Zusammenarbeit mit diesem Freelancer.

Diese Freelancer passen auch zu Ihren Kriterien

AgathaA

Agatha Frydrych

Backend Java Software Engineer

4.7

(3)

2

BaptisteB

Baptiste Duhen

Fullstack developer

4.6

(4)

5

AmedA

Amed Hamou

Senior Lead Developer

4

(2)

7

AudreyA

Audrey Champion

Web developer

4.3

(3)

4

Ausbildung und Abschlüsse

  • MSc
    University of London2014
    MSc
  • BSc
    BSc

Fähigkeiten

Kategorien