You're seeing this page as if you were . The main menu is still yours, though. Exit from immersion
Malt welcome

Willkommen auf dem Freelancer-Profil von Hichem !

Malt bringt Sie mit den besten Freelancern für Ihre Projekte zusammen. Sie können Hichem kostenlos kontaktieren und sich im Chat austauschen, oder andere Freelancer anschreiben und unverbindliche Angebote einholen.

Hichem C. Data Engineer | Python | SQL | Azure CloudHC

Hichem C.

Data Engineer | Python | SQL | Azure Cloud
  • Unverbindlicher Tarif
    720 € /Tag
  • Berufserfahrung3-7 Jahre
  • Antwortzeit1h
Das Projekt startet erst, wenn Sie das Angebot von Hichem annehmen
Standort und Mobilität
Standort
Berlin, Deutschland
Nur remote
Führt Projekte hauptsächlich remote aus
Checkliste

Malt Freelancer Charta unterzeichnet

Die Charta lesen
Geprüfte E-Mail-Adresse
Sprachen
Kategorien
Diese Profile passen auch zu Ihrer Suchanfrage
Agatha FrydrychAF

Agatha Frydrych

Backend Java Software Engineer

Baptiste DuhenBD

Baptiste Duhen

Fullstack developer

Amed HamouAH

Amed Hamou

Senior Lead Developer

Audrey ChampionAC

Audrey Champion

Web developer

Fähigkeiten
Branchenkenntnisse
Hichem in wenigen Worten
I am a Data Engineer with 4 years professional experience in building and maintaining data applications in the cloud (mainly Azure) and on premises. Fluent in german, english and french.

Ich bin Data Engineer mit über 4 Jahren professioneller Projekterfahrung in der Entwicklung und Wartung von Daten Anwendungen in der Cloud (hauptsächlich Azure) und On Premises. Fließend in Deutsch, Englisch und Französisch.
Projekt- und Berufserfahrung
  • Qurix Technology GmbH
    Data Engineer
    DIGITALAGENTUREN & IT-CONSULTING
    Mai 2023 - Heute (2 Jahre und 1 Monat)
    Hamburg, Deutschland
    September 2023 - now, Data Catalog, Food Industry (Remote)
    • Developed an engine in Python that reads data sources and derives key information such as row count, 10 most frequent values per column, column types and pandas statistical calculations.
    • Developed a Streamlit UI application that provides a consolidated overview of the metadata.
    • Integrated Confluent Kafka as a messaging broker between the engine and the Streamlit UI App.
    • Automated the manual process (originally in Excel) of maintaining and querying metadata across multiple systems including Postgres, DB2, Kafka topics, and Excel tables.
    • Accelerated migration activities through the provided consolidated metadata and key information about table contents and data types across all data sources.
    • Containerized both applications for kubernetes deployment in the customer environment.

    May 2023 - August 2023, Hubspot Integration, Machinery Industry (Remote)

    • Implemented the integration of Hubspot CRM with Alphaplan, a machinery company's ERP system, to enhance CRM data collection and ingestion processes.
    • Integrated Apache Kafka as a messaging broker between Hubspot and target system.
    • Developed a Python Kafka producer application in Azure Cloud (Azure Functions) that performs API calls and sends entries to Kafka.
    • Developed a Python Kafka Consumer application on-premises that listens to the Kafka topic and writes entries to the target system’s database.
    • Streamlined CRM data acquisition enabling automatic data transfer to the on-premises ERP system.
    • Significantly improved user experience and operational efficiency by eliminating the need for sales team users to maintain CRM data through direct access to the on-premises ERP system.
    Apache Kafka Python Microsoft Azure PostgreSQL IBM Db2 CI/CD Docker
  • Capgemini Deutschland GmbH
    Data Engineer
    DIGITALAGENTUREN & IT-CONSULTING
    April 2021 - April 2023 (2 Jahre und 1 Monat)
    Düsseldorf, Deutschland
    March 2023 - April 2023, event-driven ETL in AWS Cloud, Financial Sector (Remote)
    • Developed an event-driven ETL pipeline in AWS Cloud using AWS services (Glue, Step Functions, Lambda and SQS) to catch S3 events and trigger processing and validation of XML files.

    March 2022 - March 2023, Support project in Azure Cloud, Consumer Goods Industry (Remote)
    • Application development in Pyspark to process Terabytes of data.
    • Set up monitoring and alerting functionalities for Python and Pyspark applications.
    • Migrated processing logic from Dremio to Databricks which increased performance.
    • Responsible for maintenance of 5 applications in the Azure Cloud.

    July 2021 - February 2022, Migration project in Azure Cloud, Consumer Goods Industry (Remote)
    • Migrated data from data lake gen1 to data lake gen2 using data factory.
    • Implemented changes in Python and Pyspark applications to use data lake gen2 API.
    • Developed and maintained ETL pipelines using Pyspark, Data Factory, and Azure DevOps.
    • Responsible for migration activities for 10 applications in the Azure Cloud.
    Python Microsoft Azure Azure DevOps ETL Spark SQL Linux Amazon Web Services (AWS) AWS Lambda
  • Huf Group
    Test Engineer
    AUTOMOBILSEKTOR
    Mai 2018 - April 2020 (1 Jahr und 12 Monate)
    Velbert, Deutschland
    Derived test cases from customer requirements
    Specified of the test environment in coordination with the stakeholders
    Evaluated test data
    Managed test activities in international development projects
    Data Analysis Requirements Engineering Project Management
Externe Empfehlungen
Ausbildung und Abschlüsse
  • Data Science Bootcamp
    Spiced Academy Köln
    2020
  • M.Sc. Electrical Engineering
    Mittweida University of Applied Sciences
    2016
  • B. Sc. Applied Physics
    National Institute of Applied Sciences and Technology Tunis
    2013
Zertifizierungen