Ilya I.

Designed a platform based on IoT, Kubernetes, and Postgres for an existing application. Data migration from managed Postgres database to self-hosted TimescaleDB with replication. Developing microservice for IoT data processing with Python. Major effort was made (successfully) to move from “click-ops” and ci/cd pipelines defined in the UI to infrastructure-as-a-code, with several environments being completely redeployed.

Technologies: DevOps, IoT, Grafana, helm, kustomize

Implementing framework for centralised maintenance of log data from an IoT network processing based on Kafka cluster in AWS with backup in s3. Starting from setting up development and production environments, to setting up Kafka, HTTP API, UI with Sales Force and implementing use cases in Flink, which generated findings about coming service time and printing units productivity.

Technologies: Kafka, Java Spring, GitLab, Avro, Jenkins

Developing and running ETL jobs based on GCP, Pub/Sub, Spark (Databricks), Cloud SQL, and Airflow. Collaborated closely with cross-functional teams to define data requirements and design reliable ETL pipelines. Ensured data consistency and quality across distributed systems, developed methodology for data quality testing (Great Expectations). Actively worked on adoption of new data technologies and improving pipeline robustness.​

Technologies: Pub/Sub, TestRail, AWS, GCP, Azure, Vault, Airflow, Python, K8s, Grafana, Prometheus