Data Engineer Intern
EPAM Systems
Software engineering and IT services company.
Dec 2025 — May 2026Built Spark and Databricks data pipelines on Azure, including Kafka streaming, ML workflows, and web scraping.
• Implemented a medallion architecture (bronze, silver, gold layers) in Databricks using Apache Spark for scalable data transformation and quality control. • Configured Azure services, integrating relational databases and real-time data stream flows into the pipeline infrastructure. • Built end-to-end machine learning pipelines in Databricks using MLlib, applying models to real-world datasets. • Developed a real-time data ingestion pipeline using Apache Kafka and visualized streaming metrics with Grafana.
