Data Engineer

Role Summary
Design, build, and scale a modern AWS data platform and robust data ingestion pipelines.

Roles & Responsibilities
Pipeline Architecture & Development: Design and build scalable real-time and batch data pipelines using CDC, PySpark, and DBT.

AWS Platform Management: Build and manage cloud infrastructure (AWS S3, RDS), implementing orchestration tools like Airflow for scheduling.

Data Modeling & Warehousing: Develop structured data lake layers (raw/staged/curated) and optimize storage formats and query performance.

Quality & Reliability: Implement robust data validation, monitor pipeline health, and systematically troubleshoot production issues.

Continuous Improvement: Evaluate new technologies through POCs to enhance system performance, scalability, and overall cost efficiency.