Data Engineer

What You'll Get & Enjoy:

Work 5 days a week

Medical coverage

Group Insurance

Career opportunities development

Meet and work with great people across the Group

Work, Play & 'Makan'

Accessibility to public transport (MRT, LRT, Monorail, Buses)



The Role

As a Data Engineer, you will play a crucial role in designing, developing, and maintaining the data infrastructure that powers our organization's data-driven initiatives. You will work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand requirements and ensure the availability, reliability, and efficiency of our data pipelines and systems. The ideal candidate is passionate about data engineering, possesses a deep understanding of cloud solutions, and is skilled in building and optimizing data pipelines.



The Responsibilities:

To design, develop, and maintain robust, scalable, and efficient data pipelines to ingest, transform, and store data from various sources into our data lake/data warehouse.

Collaborate with data scientists and analysts to understand their data requirements and implement data transformations and aggregations to support their analyses and reporting needs.

Perform research on various data sources and evaluate the value and applicability to property development, including residential property and retail mall.

Develop scripts that perform web-scraping to acquire data that are openly available online.

Build and manage CI/CD pipelines to automate the deployment and testing of data pipelines and infrastructure.

Utilize Azure cloud services, AWS cloud services, and other relevant technologies to architect, implement, and manage data solutions.

Work with stakeholders to understand data integration requirements and implement data integration solutions between different systems and platforms.

Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and scalability.

Implement and enforce best practices for data security, compliance, and data quality.

Stay up-to-date with the latest trends and advancements in data engineering, cloud technologies, and data management practices.



The Qualifications:

Candidate must possess at least a Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Proven experience as a Data Engineer or in a similar role, with a strong understanding of data engineering concepts, techniques, and best practices.

Hands-on experience with cloud solutions, particularly in designing, building, and optimizing data pipelines using Azure cloud services (Azure Function, Azure Data Factory, Azure Databricks, etc.) and/or AWS cloud services (AWS Glue, Lambda, Amazon Redshift, etc.).

Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks (e.g., Spark, Hadoop) and ETL / ELT tools.

Strong knowledge of data modelling, data warehousing, and database technologies.

Experience with containerization and orchestration technologies like Docker and Kubernetes is a plus.

Familiarity with version control systems (e.g., Git) and CI/CD pipelines.

Excellent problem-solving skills and the ability to troubleshoot complex data-related issues.

Strong communication and collaboration skills to work effectively with cross-functional teams.

Ability to adapt to a fast-paced and evolving environment while delivering high-quality solutions.