Data Engineer (Perm WFH - Dayshift)

Responsibilities:

• Build the infrastructure and pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
• Assemble large, complex data sets to meet functional / non-functional business requirements.
• Ability to design solutions based on a high-level architecture and aligned with frameworks such as the AWS and Azure Well Architected Framework and maintain effective technical documentation.
• Manage the technical communication between internal and external stakeholders.
• Monitor and maintain production systems.
• Collaborate with other development and research teams.
• Build highly scalable cloud-based platforms that allow easy development of new applications.

Qualifications:

• Minimum of 4-5 years of data engineering experience.
• Strong proficiency in TSQL and advanced SQL skills (relational databases, query authoring, algorithm design, optimisation, and implementation).
• Experience building and deploying cloud native ETL/ELT pipelines on platforms such as Azure and AWS.
• Proficiency in designing and developing within microservices architecture.
• Knowledge of AWS services such as EMR, S3, RDS, DynamoDB, Kinesis, SNS, and SQS.
• Experience with RESTful API design and OpenAPI specifications.
• Knowledge of common design patterns and when/how to use them.
• Experience in designing to address Non-functional requirements (e.g. security, scalability, observability, cost).
• Automated testing on different levels (unit, component, and integration test automation) using tools like dbt, Junit, TestNG, and Mockito.
• Experience with CI/CD pipelines and version control systems like Git.
• Experience with containerisation (e.g., Docker) and deployment of containerised applications using platforms like Amazon Elastic Kubernetes Service (EKS) and Azure Kubernetes Services (AKS)
• Experience with Python, Java, or Scala.

Working schedule/setup:

• Permanent WFH setup (equipment will be provided)
• Dayshift (4am-1pm PHT)

What we offer you:

• Competitive salary package with exceptional benefits such as 500K HMO coverage + 2 free dependents upon hire
• Continuous career development
• Exposure to latest technologies