Cloud Data/ETL Engineer
Night Shift
Hybrid set up either in BGC/QC - 3x onsite, 2x remote in a week
Job Description:
We are seeking a seasoned Cloud Data/ETL Engineer with 5 to 7 years of experience to join our dynamic team. The ideal candidate will have a strong background in building ETL pipelines using various tools, along with expertise in both relational and NoSQL databases, particularly Aurora Postgres. Proficiency in AWS services such as Glue, Data Catalog, Crawler, Athena, and DMS is essential for this role.
Responsibilities:
Design, develop, and maintain robust ETL pipelines using AWS Glue and other relevant tools.
Manage and optimize DMS replication processes to ensure efficient data transfer.
Work closely with cross-functional teams to understand data requirements and implement appropriate solutions.
Utilize object-oriented/object function scripting languages such as Python, Java, or Scala to enhance data processing capabilities.
Collaborate with data engineers and architects to optimize data storage, retrieval, and processing strategies.
Stay updated with the latest advancements in cloud technologies and incorporate best practices into existing processes.
Troubleshoot and resolve issues related to data pipelines and integration processes in a timely manner.
Qualifications:
Bachelor's degree in Computer Science, Engineering, or a related field.
5 to 7 years of experience in building ETL pipelines and managing data workflows.
Strong proficiency in SQL and experience with both relational and NoSQL databases, particularly Aurora Postgres.
Hands-on experience with AWS services such as Glue, Data Catalog, Crawler, Athena, and DMS.
