Search by job, company or skills
Responsibilities:
1. Lead and manage a team of data engineers to design, develop, and maintain scalable data pipelines and infrastructure.
2. Define and implement best practices for data engineering processes, including data ingestion, transformation, storage, and retrieval.
3. Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
4. Oversee the implementation of data governance policies and standards to ensure data quality, security, and compliance.
5. Manage resources, priorities, and timelines to deliver data engineering projects on time and within budget.
6. Drive innovation and continuous improvement in data engineering technologies, tools, and practices.
7. Provide technical guidance and mentorship to team members, fostering their professional growth and development.
8. Evaluate and recommend new technologies and platforms to enhance the organization's data capabilities.
9. Monitor and optimize performance of data systems to meet SLAs and performance targets.
10. Communicate effectively with stakeholders to provide updates, gather feedback, and address concerns related to data engineering initiatives.
Qualifications:
1. Bachelor's degree in Computer Science, Engineering, or related field. Master's degree preferred.
2. Proven experience (X years) in data engineering or related roles, with at least X years in a leadership or managerial capacity.
3. Strong proficiency in data modeling, ETL/ELT processes, and data warehousing concepts.
4. Hands-on experience with cloud-based data platforms such as AWS, Azure, or GCP.
5. Proficiency in programming languages such as Python, Java, or Scala.
6. Experience with big data technologies such as Hadoop, Spark, or Kafka.
7. Solid understanding of database technologies (SQL, NoSQL) and data integration techniques.
8. Excellent leadership, communication, and interpersonal skills.
9. Ability to manage multiple projects simultaneously and prioritize effectively.
10. Strong problem-solving and analytical abilities, with attention to detail.
Preferred Skills/Attributes:
1. Experience with containerization and orchestration tools such as Docker and Kubernetes.
2. Familiarity with machine learning and data science concepts.
3. Certification in relevant technologies (e.g., AWS Certified Big Data - Specialty).
4. Experience working in Agile or Scrum environments.
5. Knowledge of DevOps practices and CI/CD pipelines.
6. Ability to thrive in a fast-paced, dynamic environment and adapt to changing priorities.
Login to check your skill match score
Date Posted: 29/05/2024
Job ID: 80314457