Senior Data Engineer

We are seeking one Senior Data Engineer to join our team. The client is developing a standard banking application that encompasses onboarding, transaction accounts, and ETFs. This application requires an Analytics reporting dashboard.The Senior Data Engineer will be responsible for developing and maintaining the server-side components of data-centric applications.

They will collaborate closely with data scientists, data analysts, and other members of the development team to design, build, and optimize data processing systems and pipelines. Serving as the primary Data Engineer, they will engage directly with the client to create the data dashboards. Moreover, the client's team currently lacks any other data engineers.

However, they do have two solution architects, back-end and front-end tech leads, and a sizable development team of over 40 people. Guidance and support in data engineering are provided by the Data chapter leadership in Amsterdam.

• Tech Skills Required:

Google Analytics

• BigQuery

AWS Glue,

• QuickSight,

Athena

• S3

Kafka Strea

• Python

• Deliverables:

Data Pipeline Development: Designing and implementing efficient and scalable data pipelines that extract, transform, and load (ETL) data from various sources into target systems, such as data warehouses or analytics platforms.

• Database Design and Management: Collaborating with data architects and database administrators to design and optimize databases for performance, scalability, and reliability. This includes data modeling, indexing, and query optimization.

Backend Development: Writing clean, maintainable, and efficient code in languages like Python, Java, Scala, etc. to implement backend functionalities required for data processing and storage. This could involve developing RESTful APIs, microservices, or serverless functions.

• Data Transformation and Integration: Applying data transformation techniques to ensure data quality, consistency, and compatibility across different systems. This may involve data cleaning, normalization, aggregation, and integration with external data sources.

Performance Optimization: Identifying performance bottlenecks in data processing workflows and optimizing algorithms, queries, and infrastructure components to improve overall system performance and throughput.

• Data Security and Compliance: Implementing data security measures, such as access controls, encryption, and data anonymization, to ensure compliance with privacy regulations and protect sensitive data.

Collaboration and Communication: Collaborating with cross-functional teams, including data scientists, front-end engineers, and product managers, to understand requirements, provide technical insights, and ensure seamless integration between front-end and back-end systems.

• Testing and Deployment: Writing unit tests and participating in code reviews to maintain code quality and reliability. Contributing to the deployment process, including version control, continuous integration, and deployment automation.

Monitoring and Maintenance: Monitoring data pipelines, identifying issues or anomalies, and performing troubleshooting and maintenance tasks to ensure data integrity and system availability.

• Seeking a dynamic candidate with exceptional communication and listening skills, capable of engaging effectively with senior managers and executives to facilitate insightful discussions on the intricacies of data analytics.

Job Type: Fixed term
Contract length: 6 months

Pay: Php110,

• 00 per month
  
  Benefits:
• Work from home

Schedule:

• 8 hour shift

Supplemental Pay:
Performance bonus