Description:
- Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
As a GCP Data Engineer, responsibilities include developing scripts (either in Python or shell script) to carry out workloads as described in the defined DAGs in Argo Workflow.- A lot of the processing that we create is related to loading data via dbt, cleaning and manipulating files with either Python or shell script, and designing technical architectures for new data flows.
The GCP Data Engineer must be confident enough to articulate their ideas in team-wide forums and understand how to frame a problem from an optimization and efficiency perspective.
3-4 years of experience as a Data Engineer
- Good understanding of the following services on GCP: BigQuery, Data Catalog , Cloud Storage
Knowledge in Data Modeling Techniques and Methodologies- Proficient in Python and Shell scripting
Understanding data models
- Experience in DBT (data build tool), MySQL
A nice to have is knowledge on Argo Workflow.Amenable to work ONSITE in Mandaluyong
Job Type: Full-time
Schedule:
Application Question(s):- Are you open for a Project based/contract employment
How much is your current salary
- How much is your asking salary
Are you amenable to work ONSITE in Mandaluyong
Experience:- Data Engineer: 3 years (Preferred)
BigQuery, Data Catalog , Cloud Storage: 2 years (Preferred)
- Data Modeling Techniques and Methodologies: 2 years (Preferred)
Python and Shell scripting: 3 years (Preferred)- DBT (data build tool): 2 years (Preferred)
Argo Workflow: 1 year (Preferred)
- MySQL: 3 years (Preferred)
AWS: 3 years (Preferred)
GCP: 3 years (Preferred)
