Primary Function
ETL developers are responsible for designing and creating the data warehouse and/or data lake and all related extraction, transformation, and loading of data functions in the project. After laying the groundwork, ETL developers must test the implemented solution to ensure the system runs smoothly. The ETL developer reports directly to his Senior ETL Lead.
Key Responsibilities:
- The ETL Developer is an integral part of the Development Team, works closely with the Project Manager, Solution Architect, Data/Business Analysts, and Data Modelers to rapidly integrate simple to complex data sources the DWBI (Data Warehouse/Business Intelligence) and/or Data Lake environments.
- Reports to the Senior ETL Developer and helps/aids in tasks related to ingestion and transformation of data
- Shepherding solutions through the testing phase, taking responsibility for resolving defects.
- Creating technical documentation required as part of the standard software development lifecycle.
- Ensuring their code is robust, performant, and supportable in an enterprise production environment.
- Providing appropriate logging, proactive data quality checks, and error handling.
Qualifications:
- At least two (2) or more years of ETL development and implementation experience. (Data Warehouse environments, a plus)
- At least two (2) years experience in SQL, Python, Spark (Databricks experience, a plus)
- Strong troubleshooting, resolution, technical, and critical thinking skills.
- Ability to pick-up new concepts and skills quickly.
- Determination to overcome obstacles.
- Strong communication skills, both written and verbal.
- Willingness to take initiative and balance multiple priorities. Should self-start and complete projects without close supervision.
- Experience working in Agile methodology.
- Willing to work on a hybrid set-up in Taguig (2x a week onsite)