Data Engineer

About Us:

Pride Global is a minority-owned human capital solutions and advisory firm headquartered in Manhattan, with offices around the world. We offer a comprehensive range of HR services, including managed services, vendor management, payroll programs, staffing, and more. As the parent company of a global corporate family, we deliver cutting-edge technology, operational excellence, and trustworthy partnerships that help our clients stay at the top of their industries.

Job Description

As a Data Engineer, you will be a key member of our data team, focusing on designing, developing, and maintaining data solutions for our data warehouse, data lake, and Dataverse environments. with specific focus on sourcing data and developing data solutions. In this role you will be primarily responsible for the development of data workflows, views, and stored procedures, in addition to performing data analysis, and monitoring and tuning queries and data loads. You will be working closely with data providers, and data analytics teams to facilitate the implementation of Pride Global business requirements and requests.

YOUR KEY RESPONSIBILITIES:

• To develop ETLs, stored procedures, triggers, and views on our DB2-based Data Warehouse
• To perform data profiling and analysis on source system data to ensure that source system data can be integrated and represented properly in our models
• To monitor the performance of queries and data loads and perform tuning as necessary
• To provide assistance and guidance during the QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of verified issues

SKILLS:

• Develop and maintain ETL (Extract, Transform, Load) processes to ingest data from various sources into our data warehouse, data lake, and Dataverse environments
• Design and implement data models, schemas, and structures to support efficient querying and reporting
• Optimize data storage and retrieval processes to ensure high performance and scalability
• Collaborate with data scientists and analysts to understand their data requirements and provide the necessary data infrastructure
• Monitor and troubleshoot data pipelines to ensure data quality and integrity
• Implement data security and compliance measures to protect sensitive data and ensure regulatory compliance
• Document data workflows, processes, and best practices to facilitate knowledge sharing and collaboration

QUALIFICATIONS:

• Bachelor's degree in Computer Science, Information Technology, or a related field
• Proven experience as a Data Engineer, with a focus on data warehouses, data lakes, and Dataverse
• Strong proficiency in SQL and experience with database management systems such Azure SQL Data Warehouse
• Familiarity with data integration tools such as Apache Kafka, AWS Glue, or Azure Data Factory
• Knowledge of data modeling techniques and best practices
• Strong problem-solving skills and attention to detail
• Excellent communication and collaboration skills
• At least 5+ years of experience in data development and solutions in highly complex data environments with large data volumes
• At least 5+ years of experience developing complex ETLs with Informatica PowerCenter
• At least 5+ years of SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis
• At least 5+ years of experience developing complex stored procedures, triggers, MQTs and views on IBM DB2 (experience with v10.5 a plus)
• Experience with performance tuning DB2 tables, queries, and stored procedures
• Experience with scripting languages like Perl and Python
• An understanding of E-R data models (conceptual, logical and physical)
• Strong understanding of advanced data warehouse concepts (Factless Fact Tables, Temporal BI-Temporal models, etc.)
• Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions
• Experience with both Waterfall and Agile development methodologies
• Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.
• Self starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities.
• Strong problem solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements and priorities.

Preferred Qualifications:

• Experience with Azure cloud platform.
• Knowledge of data governance and data quality management practices
• Familiarity with BI tools such as Power BI, Tableau, or Looker