As part of our Data Engineering team, you will create data pipelines and data structures utilizing modern data technology, engineering process, and languages. You will be responsible for helping organizations migrate and modernize data platforms in support of enterprise analytics, intelligent applications, and machine learning initiatives.
We are seeking a highly skilled and experienced Data Engineer to join our team and lead the implementation of data solutions using Azure Data Engineering tools. The ideal candidate will have a strong background in data engineering, database design, and data integration, with a focus on leveraging Azure's data engineering tools and platforms.
As a Manager, you'll work as part of a team of problem solvers, helping to solve complex business issues from strategy to execution. PwC Professional skills and responsibilities for this management level include but are not limited to:
- Design and implement data solutions, including database schema, tables, and relationships, using Azure data engineering tools.
- Leverage DE tools such as Azure Data Factory, Azure Databricks, to develop robust data pipelines for data collection, transformation, and storage.
- Integrate data from various sources into data solutions, ensuring data accuracy and completeness.
- Data Validation and Verification: Implement data validation and verification processes to maintain data quality.
- Ensure data security and compliance with relevant data protection regulations, including encryption, access controls, and audit trails.
- Establish data quality standards and metrics to ensure data accuracy and timeliness.
- Plan and execute data migration from legacy systems to new data solutions.
- Develop and maintain a change control process to handle modifications to data solutions.
- Create comprehensive documentation for data engineering processes and guidelines.
- Collaborate with cross-functional teams, including data analysts, IT architects, and project managers, to ensure the success of data solutions.
Preferred skills
- Strong knowledge of database design, data modeling, and SQL.
- Knowledge of data security and compliance standards, including GDPR and other relevant regulations.
- Proficiency in programming languages such as Python, Java, or Scala.
Minimum years experience required
- Bachelor's or higher degree in Computer Science, Data Engineering, or a related field.
- Proven experience in data engineering, with a focus on Azure data engineering tools and platforms.
- Experience in data integration and ETL processes
Additional application instructions
- Azure Data Engineering and other data engineering certification is a plus.
- Experience leading warehouse implementation is an added advantage.