Data Engineer at Baaraku

Job Description:

• As a Data Engineer, you will play a critical role in transforming our data infrastructure. You will be responsible for designing, developing, and maintaining scalable data pipelines that facilitate the migration of our legacy mainframe applications to a modern cloud environment. Your expertise in Python, DBT, and SQL will be essential in ensuring the smooth transition and integration of our data systems.

Key Responsibilities:

• Data Pipeline Development: Design, build, and maintain scalable data pipelines using Python to support data migration and integration from mainframe systems to the cloud.
• Cloud Migration: Collaborate with cross-functional teams to plan and execute the migration of mainframe applications to cloud-based solutions.
• Data Transformation: Utilize DBT (Data Build Tool) to transform and model data, ensuring data quality and consistency throughout the migration process.
• Database Management: Develop and optimize SQL queries for data extraction, transformation, and loading (ETL) processes.
• Data Quality: Implement data validation and testing procedures to ensure data accuracy and integrity during and after migration.
• Collaboration: Work closely with data analysts, data scientists, and other engineering teams to understand data requirements and deliver solutions that meet business needs.
• Documentation: Maintain comprehensive documentation of data pipelines, ETL processes, and data models.

Qualifications:

• Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Experience: Proven experience as a Data Engineer, with a strong background in data pipeline development and cloud migration.
• Technical Skills:
• Proficiency in Python for data engineering tasks.
• Experience with DBT for data transformation and modeling.
• Strong SQL skills for database management and ETL processes.
• Cloud Platforms: Experience with cloud platforms such as AWS, Google Cloud, or Azure.
• Problem-Solving: Strong analytical and problem-solving skills with a keen attention to detail.
• Communication: Excellent communication skills with the ability to collaborate effectively with cross-functional teams.
• Adaptability: Ability to work in a fast-paced, dynamic environment and adapt to changing business needs.

Preferred Qualifications:

• Experience with mainframe systems and legacy application migration.
• Knowledge of data warehousing concepts and technologies.
• Familiarity with CI/CD pipelines and version control systems (e.g., Git).