Data Engineer (DBA) at Alfred & Victoria Associates

JOB DESCRIPTION

The ideal candidate will have at least 3 years of experience in data engineering and will be responsible for building and maintaining our data infrastructure and pipelines. You will work closely with our data analysts in the team to ensure our data is accurate, reliable, and accessible.

 KEY DUTIES & RESPONSIBILITIES:  

• Design and develop data pipelines and infrastructure that enable efficient and reliable processing, storage, and retrieval of data.
• Develop and maintain data integration and ETL workflows to bring together data from multiple sources.
• Ensure the security and compliance of our data infrastructure and pipelines.
• Collaborate with data scientists and analysts to ensure data quality and accuracy.
• Optimize data structures and algorithms to improve performance and reduce processing time.
• Develop and maintain documentation of data infrastructure and pipelines.
• Continuously monitor and troubleshoot data infrastructure to ensure reliability and availability.
• Keep up-to-date with the latest industry trends and technologies in data engineering.

ESSENTIAL EXPERIENCE, SKILLS AND QUALIFICATIONS

Hard skills

·         Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.

·         At least 3 years of experience in data engineering.

·         Strong experience with data processing frameworks such as Spark, Hadoop, or Flink.

·         Experience with ETL tools such as Azure Data Factory, Airflow, Luigi, or NiFi.

·         Strong proficiency in SQL and experience with database systems such as Microsoft SQL Server, MySQL, PostgreSQL, or MongoDB.

·         Strong experience with programming languages such as C#, Python, Java, or Scala.

·         Experience with multi-cloud computing, and cloud platforms such as AWS, Azure, or GCP.

·         Experience with DevOps CI/CD tools such as Jenkins, Git, GitLab.

·         Strong understanding of data warehousing and data modeling concepts and scripting.

·         Experience with data visualization tools such as Tableau or PowerBI is a plus.

·         Familiarity with NoSQL, ML and AI concepts

 Soft skills

·         Excellent problem-solving and analytical skills.

·         Strong communication and collaboration skills.

·         High degree of initiative, dependability and ability to work with little supervision

·         Inherently demonstrate a high level of integrity and be trustworthy

·         The ability to maintain confidentiality in regard to information processed, stored, or accessed by the systems

·         The ability to develop knowledge of, respect for, and skills to engage with those of other cultures or backgrounds

Send CV to apply@alfred-victoria.com