Data Engineer at Analytics Intelligence [AI]

Job Description:

• We are seeking a skilled and motivated Data Engineer with a strong background in Python and data science.
• The ideal candidate will be responsible for developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and data processing systems to collect, integrate, and analyze large volumes of data.
• Collaborate with data scientists to understand and implement their requirements and algorithms.
• Develop and maintain ETL processes for data integration, transformation, and cleaning.
• Build and manage complex data models and structures for analytics and reporting purposes.
• Optimize and fine-tune data systems and architectures for performance and efficiency.
• Work closely with cross-functional teams to ensure data solutions align with business objectives and requirements.
• Conduct research and evaluation of new technologies and tools to improve data processing and analysis.

Requirements:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Proven professional experience as a Data Engineer or in a similar role.
• Proficiency in Python and its libraries for data manipulation, analysis, and visualization (e.g., Pandas, NumPy, Matplotlib, etc.).
• Strong experience in data modelling, database design, and implementation (SQL and NoSQL databases).
• Solid understanding of data processing frameworks and distributed computing (e.g., Hadoop, Spark, etc.).
• Familiarity with machine learning concepts and frameworks is a plus.
• Excellent problem-solving skills and the ability to work independently and collaboratively within a team.
• Strong communication skills to articulate complex technical concepts to both technical and non-technical stakeholders.