Data Engineer at Uniccon Group

Overview 

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure, ensuring its scalability, reliability, and performance on-premises. You'll collaborate closely with cross-functional teams to understand data requirements, implement robust pipelines, and contribute to the optimization of our data architecture. 

Roles & Responsibilities 

• Design, build, and maintain scalable and efficient data pipelines and architectures for both batch and real-time processing. 
• Collaborate with data scientists, analysts, and stakeholders to understand data needs and translate them into technical requirements. 
• Develop and implement data models, schemas, and database designs to support business objectives. 
• Ensure data quality, integrity, and security throughout the entire data lifecycle. 
• Optimize and tune existing data infrastructure for performance and reliability. 
• Evaluate and implement new tools and technologies to enhance data processing and analysis capabilities. 
• Troubleshoot and resolve data-related issues in a timely manner. 
• Document processes, procedures, and solutions for future reference and knowledge sharing. 
• Ensure compliance with data governance and security policies 
• Collaborate with data scientists, data architects and ML engineers on several projects 
• Collaborate with management to understand and execute company objectives 

Skills 

• Previous experience as a data engineer or in a similar role. 
• Technical expertise with database technologies, ETL (extract, transform, load) processes, data models, data mining, data warehousing, data lake, big data, data integration, data web-scrape and segmentation techniques. 
• Knowledge of programming languages (e.g., Java, Python and Scala) 
• Data Pipelines: Understands how to build data pipelines using tools like Apache Spark, Apache Kafka, Hadoop and Apache Airflow. 
• Hands-on experience with SQL database design and know about NoSQL databases such as Cassandra, MongoDB, and HBase. 
• Great numerical and analytical skills 
• Data engineering certification (e.g., IBM Certified Data Engineer) is a plus 
• Soft Skills: Good communication skills, problem-solving skills, and a willingness to learn are essential to succeed as a data engineer.