Data Engineer at Uniccon Group

Roles & Responsibilities

• Acquire datasets that align with company needs
• To be able to design, build and operationalize data solutions.
• Build, test, and maintain database pipeline architectures
• Process data streams in real-time.
• Efficiently store and access data in the On-premises and cloud servers
• Able to use either GCP, AWS or Azure pre-trained AI APIs (vision, speech, and text)
• Able to train and operationalize ML models.
• Develop algorithms to transform data into useful, actionable information
• Create new data validation methods and data analysis tools
• Ensure compliance with data governance and security policies
• Collaborate with data scientists, data architects and ML engineers on several projects
• Collaborate with management to understand and execute company objectives

Skills

• Previous experience as a data engineer or in a similar role.
• Technical expertise with database technologies, ETL (extract, transform, load) processes, data models, data mining, data warehousing, data lake, big data, data integration, data web-scrape and segmentation techniques.
• Knowledge of programming languages (e.g., Java, Python and Scala)
• Data Pipelines: Understands how to build data pipelines using tools like Apache Spark, Apache Kafka, Hadoop and Apache Airflow.
• Hands-on experience with SQL database design and know about NoSQL databases such as Cassandra, MongoDB, and HBase.
• Be familiar with TensorFlow and PyTorch.
• Great numerical and analytical skills
• Data engineering certification (e.g., IBM Certified Data Engineer) is a plus
• Soft Skills: Good communication skills, problem-solving skills, and a willingness to learn are essential to succeed as a data engineer.