Big Data Engineer at Huawei Technologies Co. Ltd.

Level: Mid-Senior career

About the Job

• Purpose of the role: Big Data Engineer will be responsible for creating solutions, they will also be responsible for creating and managing Big data infrastructure and tools, including collecting, storing, processing and analyzing our data and data systems.
• You will also need to know how to work quickly and accurately use the best solutions to analyze mass data sets, and you know how to get results.

Responsibilities

• Gather and process raw data at scale
• Create schedules for data and control flows
• Design and develop data applications and reports using selected tools and frameworks as required and requested.
• Read, extract, transform, stage and load data to selected tools and frameworks as required and requested.
• Perform tasks such as writing scripts, web scraping, calling APIs, write SQL queries, etc.
• Work closely with the other team members for 3rd party integration of data sources
• Process structured and unstructured data into a form suitable for analysis.
• Analyze processed data.
• Support business decisions with ad hoc analysis as needed.
• Monitoring data performance and modifying infrastructure as needed.
• Provide input into documentation and updating of Standard operating procedures and process documents.
• Provide input into definition data retention policies.

Working Experience and Educational Background

• Bachelor's Degree or Diploma in IT, Engineering or any Business related qualification will be advantageous
• 5 to 7 years working experience in data engineering
• Very strong SQL / PLQL skills and ability to manipulate data across heterogeneous data sources is required
• A solid track record of data management showing your flawless execution and attention to detail.
• Strong knowledge of and experience with statistics.
• Programming experience, ideally in Python, Spark, Kafka or Java, and a willingness to learn new programming languages to meet goals and objectives.
• Experience in C, Perl, Javascript or other programming languages is a plus.
• Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks.
• Experience in Hive, Spark or/and MapReduce is a plus.
• Deep knowledge of data mining, machine learning, natural language processing, or information retrieval.
• Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
• Experience with machine learning toolkits including, H2O, SparkML or Mahout
• A willingness to explore new alternatives or options to solve data mining issues, and utilize a combination of industry best practices, data innovations and your experience to get the job done.
• Experience in production support and troubleshooting.

What we Offer

• We offer you a professional career in one of the leading multinational telecommunication companies, challenging work, and a competitive salary package. Training opportunities are available for professional improvement.