Data Engineer at Data2Bots

SKILLS, QUALIFICATIONS AND REQUIREMENTS

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer with a strong foundation in data warehousing and ETL/ELT processes.
• Proficiency in SQL, Python, and other relevant programming languages.
• Experience with big data technologies (Hadoop, Spark, Hive, etc.).
• Knowledge of cloud platforms (AWS, Azure, GCP) and their data services.
• Strong understanding of data modeling and database design.
• Ability to work with large datasets and perform data analysis.
• Experience with data visualization tools (Tableau, Power BI).
• Knowledge of machine learning and statistical modeling.
• Experience with data governance and compliance regulations.

RESPONSIBILITIES

• Design, develop, and implement scalable data pipelines to extract, transform, and load data from various sources.
• Build and maintain data warehouses and data lakes.
• Develop data models and schemas to support business intelligence and analytics.
• Optimize data processing and query performance.
• Ensure data quality, integrity, and security.
• Collaborate with data scientists and analysts to understand data requirements.
• Stay up-to-date with the latest data engineering technologies and trends.