Google Cloud Data Engineer at ARTECH 2000 Limited

Job Summary

• We are seeking a Google Cloud Data Engineer to design, develop, and maintain scalable data platforms on Google Cloud Platform (GCP). You will build data pipelines, data warehouses, and analytics solutions while ensuring data quality, security, and performance.

Key Responsibilities

• Design and implement batch and streaming data pipelines.
• Develop ETL/ELT processes using Google Cloud services.
• Build and optimize BigQuery data warehouses.
• Ingest data from APIs, databases, and third-party systems.
• Develop scalable solutions using Python and SQL.
• Implement data governance and security policies.
• Monitor and troubleshoot data pipelines.
• Collaborate with data scientists, analysts, and software engineers.
• Optimize cloud costs and data processing performance.
• Automate deployments using Infrastructure as Code.

Required Technical SkillsGoogle Cloud

• BigQuery
• Cloud Storage
• Cloud SQL
• Pub/Sub
• Dataflow (Apache Beam)
• Dataproc (Apache Spark)
• Cloud Composer (Apache Airflow)
• Cloud Functions
• Cloud Run
• Vertex AI (desirable)
• IAM
• VPC Networking

Programming

• Python
• SQL (advanced)
• Bash (preferred)
• Java or Scala (optional)

Data Technologies

• Apache Spark
• Apache Beam
• Apache Kafka (nice to have)
• Airflow
• dbt (desirable)

Databases

• PostgreSQL
• MySQL
• SQL Server
• MongoDB
• Bigtable

DevOps

• Git
• Docker
• Kubernetes (GKE)
• Terraform
• CI/CD (GitHub Actions, Cloud Build)

Soft Skills

• Strong analytical thinking
• Excellent problem-solving skills
• Good communication for distributed teams
• Experience working in Agile/Scrum environments
• Ability to work independently in a remote setting