Jobless Developer
Two95 International Inc. logo
Two95 International Inc.

Posted 3 months ago

Open

Digital : Google Data Engineering

Kuala LumpurRemoteContract

AI Summary

Data engineer specializing in Google Cloud, building scalable data ingestion, modeling, and warehousing solutions using GCP tools such as BigQuery, Dataflow, Pub/Sub, and Composer. Guides teams to implement data products and maintain code quality.

About this role

We are looking for Google Data Engineering with 6 – 8 years of experience.

Required Technical Skill Set: GCP, PySpark, GCP (BigQuery, Dataflow, Dataproc, GCS, Pub/Sub, Composer), developing scalable solutions.

Key Responsibilities:

  • Build and Manage data ingestion (batch/Streaming) using Pub/Sub, Cloud Functions, Data Fusion.
  • Design and optimise BigQuery data Models, partitions, clustering, and big query performance.
  • Data engineer with strong coding and technical architectural experience in Google Data Solution
  • Should be able to guide a new team to build algorithms and data products, resolve blockers and bugs and be the code custodian.
  • Work across the full data pipeline on projects (ingestion, data modelling, data warehousing, Data Quality validity).
  • Knowledge on CI/CD Pipelines

Good-to-Have

  • Excellent communication and collaboration skills.

  • Commitment to continuous learning and improvement.

Responsibilities:

  • Hands-on Scheduling the Data Pipelines with dependency flow using any Cloud Services – Airflow/Composer, Schedulers etc.
  • Troubleshoot and resolve technical issues promptly.
  • Communicate effectively with both technical and non-technical stakeholders.
  • Architect cloud-based database solutions tailored to business needs, ensuring scalability, reliability, and performance.
  • Continuously learn and adopt new Google Cloud features and best practices to improve database systems.
  • Deploy and maintain databases on Google Cloud services like Cloud SQL, Cloud Spanner, and Bigtable.
  • Apply encryption, access controls, and other security measures to protect sensitive data and comply with regulations.
  • Migrate data from on-premises or other cloud platforms to Google Cloud with minimal downtime and data integrity.

Skills

Access ControlsAirflowBatch ProcessingBigQueryBigQuery PerformanceBigtableCI/CD PipelinesCloud ArchitectureCloud SpannerCloud SQLComposerDataflowData IngestionData MigrationData ModelingDataprocData WarehousingEncryptionGCPGCSPub/SubSecurity ControlsStreaming

Explore related jobs

Browse these categories