Posted 6 days ago
Senior Python Developer
AI Summary
Senior Python Developer responsible for designing and implementing large-scale data processing solutions using Python, PySpark, and related big data technologies on Google Cloud Platform.
About this role
Responsibilities
5+ years of experience utilizing Python, PySpark/Scala for processing large data volumes
Good knowledge of working with Databases (e.g., SQL, Oracle, Hive, Impala)
Relevant experience with Pandas, NumPy, Scikit-learn, and other relevant Python libraries
Google Cloud Platform (DataProc, AirFlow, Google Cloud Storage)
Good knowledge of Unix/Linux environments
Familiarity with Big Data and Hadoop Ecosystem: Spark (Spark SQL, Dataframes, PySpark, HUE, parquet files)
Awareness about DevOps practices like CI/CD
Proficient communication and English language skills (written/verbal)
Skills
PySpark (Python, PySpark or Scala)
Spark DataFrames
ETL concepts
Database and SQL knowledge (Hive/Impala)
