Jobless Developer
Mactores logo
Mactores

Posted 38 months ago

Open

AWS Data Engineer (Senior) (Freelancer)

MumbaiOn-siteFull-time

AI Summary

Senior AWS Data Engineer who designs and maintains data pipelines using EMR/Glue, builds data models for Redshift/Snowflake, and orchestrates workflows with Airflow.

About this role

Mactores is a trusted leader among businesses in providing modern data platform solutions. Since 2008, Mactores have been enabling businesses to accelerate their value through automation by providing End-to-End Data Solutions that are automated, agile, and secure. We collaborate with customers to strategize, navigate, and accelerate an ideal path forward with a digital transformation via assessments, migration, or modernization.

Mactores is seeking an AWS Data Engineer (Senior) to join our team. The ideal candidate will have extensive experience in PySpark and SQL, and have worked with data pipelines using Amazon EMR or Amazon Glue. The candidate must also have experience in data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, Presto, and orchestration experience using Airflow.

What you will do?

  • Develop and maintain data pipelines using Amazon EMR or Amazon Glue.
  • Create data models and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto.
  • Build and maintain the orchestration of data pipelines using Airflow.
  • Collaborate with other teams to understand their data needs and help design solutions.
  • Troubleshoot and optimize data pipelines and data models.
  • Write and maintain PySpark and SQL scripts to extract, transform, and load data.
  • Document and communicate technical solutions to both technical and non-technical audiences.
  • Stay up-to-date with new AWS data technologies and evaluate their impact on our existing systems.

    • What are we looking for?

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience working with PySpark and SQL.
  • 2+ years of experience building and maintaining data pipelines using Amazon EMR or Amazon Glue.
  • 2+ years of experience with data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto.
  • 1+ years of experience building and maintaining the orchestration of data pipelines using Airflow.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and collaboration skills.
  • Ability to work independently and within a team environment.

    • You are preferred if you have

  • AWS Data Analytics Specialty Certification
  • Experience with Agile development methodology

    • Skills

    AirflowAmazon AthenaAmazon EMRAmazon GlueAmazon RedshiftData ModelingData PipelinesETLPrestoPySparkPythonSnowflakeSQL

    Explore related jobs

    More jobs at Mactores

    Similar Airflow jobs

    Jobs in Mumbai

    Browse these categories

    Airflow JobsData Modeling JobsData Pipelines JobsETL JobsPython Jobs