Jobless Developer
Brillio logo
Brillio

Posted 2 months ago

Open

MCD AWS Data Engineer - R01562275

HyderabadRemoteFull-time

AI Summary

Designs and builds scalable AWS-based data pipelines, ETL processes, and real-time data workflows using services like Kinesis, Redshift, Athena, SNS, and SQS. Works with analysts to deliver data insights while ensuring security and compliance.

About this role

Data Engineer

Primary Skills

  • Athena, SNS, SQS, CloudWatch, Kinesis, Redshift
  • Job requirements

  • Experience Range: 1 - 3 years of experience, with hands-on expertise in AWS data engineering tools and services Key Responsibilities: 1. Design and implement scalable data pipelines using AWS services such as Kinesis, Redshift, and Athena 2. Develop and optimize ETL processes to ensure efficient data ingestion, transformation, and loading 3. Configure and manage AWS messaging services including SNS and SQS to facilitate real-time data processing 4. Monitor and troubleshoot data workflows using AWS CloudWatch to maintain high system reliability 5. Collaborate with data analysts and stakeholders to define data requirements and deliver actionable insights 6. Ensure data security and compliance in all AWS-based solutions, adhering to best practices and organizational standards 7. Automate data processing tasks to improve operational efficiency and reduce manual intervention 8. Maintain documentation for data architectures, pipelines, and operational procedures Required Skills: 1. Advanced proficiency in AWS Athena 2. Hands-on experience with Amazon SNS 3. Expertise in Amazon SQS 4. Strong skills in AWS CloudWatch monitoring and alerting 5. Proven experience with AWS Kinesis for real-time data streaming 6. Deep knowledge of Amazon Redshift for data warehousing 7. Proficiency in designing and managing ETL pipelines on AWS 8. Ability to implement data security and compliance in AWS environments 9. Experience with AWS IAM for access control 10. Familiarity with AWS Lambda for serverless data processing Preferred Skills: 1. Experience with AWS Glue for data cataloging and ETL 2. Knowledge of AWS Data Lake architecture 3. Familiarity with Python or Scala for data engineering tasks 4. Understanding of Apache Spark on AWS 5. Experience with infrastructure-as-code tools such as AWS CloudFormation 6. Exposure to DevOps practices in cloud data engineering Desired Qualifications: 1. Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field 2. AWS Certified Data Analytics – Specialty or other relevant AWS certifications (preferred)
  • Skills

    Amazon RedshiftAmazon SNSAmazon SQSAWS AthenaAWS CloudWatchAWS KinesisData IngestionData LoadingData Security And ComplianceData TransformationETL PipelinesIAMLambda

    Explore related jobs

    Browse these categories