Jobless Developer
Brillio logo
Brillio

Posted 21 days ago

Open

Lead Data Engineer - R01565384

BangaloreHybrid

AI Summary

Lead Data Engineer works on building batch and real-time data pipelines, data models, and ETL workflows using AWS, Spark, SQL, Python, and related tech.

About this role

Lead Data Engineer

Primary Skills

  • Athena, Step Functions, Spark - Pyspark, ETL Fundamentals, SQL (Basic + Advanced), Glue, Python, Lambda, Data Warehousing, EBS /EFS, AWS EC2, Lake Formation, Aurora, S3, Modern Data Platform Fundamentals, PLSQL, Data Modelling Fundamentals, Cloud front
  • Specialization

  • AWS Data EngineerIng Basic: Senior Data Engineer
  • Job requirements

  • Strong experience in data engineering, ETL (preferably Informatica), and data architecture ● Experience working with Salesforce platforms and data models ● Hands-on experience with Airflow and MuleSoft ● Strong SQL skills with Snowflake and other relational databases ● Experience writing complex Python modules for custom ETL workflows ● Expertise in building batch and real-time data pipelines ● Experience with dbt for data transformation and modeling ● Familiarity with AWS/GCP and distributed/event-driven architectures ● Strong understanding of data modeling, data warehousing, and big data processing ● Experience with data quality, monitoring, and pipeline orchestration frameworks ● Ability to work closely with Product, Data Science, and Analytics teams ● Experience working on Salesforce Flows and Apex is a plus ● Good understanding of Agile delivery process
  • Skills

    AgileAirflowApexAthenaAuroraAWS (EC2Data Modelling FundamentalsData WarehousingDbtEBSEFSETLGlueLake FormationLambdaModern Data Platform FundamentalsMulesoftPL/SQLPySparkPythonS3SalesforceSalesforce FlowsSnowflakeSparkSQLStep Functions

    Explore related jobs

    Browse these categories