Jobless Developer
Brillio logo
Brillio

Posted 29 days ago

Open

Lead Data Engineer - R01565383

BangaloreRemoteFull-time

AI Summary

Lead Data Engineer responsible for designing and maintaining scalable data pipelines, data models, and ETL processes across cloud platforms, with a focus on AWS technologies and data warehousing.

About this role

Lead Data Engineer

Primary Skills

  • Athena, Step Functions, Spark - Pyspark, ETL Fundamentals, SQL (Basic + Advanced), Glue, Python, Lambda, Data Warehousing, EBS /EFS, AWS EC2, Lake Formation, Aurora, S3, Modern Data Platform Fundamentals, PLSQL, Data Modelling Fundamentals, Cloud front
  • Specialization

  • AWS Data EngineerIng Basic: Senior Data Engineer
  • Job requirements

  • Strong experience in data engineering, ETL (preferably Informatica), and data architecture ● Experience working with Salesforce platforms and data models ● Hands-on experience with Airflow and MuleSoft ● Strong SQL skills with Snowflake and other relational databases ● Experience writing complex Python modules for custom ETL workflows ● Expertise in building batch and real-time data pipelines ● Experience with dbt for data transformation and modeling ● Familiarity with AWS/GCP and distributed/event-driven architectures ● Strong understanding of data modeling, data warehousing, and big data processing ● Experience with data quality, monitoring, and pipeline orchestration frameworks ● Ability to work closely with Product, Data Science, and Analytics teams ● Experience working on Salesforce Flows and Apex is a plus ● Good understanding of Agile delivery process
  • Skills

    AgileAirflowApexAthenaAuroraAWS (EC2Data Modelling FundamentalsData QualityData WarehousingDbtEBSEFSETLGlueLake FormationLambdaModern Data Platform FundamentalsMonitoringMulesoftPipeline OrchestrationPL/SQLPySparkPythonS3SalesforceSalesforce FlowsSnowflakeSparkSQLStep Functions

    Explore related jobs

    Browse these categories