Jobless Developer
Dun & Bradstreet logo
Dun & Bradstreet

Posted 1 month ago

Open

Senior Big Data Engineer (R-19335)

HyderabadOn-siteFull-time

AI Summary

A Senior Software Engineer – Big Data designs, builds, and optimizes scalable data platforms and pipelines, developing ETL/ELT processes and data solutions on cloud and on-prem environments.

About this role

Shape the Future with Dun & Bradstreet
At Dun & Bradstreet, we believe data has the power to create a better tomorrow. As a global leader in business decisioning data and analytics, we help companies worldwide grow, manage risk, and innovate. For over 180 years, businesses have trusted us to turn uncertainty into opportunity. We’re a diverse, global team that values creativity, collaboration, and bold ideas. Are you ready to make an impact and help shape what’s next? Join us! Explore opportunities at dnb.com/careers.

Designation: Senior Software Engineer – Big Data

Location: Hyderabad

About Us:

We are a global organization driven by a diverse community of professionals who bring unique experiences and perspectives to everything we do. Whether working from a corporate office or remotely, we stay connected by listening to our customers and collaborating on impactful solutions.

Our products and services power businesses of all sizes, across industries. At the core of our operations are our values: being data-inspired, relentlessly curious, and inherently generous. These values guide our decisions, shape our culture, and define how we work together.

Role Overview:
We are looking for a Senior Software Engineer – Big Data to design, build, and optimize modern data platforms and pipelines. This role requires strong expertise in big data technologies, cloud environments, and data engineering best practices, with a focus on scalability, performance, and innovation.

Key Responsibilities :

  • Design, build, deploy, and document scalable data pipelines within big data ecosystems
  • Develop ETL/ELT pipelines using modern data processing frameworks and tools
  • Work with data lake architectures and modern data warehousing concepts such as virtual data warehouses and push-down analytics
  • Build and optimize data solutions using file formats such as Parquet, Iceberg, and Delta
  • Develop high-performance solutions using Python, Databricks, and Apache Spark
  • Work with cloud infrastructure, primarily on GCP Design and manage relational databases including DB2, Oracle, and SQL Server with strong SQL expertise
  • Implement workflow scheduling and orchestration using Apache AirflowManage big data clusters including installation, configuration, monitoring, security, resource allocation, and performance tuning
  • Create detailed design documents and proof of concepts for new capabilities
  • Collaborate with platform and infrastructure teams to deploy solutions into production
  • Optimize workloads, manage multi-tenant environments, and ensure SLA adherence
  • Participate in planning, data science initiatives, and continuous platform improvement

Key Requirements:

  • Minimum 8 years of experience in ETL/ELT technologies
  • 4+ years of hands-on experience with big data technologies such as Databricks and Apache Spark
  • Minimum 6 years of experience working with cloud platforms, preferably GCP
  • Strong programming expertise in Python
  • Experience with relational databases and complex SQL development
  • Exposure to NoSQL and graph databases is a plus
  • Experience with access control mechanisms such as role-based and attribute-based access
  • Familiarity with BI tools such as Tableau, Power BI, or Looker
  • Hands-on experience managing and deploying cloud-based solutions
  • Experience working in a global environment and DevOps model is an advantage

    • Skills

    Apache AirflowApache SparkBI ToolsDatabricksDB2DeltaGCPGraph DatabasesIcebergNoSQLOracleParquetPythonSQLSQL Server

    Explore related jobs

    More jobs at Dun & Bradstreet

    Similar Apache Airflow jobs

    Jobs in Hyderabad

    Browse these categories

    Databricks JobsGCP JobsNoSQL JobsOracle JobsPython Jobs