Posted 3 months ago

Hadoop Data Admin

Schaumburg, IL, United StatesRemoteFull-time

AI Summary

Manages data pipelines and data management across clusters, coordinates reporting with Platform Architects, and collaborates with data scientists to optimize cluster data and ETL workflows.

About this role

Hadoop Data Admin

Ventures Unlimited is a service centric organization. Our success begins with our ability to apply our relationships, leverage technologies, and identify talent - often in combination - to an endless array of real-world customer needs

Title : Hadoop Data Admin
Location : Schaumburg, IL
Type : Full Time Permanent

Job Description

• Responsible for Data pipeline management, cross cluster data flows and data management.
• Responsible for Daily reporting of data management to Platform Architect.
• Interacts with data scientists to enhance and optimize data within the Clusters.
• Strong knowledge in JAVA, Hadoop ecosystem, HIVE and other NOSQL.
• Strong experience in data management for analytics and reporting.
• Expert in handling different formats of data and data structures.
• Recent ecosystem experience with RDBMS(Oracle/Teradata) and data management technologies.
• Experience with large scale DW implementations.
• Clear understanding of data pipelines, data buckets, data management.
• Strong expertise in PIG, Python or Perl scripting.
• Excellent development experience in SQL, NOSQL, Scala, JAVA/Spring on Hadoop.
• Strong design experience with ETL frameworks, data pipeline management with software such as Falcon, JAVA, etc.