Müller`s Solutions
Posted 3 months ago
Big Data Engineer
DubaiRemoteFull-time
AI Summary
Responsible for designing and developing scalable big data solutions, building data pipelines, and ensuring data quality and timely delivery using technologies like Spark, Hadoop, and Kafka.
About this role
Müller’s Solutions is looking for an experienced Big Data Engineer to join our innovative team. In this role, you will be responsible for designing and developing scalable big data solutions that enable advanced analytics and insights across the organization. You will work with large data sets and utilize cutting-edge technologies to ensure data processing is efficient and reliable.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka.
- Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs.
- Ensure high data quality and integrity by implementing robust data validation and testing processes.
- Optimize data storage solutions for performance and cost-efficiency across cloud and on-premises environments.
- Monitor and troubleshoot data processing workflows to ensure timely data delivery.
- Document data architectures, processes, and workflows for knowledge sharing and compliance.
- Stay ahead of industry trends and best practices in big data technologies and methodologies.
Requirements
Requirements:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 3+ years of experience as a Big Data Engineer or in a similar data engineering role.
- Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka.
- Strong coding skills in programming languages like Java, Scala, or Python.
- Familiarity with data processing frameworks and ETL tools.
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., HDFS, S3, BigQuery).
- Analytical mindset and excellent problem-solving abilities.
- Strong communication skills to collaborate effectively with technical and non-technical stakeholders.
- A self-motivated and proactive approach to work, with the ability to manage multiple tasks and deadlines.
Preferred Qualifications:
- Experience with machine learning frameworks and algorithms is a plus.
- Knowledge of data governance and security best practices.
- Familiarity with containerization technologies and orchestration tools like Docker and Kubernetes.
Benefits
1- Attractive Package.
2- Family Benefits.
3- Visa.
4-Air Tickets.
Skills
Apache KafkaApache SparkAWSAzureBigQueryCloud/on-premisesData GovernanceData PipelinesData Storage OptimizationData ValidationDockerETLGCPHadoopHDFSJavaKubernetesPythonS3Scala
Explore related jobs
More jobs at Müller`s Solutions
- SAP Ariba Consultant (Saudi National Only)Riyadh, Riyadh Province
- ServiceNow Developer - Immediate JoiningRiyadh, Riyadh Province
- Senior Ingentis ConsultantRiyadh, Riyadh Province
- Senior BMC Helix Consultant ( 1 Month)Muscat, Muscat Governorate
- ServiceNow Senior Developer - IT Service Management (ITSM)Dubai, Dubai
- ServiceNow Strategy AdvisorDubai, Dubai
Similar Apache Kafka jobs
Jobs in Dubai
Senior Growth Operator | 8-Figure DTC Founder | DubaiGethr · Dubai, United Arab Emirates- Spa Therapist - FemalePALAZZO VERSACE DUBAI · Dubai, Dubai
Chief Accountant + TaxDeluxe Holiday Homes · Dubai, Dubai
People Administrator & Project Management Officer, MENATrivandi · Dubai- Business Development Executive- Tracking & Telematics SolutionsSGS · Dubai, United Arab Emirates
- Team Lead - Rider Quality SupportDelivery Hero · Dubai, United Arab Emirates