
Posted 6 months ago
Platform Data Engineer
AI Summary
Data Engineer II focuses on building and maintaining data pipelines, ETL processes, and data warehouses using Python, BigQuery, and GCP, collaborating with the CTO and team.
About this role
About Neon Redwood
Neon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Data Engineer to join our team and help us develop and expand our data infrastructure and analytics capabilities.
The Role
We are seeking an experienced Data Engineer II with a strong background in data engineering and a passion for working with large-scale data sets. Help us develop and expand our data infrastructure and analytics capabilities.
The ideal candidate will have at least 2 years of professional experience and a solid understanding of Python, BigQuery, and Google Cloud Platform (GCP) or similar technologies. This full-time role will involve working closely with our CTO and other team members to design, develop, and maintain data pipelines, ETL processes, and data warehousing solutions.
Responsibilities
Collaborate with the CTO and other team members to design, develop, and maintain data pipelines and ETL processes.
Write clean, efficient, and maintainable code in Python and other relevant technologies.
Implement and optimize data storage and processing solutions using BigQuery and Google Cloud Platform (GCP).
Ensure data quality and integrity through proper data validation and monitoring techniques.
Stay up-to-date with the latest industry trends and technologies to ensure our data infrastructure remains competitive.
Assist in the development and launch of new data-driven tools and products.
Mentor and guide junior engineers, fostering a culture of continuous learning and improvement.
Requirements
Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent work experience.
2+ years of professional data engineering experience.
Proficiency in Python, BigQuery, and Google Cloud Platform (GCP) or equivalent technologies.
Experience with data pipeline and ETL process design and development.
Excellent problem-solving skills and the ability to work independently or as part of a team.
Strong communication, collaboration, and a passion to develop leadership skills.
Passion for working with large-scale data sets and staying current with industry trends.
Experience with Asana or similar project management tools.
Additional Skills (Nice to Have)
Experience with other data processing technologies and platforms (e.g., Apache Beam, Dataflow, Hadoop, Spark).
Experience with data visualization tools and libraries (e.g., Looker, Sigma, D3.js).
Knowledge of machine learning and AI concepts.
Experience with real-time data processing and streaming technologies (e.g., Kafka, Pub/Sub).
Skills
Explore related jobs
More jobs at Neon Redwood
Similar Airflow jobs
Jobs in San Francisco
- SArtist Logistics CoordinatorSFJAZZ · San Francisco, United States
- Director, Strategic Account ManagementRippling (Rippling) · San Francisco, Canada
- Account ExecutiveRely Health · San Francisco, Canada
- Office Administrator (part-time)Paubox · San Francisco, Canada
- NMember of Technical Staff - SecurityNeoSigma Inc. · San Francisco, Canada
Business OperationsMercor · San Francisco