Posted 2 months ago
Senior Data Engineer
Bala Cynwyd (Philadelphia Area)On-siteContract
AI Summary
Designs, builds, and supports scalable data pipelines and modern data platforms for middle- and back-office systems, processing large-scale batch and streaming data into business-ready datasets.
About this role
Overview
We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into business-ready datasets. We are looking for an experienced data engineer who is passionate about modern data architectures, distributed data processing, and scalable analytics platforms.
In this role, you will:
- Design, develop, and support scalable data pipelines and data products for middle- and back-office systems
- Architect and implement modern data platform solutions
- Build and optimize large-scale batch and streaming data processing workflows
- Collaborate with application teams to model, transform, and deliver data solutions that meet business requirements
- Monitor, troubleshoot, and optimize data processing environments to ensure reliability, scalability, and performance
What we’re looking for
- 5+ years of experience in data engineering, data platforms, or large-scale distributed data processing
- Strong experience with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka
- Strong Python development skills required
- Experience designing and optimizing high-volume data pipelines and data processing frameworks
- Experience with query optimization and performance tuning in large-scale analytical environments
- Experience with on-premises data platforms preferred
- Industry experience within capital markets or financial services is required
- Domain knowledge particularly Operations and/or Compliance, is highly preferred
- Ability and flexibility to provide occasional off-hours/weekend support
#LI-RH1
Skills
Apache ArrowDatabricksData Pipeline DesignDistributed Data ProcessingIcebergKafkaParquetPerformance TuningPolarsPythonQuery OptimizationSnowflakeSparkTrino
Explore related jobs
More jobs at Susquehanna International Group, LLP
- Technical Systems Analyst - Compensation | HR Tech | Experienced HireBala Cynwyd (Philadelphia Area), PA
- Quantitative Systematic Trader | Experienced HireBala Cynwyd (Philadelphia Area), PA
- Sports TraderBala Cynwyd (Philadelphia Area), PA
- Software Engineer | Trader & Quant Education Technology | Experienced HireBala Cynwyd (Philadelphia Area), PA
- Software Engineer | Sports Analytics | Experienced HireDublin, IE
- Software Developer Productivity Engineer | HPC | Experienced HireBala Cynwyd (Philadelphia Area), PA
Similar Apache Arrow jobs
Jobs in Bala Cynwyd (Philadelphia Area)
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.