Jobless Developer
Trunk.io logo
Trunk.io

Posted 51 months ago

Open

Senior Software Engineer (Platform)

San FranciscoOn-siteFull-time

AI Summary

Senior Software Engineer to design, build, and optimize scalable data ingestion pipelines, focusing on real-time and batch data integration and reliability within Trunk.io's Platform/Data Engineering team.

About this role

At Trunk, our mission is to help teams create high-quality software quickly. We've helped engineerings teams at: Google X, Zillow, and Brex to understand why their builds fail, which tests are flaky, and how to ship code faster without sacrificing reliability. AI has made writing code 10x faster, but shipping is still painfully slow. The bottleneck has shifted downstream - to merge conflicts, flaky tests, inconsistent code quality, and dozens of other frictions that drain productivity and morale. Engineering teams that can stay focused on designing, implementing, and delivering software will build magical, high-quality projects - and they'll be happier doing it. We're building a CI Reliability Platform that empowers teams to land code faster and develop happier.

Our founders launched Trunk in 2021 after designing, delivering, and scaling software at Uber, Google, YouTube, and Microsoft. We raised a $25M Series A led by Initialized Capital (Garry Tan) and a16z (Peter Levine), with investments from Haystack Ventures, Garage VC, and the founders of GitHub (Tom Preston-Werner), Apollo GraphQL (Geoff Schmidt), Algolia (Nicolas Dessaigne), and Peopl.ai (Oleg Rogynsky).

We are looking for a motivated and experienced Senior Software Engineer to join our Platform/Data Engineering team. In this role, you will be responsible for developing and optimizing data ingestion pipelines that can handle vast amounts of real-time and batch data from various sources. Your focus will be on designing systems that are scalable, reliable, and performant, as well as ensuring the proper integration of data across our entire ecosystem.

What you'll do 🧑‍💻

  • Design, build, and maintain scalable data ingestion pipelines to handle large volumes of structured and unstructured data.
  • Optimize and improve the efficiency of existing data processing workflows, ensuring they can scale as the data grows.
  • Collaborate with cross-functional teams to gather data requirements and ensure seamless integration with various data sources.
  • Implement real-time and batch processing systems for ingesting data from APIs and webhooks.
  • Ensure data quality, consistency, and integrity across all data pipelines.
  • Troubleshoot and resolve performance bottlenecks and data-related issues in the ingestion pipeline.
  • Develop monitoring and alerting systems to proactively manage the health of data pipelines.
  • Continuously evaluate and adopt new technologies and tools to improve the scalability and performance of our systems.
  • Document the design, implementation, and operations of data pipelines for knowledge sharing within the team.

    • We're looking for 🔎

  • 4-5+ years of professional software engineering experience
  • You're located within commute distance of San Francisco and are willing to work in office at least 8 days per month.
  • You have experience in areas such as databases, distributed systems, service-oriented architectures, and data infrastructure
  • You derive joy from refactoring and building clean abstractions in order to make complex systems fun to develop on and easy to understand
  • Excellent debugging and troubleshooting skills and the tenacity to drive a solution to a conclusion
  • Experience and intuition to zero in on root causes for bugs that can leave others stumped
  • The ability to operate independently, but know when you are in too deep and need to ask for help
  • Ability to collaborate with colleagues to plan and execute the best solution

    • Our tech stack 💻

  • Frontend: Typescript, React, Next.js, AWS
  • Backend: Typescript, Node, AWS
  • Data pipelines: Dagster, python, polars
  • CI/CD: GitHub Actions

    • What we offer 🎁

  • Unlimited PTO
  • Competitive salary and equity
  • Work-life balance
  • Lunch ordered in on us at the office on Wednesdays and Thursdays
  • Few meetings, so you can ship fast and focus on building
  • One Medical membership on us!
  • Top-notch medical, dental, vision, short-term disability, long-term disability, and life insurance
  • All insurance is 100% company-paid ($0 premiums) for employees and highly subsidized for dependents
  • FSA, HSA with company contributions, and pre-tax commuter benefits
  • 401(k) plan
  • Paid parental leave ( up to 12 weeks)

    • Skills

    AlertingAWSBatch ProcessingDagsterDatabasesData InfrastructureData IntegrationData PipelinesData QualityDistributed SystemsGitHub ActionsMonitoringNext.jsNodePolarsPythonReactReal-time ProcessingService-oriented ArchitecturesTypeScript

    Explore related jobs

    More jobs at Trunk.io

    Similar Alerting jobs

    Jobs in San Francisco

    Browse these categories

    AWS JobsDatabases JobsData Integration JobsData Pipelines JobsData Quality Jobs