Posted 23 days ago
Sr. BI Data Engineer
AI Summary
Designs, builds and optimizes enterprise-scale Databricks Lakehouse data pipelines and analytics data products on Azure, leading technical design and production support for complex data initiatives across business functions.
About this role
As a Senior BI Data Engineer, you will design, build, and optimize enterprise-scale data solutions that power analytics and business decision-making across Boston Beer. You will work hands-on with Databricks, Azure data services, and modern data engineering practices to deliver reliable, scalable, and high-performing data products. In this role, you'll partner with stakeholders across multiple business functions while helping drive platform modernization, engineering excellence, and technical innovation.
Qualifications
- Bachelor's degree in Computer Science, a closely related field, or equivalent practical experience.
- 7+ years of experience in data engineering, data warehousing, data integration, analytics engineering, or related technology roles.
- 3+ years of hands-on Databricks development experience supporting production environments.
- Strong expertise with Databricks Lakehouse, Apache Spark, Delta Lake, Databricks Workflows, Unity Catalog, and distributed data processing.
- Experience working with Microsoft Azure data services, including Azure Data Factory, Azure Data Lake Storage, and Azure Key Vault.
- Advanced SQL and Python skills with experience building, operating, and optimizing complex ETL/ELT pipelines and analytical data models.
- Experience with modern DevOps and data engineering practices, including Git-based development, automated testing, CI/CD, orchestration, monitoring, security, governance, and production support.
- Demonstrated ability to lead technical solution design, evaluate technical trade-offs, and independently deliver complex data initiatives.
- Strong communication and collaboration skills with experience providing technical guidance to engineering teams.
- Experience with advanced Databricks capabilities, including Databricks Asset Bundles, workspace administration, platform configuration, and governance.
- Experience with Power BI semantic modeling, reporting enablement, and analytics consumption patterns.
- Experience modernizing legacy SQL Server data solutions to cloud-based platforms.
- Familiarity with artificial intelligence (AI), machine learning (ML), feature engineering, or model-ready data products.
- Knowledge of SAP, Salesforce, Supply Chain, Manufacturing, or consumer packaged goods business processes.
Level: L6
- Tuition reimbursement
- Fertility/adoption support
- Free financial coaching
- Health & wellness program and discounts
- Professional development & training
- Free beer!
Responsibilities
- Design, build, and support scalable Databricks Lakehouse data pipelines using Apache Spark, Delta Lake, Structured Query Language (SQL), and Python.
- Lead technical design and delivery for complex data initiatives that span multiple systems, platforms, and business functions.
- Diagnose production issues, perform root cause analysis, evaluate technical alternatives, and implement solutions that improve reliability, scalability, and maintainability.
- Develop reusable frameworks and engineering practices for data ingestion, transformation, orchestration, testing, monitoring, data quality, and production support.
- Administer and support Databricks platform capabilities, including workspace configuration, Unity Catalog, permissions management, and data governance.
- Design and manage production workflows, including scheduling, dependency management, monitoring, alerting, and failure recovery.
- Implement continuous integration and continuous deployment (CI/CD) processes using Azure DevOps, Git-based development workflows, and Databricks Asset Bundles.
- Collaborate with business stakeholders, analytics teams, and technology partners to define requirements and deliver impactful data solutions.
- Optimize data pipelines, compute resources, and storage for performance, observability, reliability, and cost efficiency while supporting modernization of legacy SQL Server solutions.
- Mentor engineers, conduct code and design reviews, and contribute to continuous improvements in engineering standards and practices.
- Work in a standard office environment with occasional travel as needed to support business objectives and team collaboration.
Skills
Explore related jobs
More jobs at The Boston Beer Company
Similar Databricks jobs
- B
Apache Spark DeveloperBright Vision Technologies · Edison / Middlesex County, New Jersey - E
Apache Spark Java DeveloperElite Workforce Inc. · Brooklyn Park, MN - E
JAVA and Scala/ Apache Spark developer.EROS Technologies Inc. · New York, NY - N
Senior Machine Learning Engineer, Accelerated Apache SparkNVIDIA USA · US, CA - D
Sr. Designated Support Engineer, Apache Spark™Databricks · Sao Paulo, Brazil - LPrincipal Data Engineer (Apache Spark, dbt, Airflow)LE001-ASXOPS ASX Operations Pty Ltd · Sydney Office
Jobs in Boston
- S
Manager, Marketing - DEKA, North America (NAM)Spartan Race · Boston, Massachusetts - E
Personal TrainerEverybodyfights · Boston, Massachusetts - F
Patient Resource NavigatorFenway Health · Boston, Massachusetts - H
IT Project ManagerHarvard University · Boston, MA - G
Senior MEP ProfessionalGilbane Building Company · Boston, MA - S
Fund Accounting Internship (Busy Season)Standish Management · Boston, Massachusetts
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.