
Posted 6 months ago
Senior Azure Cloud Infrastructure Engineer (Healthcare AI Platform)
AI Summary
Designs and operates a highly available, secure Azure cloud platform for healthcare AI workloads, ensuring compliance, GPU-based compute optimization, and multi-region disaster recovery.
About this role
Overview
We'relooking fora Senior Azure Cloud Infrastructure Engineer to design, build, andoperatea highly resilient, secure, and cost-efficient cloud platform supporting advanced AI workloads in a healthcare environment.
This roleis responsible formission-critical infrastructure powering our proprietary foundational AI model, including GPU-based compute, while meeting strict requirements for compliance, data protection, and high availability. You will play a key role in ensuring our systems are fault-tolerant, auditable, and continuouslyoptimizedfor both performance and cost.
What You'll Do
- Architect and managehighly available, fault-tolerant systems on Microsoft Azure with multi-region redundancy and disaster recovery
- Design infrastructure with strict adherence to healthcare compliance standards (e.g., HIPAA, HITRUST, SOC 2)
- Provision andoptimizeGPU-based environments for AI/ML workloads, including large-scale model training and inference
- Build secure, zero-trust architectures (private networking, encryption, identity isolation, least privilege access)
- Implement backup, failover, and business continuity strategies with clearly defined RTO/RPO targets
- Continuously reduce infrastructure costs through intelligent scaling, reserved capacity, spot instances, and workload optimization
- Develop Infrastructure as Code (Terraform, Bicep, ARM) for repeatable, auditable deployments
- Partner with AI/ML teams to productionize and scale foundational models reliably
- Establish observability across systems (logging, monitoring, alerting) with proactive incident response
- Conduct architecture reviews, risk assessments, and security audits
Required Experience
- 5–8+ years of hands-on experience with Microsoft Azure cloud infrastructure
- Proven experience designinghigh-availability and disaster recovery systemsin regulated environments
- Strong background in healthcare or other compliance-heavy industries
- Deepexpertisein:
- Azure Virtual Machines, VM Scale Sets, and GPU compute
- Azure networking (VNets, Private Link, ExpressRoute, firewalls)
- Storage solutions (Blob, Files, managed disks with redundancy options)
- Experience implementing compliance frameworks such as HIPAA or SOC 2
- Strong knowledge of identity and access control (RBAC, Azure AD, managed identities)
- Experience with Kubernetes (AKS) and containerized workloads
- Proficiencyin scripting (Python, Bash, PowerShell)
Preferred Qualifications
- Experience with Azure AI ecosystem (Azure Machine Learning, Azure AI Foundry, Cognitive Services)
- Familiarity with distributed training, model parallelism, and GPU orchestration
- Experience implementingMLOpspipelines in regulated environments
- Azure certifications (Solutions Architect Expert, Security Engineer Associate, DevOps Engineer Expert)
- Experience with zero-downtime deployments and blue/green or canary strategies
Infrastructure Expectations
- Multi-region architecture with automated failover
- End-to-end encryption (data at rest and in transit)
- Segmented environments (dev/staging/prod) with strict isolation
- Real-time monitoring and alerting with defined SLAs
- Automated backup and recovery with regular testing
- Cost visibility and governance across all resources
What Success Looks Like
- Near-zero downtime systems with tested failover capabilities
- Full compliance readiness with audit trails and documentation
- Efficient GPUutilizationsupporting AI workloads at scale
- Measurable reduction in cloudspendwithout compromising reliability or security
- Seamless collaboration between infrastructure and AI teams
Why This Role Matters
You will be building the backbone of the next-generation healthcare AI platform - where reliability, security, and performance directly impact real-world outcomes. This is not just infrastructure; it is critical systems engineering at the intersection of cloud, AI and healthcare.
We offer
- Paid vacation, sick time, and personal days
- 11company paid holidays
- Quarterly
Skills
Explore related jobs
More jobs at Civie
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.