Senior Python Developer: Databricks AI Platform, Alerting & Monitoring
AI Summary
Senior Python Developer focused on AI Platform Engineering and system observability, responsible for Databricks automation, AI deployment, and Python-based AWS monitoring/alerting across multi-account environments.
About this role
About Xenon7
Where elite tech talent meets world-class opportunities! At Xenon7, we partner with leading enterprises and innovative startups on transformative projects across Data, Infrastructure, and AI. We are building an exclusive community of top-tier experts ready to solve real-world problems and shape the future of intelligent systems.
Role Overview
We are seeking a Senior Python Developer who thrives at the intersection of ** AI Platform Engineering** and ** System Observability **. This is a unique "hybrid" role where you will be responsible for building automated, scalable Databricks environments for AI/ML workloads, while simultaneously engineering a robust, Python-based AWS monitoring and alerting ecosystem.
You aren't just building the engine; you are designing the high-tech dashboard and fail-safes that ensure it runs perfectly at scale.
Key Responsibilities
1. Databricks Automation & AI Integration
- Workload Automation: Build Python-based workflows for MLOps, LLMOps, and application deployment within Databricks.
- Workspace Governance: Enhance workspace onboarding including Unity Catalog, permissions, and environment setup using reusable Python modules.
- AI Deployment: Integrate Mosaic AI components (Gateway, Model Serving, Agents) into platform automation.
- Architecture: Support Delta Lake (Bronze/Silver/Gold) architecture and MLflow model lifecycles.
2. Python-Driven Alerting & Monitoring
- Observability Frameworks: Implement automated health checks for AWS resources and Databricks applications.
- Event-Driven Alerting: Develop and configure alerting mechanisms using ** AWS CloudWatch, SNS, and EventBridge.**
- Consistency & Compliance: Build Python automations to validate configuration consistency across multiple AWS accounts and detect anomalies or misconfigurations.
- Workflow Integration: Create automated service request workflows that bridge alerting with ticketing systems (Slack, Jira, etc.).
Requirements
Required Technical Expertise
- Python Mastery (6+ Years): Deep understanding of Python internals, including ** GIL behavior, multiprocessing vs. multithreading,** and memory overhead trade-offs.
- Databricks Ecosystem: Hands-on experience with ** Unity Catalog, MLflow, and Mosaic AI.**
- AWS Automation: Strong proficiency in ** AWS Lambda, API Gateway, CloudWatch, and EventBridge.**
- Reliability Engineering: Experience with Docker image immutability, automated rollback strategies, and production stability patterns.
- Authentication: Experience with Service Principal-based authentication for secure Databricks/AWS bridging.
Ideal Candidate Profile
- 6+ years of professional Python development and cloud automation experience.
- A dual mindset: You love building new AI capabilities but are equally obsessed with proactive monitoring and 99.9% uptime.
- Ability to work independently in a remote, global environment.
- Immediate availability is highly preferred.
Benefits
- Ecosystem of Opportunity: Be part of a network where client engagements, thought leadership, and mentorship paths are interconnected.
- Outcome-Focused Culture: We value smart execution, autonomy, and ownership over "hours at a desk."
- Leading Edge: Contribute to projects that shape the direction of AI and high-scale cloud infrastructure.
Skills
Explore related jobs
More jobs at Xenon7
- InfoSec Compliance & Assurance Lead - BankingNew Cairo City, Cairo Governorate
- InfoSec Awareness & Engagement Lead - BankingNew Cairo City, Cairo Governorate
- Security Architecture, Engineering & Threat Operations Lead - BankingNew Cairo City, Cairo Governorate
- Senior Cyber Security EngineerNew Cairo City, Cairo Governorate
- Sagemaker DevOps Engineer - Europewarsaw, Poland
- Senior Business Analyst - BankingNew Cairo City, Cairo Governorate
Similar API Gateway jobs
Jobs in Hyderabad
- Support Resource – NG MobileSutherland · Hyderabad, TS
- Data EngineerMattel · Hyderabad, India
- Team Member - Quality ControlDr Reddy's Laboratories Limited · Hyderabad, India
HR Operations OfficerIQ-EQ · Hyderabad, India- Infrastructure EngineerRedwood Software · Hyderabad, Telangana
Senior Accountant, Corporate AccountingIQ-EQ · Hyderabad, Telangana