Lead Azure Databricks Administrator

About Infinite

Infinite is a global leader in digital engineering and IT services, with over 20 years of experience driving digital transformation. We partner with leading Fortune 1000 companies to deliver innovative, scalable technology solutions that accelerate business outcomes.

With deep expertise in telecommunications, healthcare, banking, and finance, Infinite helps organizations optimize and modernize their technology landscapes to achieve long-term growth and efficiency.

Job Descriptions

We are seeking an experienced Lead Azure Databricks Administrator to support, optimize the Databricks platform on Microsoft Azure for a US Healthcare payer organization. This role will provide technical expertise across platform administration, security, integrations, and user enablement. The ideal candidate will ensure platform reliability, compliance, and scalability.

Key Responsibilities

• Drive workload planning, task prioritization, performance tracking, and continuous skill development within the team.
• System Integration & Monitoring
• Implement and maintain integrations between Databricks and enterprise systems such as LogRhythm, ServiceNow, and AppDynamics.
• Oversee end-to-end observability, monitoring, and alerting to ensure seamless system performance.
• Security & Access Management
• Provision access management for users, groups, and workspaces—aligned with US Healthcare security, compliance, and data governance requirements.
• Implement platform-wide controls, audits, and compliance measures (e.g., HIPAA-aligned practices).
• User Support & Engagement
• Serve as the point of contact for Databricks users and cross-functional engineering teams.
• Coordinate with security, cloud operations, data engineering, and application teams for issue resolution and enhancements.
• Operational Monitoring & Maintenance
• Monitor performance, usage, and cost metrics; recommend optimization strategies.
• Ensure timely application of patches, runtime upgrades, and newly released features within a controlled environment.
• Ticket Management, Troubleshooting & SLA Compliance
• Oversee the intake, assignment, and resolution of support tickets related to Databricks platform issues, access requests, and operational tasks.
• Guide onshore and offshore team members through troubleshooting, root-cause analysis, and best-practice resolution workflows.
• Monitor ticket queues for aging, prioritization, and workload balance to ensure adherence to SLAs and operational KPIs.
• Establish structured troubleshooting playbooks, runbooks, and escalation paths.

Required Skills & Qualifications

• Experience as administering Azure Databricks in a production environment, preferably in US Healthcare payer or regulated data ecosystems.
• Strong knowledge of Azure services, data engineering workflows, and DevOps practices.
• Experience integrating Databricks with tools like LogRhythm, ServiceNow, and AppDynamics.
• Strong communication, stakeholder management, and documentation skills.

Preferred Certifications

• Microsoft Certified: Azure Administrator Associate
• Databricks Certification(s)
• Microsoft Certified: Azure Data Engineer Associate