AWS Databricks Platform Administrator
Posted: 06/11/2026
Job Number: c0FJU1FyVjRrMEFVMVJ0UFpGN2Radz09
Pay Rate: 70-75 Hourly USD
Job Description
Job Description
Role: AWS Databricks Platform Administrator
Location: Raritan, NJ (Onsite)
Role Summary: We are seeking a Databricks professional with 5–8 years of experience in building, optimizing, and supporting modern data platforms on Databricks. This role may align to either a Databricks Data Engineer or a Databricks Platform Engineer/Administrator, depending on business needs. The ideal candidate should have strong hands-on expertise in Databricks, Apache Spark, Python, SQL, Delta Lake, and cloud platforms, along with experience in platform governance and security. The role requires the ability to design and deliver scalable, secure, and cost-efficient data solutions.
Key Responsibilities
Required Skills & Qualifications
Preferred Qualifications
Skills Mandatory: Databricks, Databricks Mlflow
Role Summary: We are seeking a Databricks professional with 5–8 years of experience in building, optimizing, and supporting modern data platforms on Databricks. This role may align to either a Databricks Data Engineer or a Databricks Platform Engineer/Administrator, depending on business needs. The ideal candidate should have strong hands-on expertise in Databricks, Apache Spark, Python, SQL, Delta Lake, and cloud platforms, along with experience in platform governance and security. The role requires the ability to design and deliver scalable, secure, and cost-efficient data solutions.
Key Responsibilities
- Design, develop, and maintain scalable batch and streaming data pipelines using Databricks, Python, SQL, and Spark.
- Build and optimize ETL/ELT workflows using Databricks Workflows, Jobs, and Delta Lake.
- Implement Medallion Architecture standards ensuring high data quality, performance, and reliability.
- Manage Databricks workspace administration including clusters, cluster policies, instance pools, jobs, and runtime upgrades.
- Configure Unity Catalog including catalogs, schemas, permissions, and governance policies for secure data access.
- Monitor platform health, job execution, audit logs, and cloud resource usage to improve performance and reduce cost.
- Automate infrastructure provisioning using Terraform, CI/CD pipelines, Databricks CLI, and REST APIs.
- Support cloud integrations across AWS, Azure, or GCP including storage, networking, secrets, and identity management.
- Troubleshoot pipeline failures, performance issues, permission errors, and platform-related challenges.
- Collaborate with data engineers, analysts, architects, security, and business teams to deliver reliable data solutions.
- Ensure adherence to enterprise security standards, governance policies, and operational best practices.
Required Skills & Qualifications
- 5–8 years of experience in data engineering, big data, or cloud data platform administration.
- Strong hands-on experience with Databricks, Apache Spark, PySpark, SQL, and Python.
- Experience building ETL/ELT pipelines, Delta Lake tables, and streaming data solutions.
- Solid understanding of data modeling, data warehousing, and lakehouse architecture.
- Hands-on experience in Databricks administration (clusters, jobs, access control, secrets, workspace management).
- Strong knowledge of Unity Catalog, data governance, lineage, and fine-grained access control.
- Experience with cloud platforms such as AWS, Azure, or GCP (S3, ADLS, IAM, Key Vault, networking).
- Experience with Infrastructure as Code and DevOps tools such as Terraform, Git, and CI/CD pipelines.
- Strong skills in troubleshooting, performance tuning, and monitoring of Databricks/Spark workloads.
- Good understanding of security, compliance, cost optimization, and enterprise operations.
- Excellent communication and stakeholder management skills.
Preferred Qualifications
- Experience with Delta Live Tables, Lakeflow, Auto Loader, MLflow, or Databricks SQL.
- Exposure to Kafka, Airflow, ADF, or other orchestration tools.
- Experience managing multi-workspace or multi-cloud Databricks environments.
- Knowledge of FinOps practices and cloud cost optimization.
- Experience working in Agile/Scrum environments.
- Prior experience in platform support, production operations, or managed services.
Skills Mandatory: Databricks, Databricks Mlflow