Job Description

Job Description

Role: Azure Databricks Lead / Architect

Location: Atlanta, GA/ Alpharetta, GA (Onsite)

Duration: Long Term

Required:

• 12+ Years’ experience Azure Databricks, Data modeling, Data Lake.
• Good to have Databricks certified.

Key Responsibilities:

• Lead the design, development, and implementation of Azure-based data lake and data warehouse architectures .
• Develop and optimize ETL/ELT pipelines using Azure Databricks (PySpark/Scala) .
• Build and maintain Delta Lake -based architectures to support transactional data lakes.
• Design and implement logical and physical data models supporting business analytics, reporting, and advanced analytics use cases.
• Collaborate with business stakeholders and BI teams to understand data needs and ensure data models align with business requirements.
• Establish governance , partitioning , and security strategies across structured and unstructured data in the lake.
• Define best practices and standards for data ingestion, processing, and storage using Azure-native tools.
• Provide technical leadership and mentorship to data engineering teams.

Required Skills:

• Expertise in Azure Databricks – Notebooks, Jobs, Workflows, and Delta Lake.
• Strong experience in data modeling (star schema, snowflake, normalized/denormalized models).
• Deep knowledge of Data Lake architecture – Azure Data Lake Storage Gen2, Delta Lake, and Medallion architecture (bronze/silver/gold).
• Hands-on experience with PySpark / Scala for distributed data processing.
• Proficient in Azure Data Factory , Azure Synapse Analytics , and Azure SQL .
• Strong understanding of data governance , lineage , and metadata management .
• Experience in performance tuning , partitioning , and data pipeline optimization .
• Proficiency in source control and CI/CD tools like Git and Azure DevOps .

Job Tags

Similar Jobs