Job description

Specialisation: Data Platform Modernisation: Azure, Databricks
We are looking for a Senior Technology Architect with advanced, hands-on expertise in Databricks and Azure to architect and deliver modern cloud data solutions. The role involves leading migration efforts and designing high-performance, secure environments tailored for the financial services sector.

Key Responsibilities

• Architecting, implementing, and optimising scalable data solutions using Databricks, Azure, MS Fabric for data warehousing, lakes, and analytics.
• Leading migrations from legacy platforms to Databricks, MS Fabric, leveraging automation tools and best practices for code and workload transformation.
• Developing Databricks features such as Delta Lake, Unity Catalog, MLflow, and secure collaboration capabilities.
• Automating pipelines using Databricks Workflows and orchestrating data workflows with Delta Live Tables.
• Configuring and enforcing data security, RBAC, and compliance using Databricks governance features (Unity Catalog, data lineage, audit).
• Monitoring and tuning Databricks clusters and jobs for cost and performance efficiency.
• Integrating Databricks with Azure services, including Data Factory, Data Lake Storage, and Azure Synapse.
• Staying up to date with Databricks and Azure platform releases and best practices.

Required Skills and Certifications

• 15+ Years of total experience in Data platforms/ETL/BI with minimum 5-7 years of Experience in architecting, modernizing, implementing cloud data platforms.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Expert-level, hands-on experience with the Databricks, including security, automation, performance optimization, and migration strategies.
• Advanced certifications in Databricks and/or Azure data solutions.
• Strong background in data modelling, governance, and compliance within financial domains.
• Excellent problem-solving and communication skills.

Desirable Experience

• Experience with Mainframe systems.
• Experience with reporting tools such as PowerBI, SAS, etc.
• Experience with ETL tools such as Informatica, ADF, etc.
• Exposure to Gen-AI solutions for code conversion or migration.
• Certifications in Informatica, Snowflake or other advanced data technologies.
• Knowledge of industry data standards, regulatory audits, and privacy regulations.
• Background in Data Governance, Data Catalog, Lineage, and Master Data Management (MDM).