Databricks Practice Lead

INTRODUCTION.

At our core, Data Intellect is a data and technology consultancy firm. Our key area of expertise is financial and capital markets technology solutions. However, the utility of these solutions allow us to apply fintech data expertise to other industries such as smart energy and healthcare.

This proprietary offering is complemented by a wealth of experience in data engineering, electronic trading systems, data capture applications, regulatory and compliance systems and middle and back-office enterprise web solutions.

Our mission is to help organisations unlock the full potential of their data, enabling strategic decision-making and transformative business growth. We are known for our deep technical expertise, collaborative approach, and commitment to innovation.

Simply put – we turn big data problems into smart data solutions.

Apply Now

Job Details.

> Reference:

REF81W

> Department:

Data Analytics & Engineering

> Location:

London Office

> Contract Type:

Full-time

> Experience:

Mid-Senior Level

> Industry:

Information Technology And Services

> Closing Date:

01/12/2024

Requirements.

Requirements

Key Qualifications

  • Strong experience in data engineering, data architecture, or big data analytics.
  • Proven experience designing and deploying large-scale data pipelines, ETL processes, and data lakes using Databricks.
  • Demonstrable experience with cloud services, all three public clouds (AWS, GCP, Azure) is beneficial.
  • Solid understanding of Spark architecture, distributed computing, and cloud-based data engineering principles.
  • Proficiency in programming languages such as Python or SQL.
  • Strong leadership skills with experience managing and growing high-performing technical teams.
  • Excellent client-facing communication skills, including the ability to translate technical solutions into business value.
  • Experience in Consulting / Financial Services / Capital Markets, delivering solutions for multiple clients is advantageous.

Key Competencies

  • Leadership: Ability to inspire, lead, and develop a high-performing team.
  • Strategic Thinking: Proactively identifies opportunities to innovate and expand service offerings.
  • Problem-Solving: Demonstrates strong analytical skills to solve complex technical problems.
  • Communication: Excellent interpersonal and presentation skills to engage with clients and stakeholders.
  • Collaboration: Works effectively across departments, teams, and client organizations.
Apply Now

Responsibilities.

Responsibilities

We are seeking a highly skilled and motivated Databricks Lead to spearhead our Databricks practice. This is a leadership role responsible for driving the growth, innovation, and successful delivery of cloud-based data solutions for our clients leveraging Databricks. The Practice Lead will collaborate with internal teams and clients to design, implement, and optimize big data and machine learning workflows, driving value through scalable and efficient data architectures.

The ideal candidate has a deep understanding of cloud-based data processing, particularly within a Databricks environment, and a passion for leading and mentoring a team of data engineers. This role requires both technical expertise and strategic leadership, making it a unique opportunity for someone who is looking to shape the future of data-driven solutions within a fast-growing, innovative company.

Key Responsibilities

The role will be working with the CTO on the following:

1. Practice Leadership

  • Develop and lead the Databricks practice, establishing it as a key offering within Data Intellect’s services.
  • Define the strategic vision for the practice, including service offerings, go-to-market strategies, and best practices.
  • Stay up to date with current with Databricks advancements, industry trends, and competitor strategies to ensure continuous innovation.
  • Collaborate the Business Development Team to drive new business opportunities and expand the client base.

2. Team Management & Development

  • Build, mentor, and manage a team of data engineers and consultants within the Databricks practice.
  • Foster a culture of innovation, continuous learning, and knowledge sharing within the team.
  • Develop training programs and professional development opportunities to ensure team members are skilled in the latest technologies and best practices.

3. Project Delivery & Execution

  • Lead the design, development, and implementation of complex data pipelines, ETL processes, and data lakes using Databricks and other services
  • Provide oversight and guidance to project teams ensuring high-quality delivery of data solutions, including scalability, performance, and security.
  • Partner with clients to understand their data needs, architect tailored solutions, and provide strategic guidance on leveraging Databricks to meet business objectives.

4. Client Engagement & Relationship Building

  • Act as the primary point of contact for Databricks expertise in discussions with key clients, offering thought leadership and driving long-term relationships.
  • Lead client discussions around technical architecture, project scope, and implementation plans.
  • Ensure client satisfaction through proactive communication, project transparency, and post-deployment support.

5. Technical Excellence & Innovation

  • Establish best practices for Databricks deployments, including performance tuning, cost optimisation, and security management.
  • Develop reusable frameworks, assets, and accelerators to improve delivery efficiency and consistency across projects.
  • Advocate for the adoption of advanced analytics, AI, and machine learning capabilities within Databricks to drive additional business value.
Apply Now

You'll know if you're up to the challenge

Apply Now

our Benefits.

  • Hybrid working.

    The commute can be a pain, but there's really no virtual replacement for sitting around a whiteboard with teammates. We offer hybrid working, with flexbility around in-office or from-home, allowing our people to achieve a good work/life balance.

  • REFERRAL SCHEME.

    We love to see referrals coming through for people that could add to the ever growing Data Intellect team. Referring a friend means cash for you!

  • Travel opportunities .

    We offer opportunities to work globally in locations such as London, New York, Hong Kong, Singapore and Japan- with all expenses paid!

  • Healthcare cover.

    We provide private health care via Benenden Health, including 24/7 GP, Mental Health helpline, medical diagnosis and treatment, and physiotherapy.

  • Holiday entitlement

    We get up to 27 days leave, public holidays, compensatory days off, and holiday carry over (different holiday entitlements apply depending on region)

  • Continual professional development.

    We have extensive training ranging from leadership to technical skills. Monthly 1-2-1s with your People Leader will support and guide you in the right direction. We run an internal promotion process twice a year.

LET'S CHAT ABOUT YOUR PROJECT.

GET IN TOUCH