Senior Data Engineer (Western Cape)

Flash Group · Western Cape

Stop applying one at a time.

JobAlertsZA auto-applies to South African jobs like this one for you, overnight. Upload your CV once — we do the applying.

Start free — we apply for you →

Why this role matters

  • As our Senior Data Engineer, you'll be responsible for creating robust data pipelines from millions of transactions a day, integrating data from multiple sources, ensuring data quality and governance, and optimising data platforms for performance and scalability.
  • This role plays a key part in enabling data-driven decisions by delivering trusted, accessible, and well-structured data to business stakeholders, analysts, and engineering teams

What you'll own

  • Own the migration of assigned workstreams from SQL Server to Microsoft Fabric, from assessment through cutover and decommissioning.
  • Contribute to data architecture and platform design decisions for the target Fabric estate.
  • Design, develop, and maintain scalable data pipelines.
  • Develop and maintain data models for analytics and reporting.
  • Ensure data quality, integrity, and reliability across platforms.
  • Monitor and troubleshoot data platform performance issues.
  • Implement data governance, security, and compliance standards.
  • Assess and inventory the existing SQL Server estate — databases, SSIS packages, stored procedures, SQL Agent jobs, downstream report dependencies — and sequence the migration by risk and business value.
  • Rebuild SSIS packages as Fabric-native pipelines, notebooks, or Dataflows Gen2.
  • Assist in implementing Master Data Management across the estate.
  • Refactor T-SQL and stored procedures for Fabric Warehouse compatibility, resolving unsupported constructs.
  • Run parallel validation and reconciliation between legacy and Fabric outputs, and plan zero-downtime cutovers.
  • Maintain and support the legacy SQL Server platform through the transition period, then decommission migrated components.
  • Manage Fabric capacity consumption and platform cost.

Requirements

Experience we're looking for

  • Bachelor's degree in computer science, Information Systems or Engineering.
  • 5–8 years in data engineering, including hands-on SQL Server T-SQL, SSIS, SQL Agent in production.
  • Demonstrable experience delivering a cloud data platform migration or greenfield Lakehouse/warehouse build.
  • Microsoft fabric experience highly advantageous or directly transferable experience on Azure Synapse or Databricks.

Bonus points if you have…

  • Preferred: DP-700 Microsoft Fabric Data Engineer Associate

You'll thrive in the Herd if you have…

  • Analytical Thinking: Systematically breaks down complex data and commercial structures to identify trends, risks, and opportunities that inform strategic decisions.
  • Stakeholder Influence: Communicates financial insights clearly to non-finance stakeholders, including senior leadership and external partners, to drive alignment and action.
  • Attention to Detail: Maintains accuracy and rigour across financial models, dashboards, and reporting, ensuring data integrity underpins all decision-making.
  • Strategic Orientation: Connects day-to-day financial analysis to broader divisional and company strategy, proactively identifying growth levers and efficiency gains.
  • Adaptability: Thrives in a fast-paced, evolving environment where product portfolios, partner relationships, and commercial structures change frequently.
  • Problem Solving: Approaches challenges with a solutions-oriented mindset, balancing speed and thoroughness to deliver actionable outcomes under pressure.

Perks that make your life easier

  • Catered lunch four days a week for office-based team members.
  • An open coffee bar and snacks.
  • Employee Assistance Programme.
  • Corporate Social Investment events and opportunities to give back.
  • Free on-site parking.
  • Access to LinkedIn Learning.
  • Social events throughout the year.
  • Group risk benefits.
  • Flash Club, our employee engagement programme where you can earn up to five additional leave days by completing all categories within a cycle.
Auto-apply to this jobView original posting ↗