Senior Data Engineer (Western Cape)
Flash Group · Western Cape
Stop applying one at a time.
JobAlertsZA auto-applies to South African jobs like this one for you, overnight. Upload your CV once — we do the applying.
Start free — we apply for you →Why this role matters
- As our Senior Data Engineer, you'll be responsible for creating robust data pipelines from millions of transactions a day, integrating data from multiple sources, ensuring data quality and governance, and optimising data platforms for performance and scalability.
- This role plays a key part in enabling data-driven decisions by delivering trusted, accessible, and well-structured data to business stakeholders, analysts, and engineering teams
What you'll own
- Own the migration of assigned workstreams from SQL Server to Microsoft Fabric, from assessment through cutover and decommissioning.
- Contribute to data architecture and platform design decisions for the target Fabric estate.
- Design, develop, and maintain scalable data pipelines.
- Develop and maintain data models for analytics and reporting.
- Ensure data quality, integrity, and reliability across platforms.
- Monitor and troubleshoot data platform performance issues.
- Implement data governance, security, and compliance standards.
- Assess and inventory the existing SQL Server estate — databases, SSIS packages, stored procedures, SQL Agent jobs, downstream report dependencies — and sequence the migration by risk and business value.
- Rebuild SSIS packages as Fabric-native pipelines, notebooks, or Dataflows Gen2.
- Assist in implementing Master Data Management across the estate.
- Refactor T-SQL and stored procedures for Fabric Warehouse compatibility, resolving unsupported constructs.
- Run parallel validation and reconciliation between legacy and Fabric outputs, and plan zero-downtime cutovers.
- Maintain and support the legacy SQL Server platform through the transition period, then decommission migrated components.
- Manage Fabric capacity consumption and platform cost.
Requirements
Experience we're looking for
- Bachelor's degree in computer science, Information Systems or Engineering.
- 5–8 years in data engineering, including hands-on SQL Server T-SQL, SSIS, SQL Agent in production.
- Demonstrable experience delivering a cloud data platform migration or greenfield Lakehouse/warehouse build.
- Microsoft fabric experience highly advantageous or directly transferable experience on Azure Synapse or Databricks.
Bonus points if you have…
- Preferred: DP-700 Microsoft Fabric Data Engineer Associate
You'll thrive in the Herd if you have…
- Analytical Thinking: Systematically breaks down complex data and commercial structures to identify trends, risks, and opportunities that inform strategic decisions.
- Stakeholder Influence: Communicates financial insights clearly to non-finance stakeholders, including senior leadership and external partners, to drive alignment and action.
- Attention to Detail: Maintains accuracy and rigour across financial models, dashboards, and reporting, ensuring data integrity underpins all decision-making.
- Strategic Orientation: Connects day-to-day financial analysis to broader divisional and company strategy, proactively identifying growth levers and efficiency gains.
- Adaptability: Thrives in a fast-paced, evolving environment where product portfolios, partner relationships, and commercial structures change frequently.
- Problem Solving: Approaches challenges with a solutions-oriented mindset, balancing speed and thoroughness to deliver actionable outcomes under pressure.
Perks that make your life easier
- Catered lunch four days a week for office-based team members.
- An open coffee bar and snacks.
- Employee Assistance Programme.
- Corporate Social Investment events and opportunities to give back.
- Free on-site parking.
- Access to LinkedIn Learning.
- Social events throughout the year.
- Group risk benefits.
- Flash Club, our employee engagement programme where you can earn up to five additional leave days by completing all categories within a cycle.