Big Data Engineer (Senior)
MSP Staffing Pty Ltd
Our client is seeking a Senior Big Data Engineer to build and optimise large-scale data platforms that support advanced analytics, machine learning, and enterprise data products. This is an exciting opportunity to work on high-volume data processing solutions within a cloud-first environment while collaborating with multidisciplinary engineering teams.
Key Responsibilities
- Design, develop, and maintain high-volume data ingestion and transformation pipelines.
- Build scalable feature stores, analytical datasets, and data processing frameworks.
- Optimise data workflows for performance, scalability, and reliability.
- Develop ETL/ELT solutions supporting enterprise data products.
- Collaborate with architects, data scientists, and platform engineers.
- Implement data quality, validation, and governance processes.
- Support cloud-native data engineering initiatives and platform optimisation.
- Produce technical documentation and support operational excellence.
Requirements
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
- 10+ years' experience in data engineering or big data development.
- Strong experience with Spark, Hadoop, or similar distributed data processing technologies.
- Experience building enterprise-scale data pipelines.
- Strong SQL and programming skills (Python, Scala, or Java).
- Experience working with cloud-based data platforms.
- Excellent analytical and problem-solving skills.
Advantageous
- Experience with Azure Databricks or comparable cloud data platforms.
- Experience with Kafka or streaming technologies.
- Cloud certifications.
- Telecommunications, financial services, or enterprise analytics experience.
P ersonal Attributes
- Detail-oriented with a passion for data engineering.
- Strong collaboration and communication skills.
- Self-driven and adaptable.
- Able to manage multiple priorities effectively.
- Committed to delivering high-quality, scalable data solutions.
Only shortlisted candidates will be contacted.
Submit your CV to Sign in to view email or call 021 555 0432.
Visit our website for more exciting career opportunities: https://mspstaffingza.co/
Correspondence will only be conducted with short listed candidates. Should you not hear from us within 4 days, please consider your application unsuccessful.
For employers only
Is this your company's job post? Verify ownership to manage this listing and receive applications directly.
Claim this listingLooking to apply for this job? Use the Apply button above.
See more jobs in Durban, KwaZulu-Natal