Senior Data Engineer: Pretoria
Arid Talent Solutions CC
Senior Data Engineer: Pretoria: FTC: 3x Year Project
Essential Skills Requirements
- Hands-on experience with Kafka and event streaming platforms for real-time data movement
- Proven experience with API integration patterns, webhooks and event/webhook ingestion
- Strong proficiency in Python for data engineering, ingestion pipelines and automation
- Strong proficiency in Java for stream processing or connector development
- Solid competence with enterprise databases and query languages, including performance tuning and query optimisation for OLTP/operational workloads
- Experience with NoSQL/document stores such as Amazon DynamoDB, MongoDB.
- Experience in data modelling to design schemas and standardised data representations
- Experience with schema registries and contract-first designs (Avro, Protobuf) to manage producer/consumer compatibility
- Strong understanding and practice of data quality techniques and tooling to ensure trusted data
- Knowledge of metadata management and cataloguing to support discoverability and lineage
- Familiarity with ETL/ELT patterns and best practices for performant, reliable data pipelines
- Observability for streaming: experience with metrics, tracing and logging on AWS (CloudWatch, OpenTelemetry, Prometheus/Grafana)
Qualifications / Experience
- Extensive hands-on experience (typically 6+ years) in data engineering, integration or streaming roles with demonstrable production experience
- Proven track record building and operating streaming platforms (Kafka/MSK) and API-based integrations, with strong Python and Java skills and experience with enterprise databases and query languages
- Strong analytical thinking, curiosity about data, attention to detail, structured problem solving and ownership: able to drive topics to completion
Preferred certifications: Confluent Certified Developer for Apache Kafka, Microsoft streaming event hubs, AWS Certified Data Engineer
Qualifications/Experience
- Extensive hands-on experience (typically 6+ years) in data engineering, integration or streaming roles with demonstrable production experience
- Proven track record building and operating streaming platforms (Kafka/MSK) and API-based integrations, with strong Python and Java skills and experience with enterprise databases and query languages
- Strong analytical thinking, curiosity about data, attention to detail, structured problem solving and ownership: able to drive topics to completion
- Preferred certifications: Confluent Certified Developer for Apache Kafka, Microsoft streaming eventhubs, AWS
- Certified Data Engineer
Please email a copy of your updated CV
For employers only
Is this your company's job post? Verify ownership to manage this listing and receive applications directly.
Claim this listingLooking to apply for this job? Use the Apply button above.
See more jobs in Pretoria, Gauteng