Senior Data Engineer: Pretoria

Arid Talent Solutions CC

Date: 12 hours ago
City: Pretoria, Gauteng
Contract type: Full time

Senior Data Engineer: Pretoria: FTC: 3x Year Project

Essential Skills Requirements

  • Hands-on experience with Kafka and event streaming platforms for real-time data movement
  • Proven experience with API integration patterns, webhooks and event/webhook ingestion
  • Strong proficiency in Python for data engineering, ingestion pipelines and automation
  • Strong proficiency in Java for stream processing or connector development
  • Solid competence with enterprise databases and query languages, including performance tuning and query optimisation for OLTP/operational workloads
  • Experience with NoSQL/document stores such as Amazon DynamoDB, MongoDB.
  • Experience in data modelling to design schemas and standardised data representations
  • Experience with schema registries and contract-first designs (Avro, Protobuf) to manage producer/consumer compatibility
  • Strong understanding and practice of data quality techniques and tooling to ensure trusted data
  • Knowledge of metadata management and cataloguing to support discoverability and lineage
  • Familiarity with ETL/ELT patterns and best practices for performant, reliable data pipelines
  • Observability for streaming: experience with metrics, tracing and logging on AWS (CloudWatch, OpenTelemetry, Prometheus/Grafana)

Qualifications / Experience

  • Extensive hands-on experience (typically 6+ years) in data engineering, integration or streaming roles with demonstrable production experience
  • Proven track record building and operating streaming platforms (Kafka/MSK) and API-based integrations, with strong Python and Java skills and experience with enterprise databases and query languages
  • Strong analytical thinking, curiosity about data, attention to detail, structured problem solving and ownership: able to drive topics to completion

Preferred certifications: Confluent Certified Developer for Apache Kafka, Microsoft streaming event hubs, AWS Certified Data Engineer

Qualifications/Experience

  • Extensive hands-on experience (typically 6+ years) in data engineering, integration or streaming roles with demonstrable production experience
  • Proven track record building and operating streaming platforms (Kafka/MSK) and API-based integrations, with strong Python and Java skills and experience with enterprise databases and query languages
  • Strong analytical thinking, curiosity about data, attention to detail, structured problem solving and ownership: able to drive topics to completion
  • Preferred certifications: Confluent Certified Developer for Apache Kafka, Microsoft streaming eventhubs, AWS
  • Certified Data Engineer

Please email a copy of your updated CV

For employers only

Is this your company's job post? Verify ownership to manage this listing and receive applications directly.

Claim this listing

Looking to apply for this job? Use the Apply button above.