Data Engineer (Senior)

ROLE & RESPONSIBILITIES:

• Design, build and maintain scalable data pipelines and ETL workflows to ingest and transform data for analytics and reporting.
• Implement and optimize data storage solutions including data lakes and data warehouses on cloud platforms.
• Develop PySpark and Python applications for large-scale data processing and transformations.
• Ensure data quality, consistency and integrity through testing, validation and the use of data quality tools.
• Collaborate with stakeholders to translate business requirements into technical specifications and data models.
• Propose and review system and solution designs and evaluate technical alternatives.
• Maintain and operate cloud infrastructure and CI/CD pipelines for data platform components.
• Create and maintain technical documentation, runbooks and artefacts for developed solutions.
• Support production troubleshooting, monitoring and incident management for data services.
• Work closely with BI teams to prepare and optimize data for reporting tools such as Business Objects or Tableau.
• Coach and support fellow engineers, and help improve team capability through knowledge sharing and training.
• Participate in Agile ceremonies and contribute to continuous improvement of delivery processes.

• Minimum 3-5 years’ experience as a data engineer with demonstrated hands-on experience in Python, PySpark
• and cloud data services (AWS and/or OCI).
• Relevant IT/Computer Science/Engineering degree or equivalent proven experience; advanced degrees
• advantageous.
• Certifications such as AWS Certified Cloud Practitioner, Oracle Cloud certifications or other relevant cloud/data
• engineering certifications preferred