Data Platform DevOps Engineer Contract

Role: Data Platform DevOps Engineer

Location: Dubai, United Arab Emirates

Engagement: Contractual

Duration: 12 Months (Extendable, Long-term with Marc Ellis)

Job Summary:

We are seeking a highly skilled Data Platform DevOps Engineer to support enterprise data workloads across Hadoop, Spark, and Oracle environments. The role focuses on building and optimizing CI/CD pipelines for database and PySpark deployments, enabling secure, scalable, and automated data platform operations across multiple environments. This role operates at the PaaS layer, supporting containerized and distributed data platforms using modern DevOps and Infrastructure as Code practices.

Education & Experience:

• 7+ years overall engineering experience.
• Minimum 5 years hands-on DevOps / Platform Engineering experience.
• Experience in large enterprise environments with high availability and scale.
• Bachelor’s degree in Computer Science, Engineering, or related discipline.

Key Responsibilities:

• Design, build, and manage CI/CD pipelines for Oracle database deployments (schemas, packages, procedures, custom scripts).
• Automate deployment pipelines for PySpark applications across Dev, UAT, and Production environments.
• Integrate PySpark unit and integration tests into CI/CD workflows.
• Implemen database version control and release automation strategies.
• Support and optimize Hadoop/Spark cluster workload deployments.
• Deploy and manage containerized workloads using OpenShift.
• Apply Infrastructure as Code (Terraform, Helm, etc.) to standardize platform provisioning.
• Enhance CI/CD processes using automation and AI-driven improvements.
• Ensure secure, compliant, and reliable platform deployments.
• Provide production support and troubleshooting for data platform environments.

Technical Skills:

• Strong CI/CD experience (Jenkins, GitHub Actions, ArgoCD, Azure DevOps).
• Hands-on experience automating Oracle DBA activities and custom Oracle script deployments.
• Experience deploying PySpark applications through CI/CD pipelines.
• Strong understanding of Hadoop ecosystem and Spark workloads.
• Hands-on experience with OpenShift / Kubernetes.
• Experience with HelmCharts and GitOps workflows.
• Proficiency in Python and/or Bash scripting.
• Strong Git/version control knowledge.
• Experience with DevSecOps tooling (SonarQube, Nexus, Checkmarx, etc.).
• Strong troubleshooting and production support capability.

Behavioral & Soft Skills:

• Self-motivated and proactive.
• Calm and composed under pressure, especially during production incidents.
• Strong problem-solving mindset with an automation-first approach.
• Strong communication skills and ability to collaborate across DevOps, Data Engineering, and DBA teams.
• Passionate about continuous improvement, learning, and innovation.