Data Engineer – Scalable Data Pipelines & Big Data

About the role

We are seeking a Data Engineer to design, build, and maintain scalable data pipelines and platforms that empower data‑driven decision‑making across Almosafer’s travel and tourism ecosystem. The role combines backend engineering expertise with modern big‑data and AI‑driven technologies.

Key responsibilities

• Design, develop, and optimise data pipelines using Python, Java or Scala.
• Build and maintain ETL/ELT frameworks with Apache Spark (batch and streaming).
• Write advanced SQL queries for transformation, validation and analytics.
• Develop APIs to expose data to other services.
• Integrate data from diverse structured and unstructured sources.
• Collaborate with data scientists, analysts and product teams to support analytics and machine‑learning use cases.
• Implement data validation, logging and error‑handling mechanisms.
• Optimise pipeline performance and manage large‑scale datasets.

Required profile

• Bachelor’s or Master’s degree in Computer Science, Engineering or related field.
• 5+ years of hands‑on data engineering or big‑data development experience.
• Strong programming skills in Python, Java and/or Scala.
• Deep expertise with Apache Spark (batch & streaming).
• Experience with scripting (Python, Bash, Shell) and API development.
• Solid understanding of distributed systems and big‑data architectures.
• Proficiency with AWS services such as S3, RDS, Redshift, Glue, EMR, Athena and Lambda.
• Experience in data modelling, data warehousing and workflow orchestration (e.g., Apache Airflow).

Required skills

• Python
• Java
• Scala
• Apache Spark
• SQL
• Bash / Shell scripting
• API development
• AWS (S3, RDS, Redshift, Glue, EMR, Athena, Lambda)
• Data modelling
• Data warehousing
• Apache Airflow
• GenAI integrations (LLMs, LangChain) – plus