Data Engineer – Scalable Data Pipelines & Infrastructure

About the role

We are seeking a Data Engineer to design, build and maintain scalable data pipelines and platforms that empower data‑driven decision‑making across Almosafer’s travel and tourism services. The role combines backend engineering expertise with modern big‑data and AI‑driven ecosystems to support analytics, machine‑learning and product initiatives.

Key responsibilities

• Design, develop and optimise data pipelines using Python, Java or Scala.
• Build and maintain ETL/ELT frameworks with Apache Spark (batch and streaming).
• Write advanced SQL queries for data transformation, validation and analytics.
• Develop APIs to expose data to internal services.
• Integrate data from diverse structured and unstructured sources.
• Collaborate with data scientists, analysts and product teams to enable analytics and ML use cases.
• Implement data validation, logging and error‑handling mechanisms.
• Optimise pipeline performance and manage large‑scale datasets.

Required profile

• Bachelor’s or Master’s degree in Computer Science, Engineering or a related field.
• 3+ years of hands‑on experience in data engineering or big‑data development.
• Strong programming background in Python and/or Java and Scala.
• Experience with Apache Spark, Bash/Shell scripting and API development.
• Good understanding of distributed systems, data modelling and data warehousing.
• Familiarity with AWS services such as S3, RDS, Redshift, Glue, EMR, Athena and Lambda.
• Experience with workflow orchestration tools like Apache Airflow.
• Excellent problem‑solving, analytical and communication skills.

Required skills

• Python
• Java
• Scala
• Apache Spark (batch & streaming)
• SQL
• Bash / Shell scripting
• API development (Python, Java)
• AWS (S3, RDS, Redshift, Glue, EMR, Athena, Lambda)
• Data modelling
• Data warehousing
• Apache Airflow
• GenAI integrations (LLMs, LangChain) – plus