Data Engineer – Data Services & Infrastructure

About the role

We are seeking a Data Engineer to design, build, and maintain scalable data pipelines and platforms that enable data‑driven decision‑making across Almosafer’s travel and tourism services. The role focuses on modern big‑data and AI‑driven ecosystems, supporting analytics and machine‑learning use cases.

Key responsibilities

• Design, develop, and optimise scalable data pipelines using Python or Java.
• Build and maintain ETL/ELT frameworks with Apache Spark (batch and streaming).
• Write advanced SQL queries for transformation, validation and analytics.
• Develop APIs to expose data to other services.
• Integrate data from multiple structured and unstructured sources.
• Collaborate with data scientists, analysts and product teams to support analytics and ML projects.
• Implement data validation, logging and error‑handling mechanisms.
• Optimise pipeline performance and manage large‑scale datasets.

Required profile

• Bachelor’s or Master’s degree in Computer Science, Engineering or a related field.
• 3+ years of hands‑on data engineering or big‑data development experience.
• Strong programming skills in Python and/or Java and Scala.
• Hands‑on expertise with Apache Spark (batch & streaming).
• Experience with scripting languages such as Bash or Shell.
• API development experience (Python, Java).
• Understanding of distributed systems and big‑data architectures.
• Good knowledge of AWS services (S3, RDS, Redshift, Glue, EMR, Athena, Lambda, etc.).
• Experience in data modelling, data warehousing and workflow orchestration (Apache Airflow).
• Exposure to GenAI integrations (LLMs, LangChain) is a plus.
• Strong problem‑solving, analytical and communication skills.

Required skills

• Python
• Java
• Scala
• Apache Spark
• SQL
• Bash / Shell scripting
• API development
• Distributed systems
• Big‑data architectures
• AWS (S3, RDS, Redshift, Glue, EMR, Athena, Lambda)
• Data modelling
• Data warehousing
• Apache Airflow
• GenAI integrations (LLMs, LangChain)