Data Engineer – Scalable Data Pipelines & AI Integration

About the role

Almosafer is seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that empower data‑driven decision‑making across the organization. You will work closely with data scientists, analysts, and product teams to support analytics and machine‑learning initiatives.

Key responsibilities

• Design, develop, and optimise data pipelines using Python or Java.
• Build and maintain ETL/ELT frameworks with Apache Spark (batch & streaming).
• Write advanced SQL queries for transformation, validation, and analytics.
• Develop APIs to share data with other services.
• Integrate data from multiple structured and unstructured sources.
• Implement data validation, logging, and error‑handling mechanisms.
• Optimise pipeline performance and manage large‑scale datasets.

Required profile

• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• 5+ years of hands‑on experience in data engineering or big‑data development.
• Strong programming experience in Python and/or Java and Scala.
• Hands‑on expertise with Apache Spark (batch & streaming).
• Experience with scripting (Python, Bash, Shell) and API development.
• Good knowledge of AWS services (S3, RDS, Redshift, Glue, EMR, Athena, Lambda, etc.).
• Experience with data modelling, data warehousing, and workflow orchestration tools such as Apache Airflow.
• Exposure to GenAI integrations (LLMs, LangChain) is a plus.

Required skills

• Python
• Java
• Scala
• Apache Spark
• SQL
• AWS (S3, RDS, Redshift, Glue, EMR, Athena, Lambda)
• Apache Airflow
• API development
• Data modelling & warehousing