IT Data Engineer

About the role

We are seeking a technically strong IT Data Engineer to design and build modern data platforms and scalable pipelines that power analytics and business intelligence across the organization.

Key responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines for data ingestion, transformation, and storage.
• Develop data pipelines using Microsoft Fabric components such as Data Pipelines, Lakehouse, and Data Warehouse.
• Implement real‑time and batch processing across multiple data sources.
• Create and manage Bronze, Silver, and Gold data layers to support reporting and analytics.
• Integrate data from ERP systems, APIs, and external sources while ensuring quality and consistency.
• Apply incremental loading, change tracking, and data synchronization techniques.
• Automate workflows and set up CI/CD pipelines for data engineering solutions.
• Optimize pipelines for performance, scalability, and cost efficiency.
• Enforce data security, governance, backup, and disaster‑recovery best practices.
• Collaborate with business and technology teams to translate requirements into scalable solutions.
• Provide clean, analytics‑ready data for BI and advanced analytics initiatives.
• Document architectures, integrations, and pipeline performance metrics.

Required profile

• 3–7 years of experience in data engineering or related fields.
• At least 3 years of hands‑on ETL development and cloud‑based data solutions.
• Strong experience with Microsoft Fabric and Azure data services.
• Proficiency in SQL and Python for data processing and automation.
• Experience with Apache Spark, preferably using PySpark.
• Understanding of Medallion Architecture (Bronze, Silver, Gold).
• Experience integrating ERP platforms, APIs, and external data sources.
• Knowledge of CI/CD pipelines and modern DevOps practices.
• Familiarity with data governance, lineage, and compliance frameworks.
• Experience with relational and NoSQL databases.
• Exposure to cloud platforms such as Azure, AWS, or Google Cloud is a plus.

Required skills

• Microsoft Fabric
• Azure (including OneLake and Azure data services)
• SQL
• Python
• Apache Spark / PySpark
• Medallion Architecture
• ETL / ELT pipeline development
• ERP integration
• API integration
• CI/CD and DevOps
• Data governance and lineage
• Relational databases
• NoSQL databases
• Cloud platforms (Azure, AWS, Google Cloud)