Data Engineer – Build Scalable Data Pipelines

About the role

Nexttec Technology is seeking a skilled Data Engineer to design, build, and maintain robust data infrastructure. You will collaborate with data scientists, analysts, and IT teams to ensure reliable, efficient, and secure data processes.

Key responsibilities

• Design, develop, and optimise scalable ETL/ELT pipelines for batch and real‑time data ingestion.
• Integrate data from ERP systems (Oracle EBS, Fusion, NetSuite), REST APIs and external sources, handling pagination, rate limits and schema changes.
• Implement Lakehouse architecture with Bronze, Silver and Gold layers to deliver clean, analytics‑ready data.
• Maintain data pipelines on Microsoft Fabric (Data Pipelines, Lakehouse, Data Warehouse) and support transition to Google BigQuery.
• Automate CI/CD workflows for data pipelines and apply incremental loading techniques such as CDC.
• Ensure data security and compliance with GDPR, HIPAA and company policies, including backup and disaster recovery.
• Monitor performance, troubleshoot issues and optimise cost efficiency.

Required profile

• Proven experience designing and operating large‑scale data pipelines.
• Strong understanding of data integration from ERP and API sources.
• Ability to work closely with cross‑functional teams and translate business requirements into technical solutions.
• Commitment to data quality, security and regulatory compliance.

Required skills

• Microsoft Fabric components (Data Pipelines, Lakehouse, Data Warehouse)
• ETL/ELT design and implementation
• Real‑time streaming and batch processing
• Oracle EBS, Oracle Fusion, NetSuite integration
• REST API consumption and handling
• Google BigQuery
• CI/CD pipelines for data workflows
• Change Data Capture (CDC) techniques
• GDPR and HIPAA compliance practices
• Data backup and disaster recovery strategies