India - Senior Data Engineer (Contractual Remote Opportunity)

About Inchcape Shipping Services At Inchcape, our vision is to have a connected world, in which our customers trade successfully and make better decisions in every port, everywhere. We use technology and our global network to help our partners connect to a smoother, smarter ocean. Inchcape combines its worldwide infrastructure with local expertise through our global network of over 250 proprietary offices, across 70 countries and a team of more than 3,000 committed professionals. Our diverse global customer base includes owners and charterers in the oil, cruise, container, and bulk commodity sectors as well as naval, government and intergovernmental organizations. We have an ambitious growth model and a career here is certainly going to be a rewarding one that will allow you to bring your skills & experience. We embrace change and are open to new thinking and pushing for positive change in our industry. Note: This role is on a contract basis & the duration of contract will be 3-4 months .It can be extendable as per the business need. Main Purpose of Job The Senior Data Engineer designs, builds and maintains the data ingestion and transformation pipelines that populate Inchcape s central data platforms. This role ingests raw data from diverse systems, curates the bronze and silver layers of the medallion architecture, ensures data quality and performance, and delivers reliable, reusable datasets for modelling, analysis, reporting and BI. Key Accountabilities • Develop and maintain ETL/ELT pipelines to ingest data from ERP, CRM, operational, financial, and third party sources into the Microsoft Fabric Platform - Lakehouse (OneLake) using Delta Lake/Parquet. • Implement data quality standards and controls, incremental loading, CDC and error handling to ensure reliability and correctness. • Create bronze tables, curated Silver and gold tables by transforming, cleansing and conforming raw data, document lineage and transformations. • Optimise performance through partitioning, clustering and tuning of MS Fabric, SQL and Spark workloads, monitor pipeline health and costs. • Collaborate with Data Architects, Modellers and Data BAs to design schemas, naming conventions and integration patterns to ensure business self-service enablement through Gold data. • Build reusable components, templates and automation scripts using Fabric Dataflows Gen2, Spark notebooks or equivalent tools. • Maintain metadata and sensitivity labels via Purview, ensure proper access controls and compliance. • Research and evaluate new features and patterns in Microsoft Fabric and make recommendations for adoption, enabling an AI-driven data strategy. • Introduce the most economic, optimised technique in the data integration space to reduce total operational cost. • Ensure NFR requirements like resilience, availability and security standards are applied as per agreed NFR metrics. Key Deliverables • Automated, documented ingestion pipelines with monitoring and alerting. • High quality conforming bronze, silver and gold data assets that are ready for self-service. • Performance benchmarks and tuning reports demonstrating efficient resource usage. • Contribution to ingestion templates, best practice guides and knowledge sharing. • Low-Level Designs for data pipelines and other data integration-related assets. Essential • 8+ years in data engineering or data integration roles, working with SQL, Python and or Scala. • Experience of ETL/ELT patterns, CDC, incremental loading and data warehousing principles using Microsoft Fabric. • Practical experience with Delta Lake, Lakehouse/Medallion architecture and cloud data platforms (Azure and AWS). • Proficient in building pipelines with tools like MS Fabric Dataflows Gen2, Spark/SQL notebooks or equivalent. • Experienced in data quality frameworks and monitoring/observability tools. • Ability to collaborate across teams and communicate technical concepts to non engineers. Desirable • Experience with streaming data (Kafka, Event Hubs) or real time ingestion. • Knowledge of master data management and data governance practices. • Familiarity with version control and CI/CD for data pipelines. • Experience in, and assisted in, the implementation of governance, controls, and standards. • Any Shipping or Maritime experience • Big Data Ecosystem prior experience is a plus. Educational & Professional Qualification: Essential • Bachelor s degree in computer science, engineering or related discipline. • Certification in Azure Data Engineering is a MUST. Desirable • Certifications in AWS cloud data platform or other data platform. Plus much more! Why Inchcape Shipping Services? We believe in building a diverse and high-performing workforce that works together to provide our customers with the exceptional service they deserve. To reach the highest standards, we depend on our people, their welfare, training, and expertise. We realize the value of our staff and know that you...