Data Integration Engineer (Databricks / Python / SQL)

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

Our client is a Big4 Consultancy group that works with leading financial institutions onAI-driven transformation, automation, advanced analytics, and financial crime prevention. Their are building a production-gradeAI-assisted KYC / Customer Due Diligence platformfor an international insurance environment.

We are looking for an experiencedData / Integration Engineerto own the data flowing into and out of the platform. The role focuses onDatabricks, Python / PySpark, SQL, data modelling, data contracts, APIs, legacy-system integration, and data quality, replacing mocked sources with reliable production integrations.

CONTRACT: B2B or B2C contract

COMMITMENT:Full-time, 3-4 months contract with possibility of extension or getting on new projects

LOCATIONS: Remote, EU-based candidates

START: ASAP

PROCESS: Initial qualification followed by client interviews

Responsibilities

• Inventory and map all internal and external data sources.
• Definedata contractsand canonical data structures for client, screening, evidence, audit, and reporting data.
• Build connectors to external screening providers, public registers, and local data sources.
• ConnectDatabrickswith SQL Server, legacy databases, and core enterprise systems.
• Support API, database-link, batch, file, and SFTP-based integrations.
• Design and maintain data models supporting evidence, audit trails, and reporting.
• Implementdata quality checks, contract tests, and retention rules.
• Validate incoming and outgoing data flows across production services.
• Support integration troubleshooting and production-readiness activities.
• Contribute to a business-critical platform where data accuracy and reliability are essential.

Requirements

• Strong hands-on experience withDatabricks, including Delta Lake and Unity Catalog.
• Strong experience withPython / PySpark.
• AdvancedSQLskills.
• Experience integrating withSQL Server and legacy databases.
• Strong experience withREST APIs, DB links, batch processing, files, and SFTP integrations.
• Experience withdata modelling and data-contract design.
• Experience implementing data-quality validation and integration testing.
• Fluent English and ability to work remotely within the EU.