Team Lead Data Engineer

We are seeking a highly skilled and proactiveData Engineerto join our team. The ideal candidate will have strong hands-on expertise withAWS cloud services,Databricks,Apache Spark,Python, andSQL, along with excellent communication and stakeholder engagement skills. You will play a key role in designing, building, and optimizing data pipelines and analytics solutions that support critical business initiatives.Key Responsibilities

• Design, develop, and maintain scalabledata pipelinesand transformation workflows using Databricks and Spark.
• Build and optimizeETL/ELT processesto ingest, cleanse, and prepare large datasets.
• Work with AWS services such asS3, Lambda, IAM, ECS and CloudWatchto support data architecture and operational needs.
• Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and translate them into technical solutions.
• Ensure data quality, reliability, and performance across all data systems.
• Implement and enforcebest practicesfor coding, version control, CI/CD, and environment management.
• Monitor and troubleshoot data pipelines, ensuring high availability and timely delivery.
• Contribute to architectural decisions, documentation, and process improvements.

Requirements

• Strong hands-on experience withAWS Cloud(S3, Lambda, IAM, EC2 or equivalent).
• Extensive experience withDatabricks, Delta Lake, and Unity Catalog.
• Proficiency inApache Spark(PySpark preferred).
• Strong programming skills inPython.
• Excellent command ofSQL, including performance tuning and working with large datasets.
• Experience working in fast-paced, agile environments.
• Strong problem-solving abilities and a proactive approach to identifying improvements.
• Excellent communication and stakeholder management skills; able to collaborate across multiple teams.
• Experience with data governance frameworks and tools (e.g., DataHub, Soda).
• Experience with CI/CD tools (GitHub Actions).
• Availability:Required to support meetings and calls inUS Pacific Time (PT).
  
  Personal Attributes

• Proactive, self-driven, and highly accountable.
• Strong ownership mindset with the ability to work independently.
• Comfortable engaging with technical and non-technical stakeholders.
• Passion for building reliable, scalable, and high-quality data systems.

Benefits

We Offer

• Fun, happy and politics-free work culture built on the principles of lean and self organisation;
• Work with large scale systems powering global businesses;
• Competitive salary and benefits.

About Mindera

At Mindera we use technology to build products we are proud of, with people we love.

Software Engineering Applications, including Web and Mobile, are at the core of what we do at Mindera.

We partner with our clients, to understand their product and deliver high performance, resilient and scalable software systems that create an impact in their users and businesses across the world.

You get to work with a bunch of great people, where the whole team owns the project together.

Our culture reflects our lean and self-organisation attitude. We encourage our colleagues to take risks, make decisions, work in a collaborative way and talk to everyone to enhance communication.

We are proud of our work and we love to learn all and everything while navigating through an Agile, Lean and collaborative environment.

Check ot our Blog:http://mindera.com/and our Handbook:http://bit.ly/MinderaHandbook

Our offices are located: Aveiro, Portugal | Porto, Portugal | Leicester, UK | San Diego, USA | San Francisco, USA | Chennai, India | Bengaluru, India