Senior Data Engineer

Job Summary

We are seeking an experienced Senior Data Engineer to design, implement, and maintain our data infrastructure and pipelines. The ideal candidate will have a strong background in data engineering, big data technologies, and cloud platforms. You will work closely with data scientists, analysts, and other stakeholders to ensure efficient and reliable data processing and storage solutions.

Key Responsibilities:

• Design, develop, and maintainscalabledata pipelines and ETLprocesses
• Implement and optimizedata storage solutions, including data warehouses and data lakes
• Collaborate withdata scientists and analyststo understand data requirements and provide efficient data access
• Ensuredata quality, consistency, and reliabilityacross all data systems
• Develop and maintaindata models and schemas
• Implementdata security and access control measures
• Optimizequery performance and data retrieval processes
• Evaluate and integrate new data technologies and tools
• Mentor junior data engineers and provide technical leadership
• Collaborate with cross-functional teams to support data-driven decision-making

Requirements

• Bachelor's or Master's degree inComputer Science, Engineering, or a related field
• 5+ yearsof experience indata engineering or related roles
• Strong programming skills inPython, Java, or Scala
• Extensive experience withbig data technologiessuch asHadoop, Spark, and Hive
• Proficiency inSQLand experience with both relational andNoSQL databases
• Experience with cloud platforms(AWS, Azure, or GCP)and their data services
• Knowledge of data modeling,data warehousing, and ETLbest practices
• Familiarity with data visualization tools(e.g., Tableau, Power Bl)
• Experience with version control systems(e.g., Git)andCI/CD pipelines
• Strong problem-solving skills and attention to detail
• Excellent communication and collaboration skills

Additional Preferred Qualifications

• Experience with stream processing technologies(e.g., Kafka, Flink)
• Knowledge ofmachine learning and Altechnologies
• Familiarity withdata governance and compliance requirements
• Experience with containerization and orchestration tools(e.g., Docker, Kubernetes)
• Contributions toopen-source projects or relevant certifications
• Experience inAzure big data platform (ADF, Databrick)
• Experience inPowerBl