Engenheiro de Dados Sênior

<h3>Accountabilities:</h3><li>
<strong>Data Architecture and Solution Design:</strong>Design, develop, and maintain scalable data architectures using Microsoft Azure and Databricks, ensuring alignment with business objectives, technical requirements, and long-term platform needs.</li><li>
<strong>Lakehouse Architecture Implementation:</strong>Build and optimize modern Lakehouse solutions using Delta Lake and Unity Catalog to support reliable data storage, processing, access management, and analytics.</li><li>
<strong>Data Pipeline Development:</strong>Design, implement, maintain, and optimize robust data pipelines that support efficient ingestion, transformation, integration, and delivery of data across multiple sources.</li><li>
<strong>Advanced Data Processing:</strong>Leverage Apache Spark and PySpark to develop high-performance data processing solutions capable of handling large volumes of structured and unstructured information.</li><li>
<strong>Streaming and Real-Time Data:</strong>Support the development and optimization of streaming data architectures and processing workflows to enable timely insights and data-driven applications.</li><li>
<strong>Data Quality and Reliability:</strong>Establish and implement data quality controls, validation processes, and monitoring mechanisms to ensure accuracy, consistency, completeness, and reliability across data platforms.</li><li>
<strong>Data Governance and Security:</strong>Implement and maintain data governance frameworks, access controls, security policies, and metadata management practices to protect sensitive information and support compliance requirements.</li><li>
<strong>Platform Performance and Optimization:</strong>Monitor and optimize data workloads, infrastructure utilization, processing performance, and platform costs to ensure scalable and efficient operations.</li><li>
<strong>Analytics and AI Enablement:</strong>Develop and maintain data foundations that support business intelligence, advanced analytics, machine learning, and artificial intelligence initiatives.</li><li>
<strong>Technical Collaboration:</strong>Work closely with engineering teams, analytics specialists, business stakeholders, and international clients to translate requirements into effective technical solutions.</li><li>
<strong>Technical Documentation and Best Practices:</strong>Maintain architecture documentation, establish engineering standards, and promote best practices in data modeling, pipeline development, governance, and platform management.</li><li>
<strong>International Stakeholder Communication:</strong>Communicate technical concepts, architectural decisions, project progress, and recommendations clearly in English when collaborating with clients and teams in the United States and Canada.</li><h2>Requirements:</h2><li>
<strong>Professional Experience:</strong>Extensive experience as a Senior Data Engineer and/or Data Architect, with a proven track record of designing and implementing enterprise-scale data solutions.</li><li>
<strong>Databricks and Microsoft Azure:</strong>Advanced knowledge of Databricks and Microsoft Azure, including experience designing, deploying, and managing cloud-based data engineering platforms.</li><li>
<strong>Lakehouse Architecture:</strong>Strong experience with Lakehouse architecture principles, Delta Lake, and Unity Catalog, including data management, governance, and access control.</li><li>
<strong>Apache Spark and PySpark:</strong>Advanced proficiency in Apache Spark and PySpark for large-scale data processing, transformation, and workload optimization.</li><li>
<strong>Data Pipeline Engineering:</strong>Demonstrated experience building, maintaining, and optimizing scalable data pipelines and modern data platforms, with an understanding of performance, reliability, and operational efficiency.</li><li>
<strong>Data Engineering and Analytics:</strong>Strong understanding of data engineering principles, analytics requirements, data integration, and the preparation of reliable datasets for downstream consumption.</li><li>
<strong>Streaming Technologies:</strong>Experience designing or supporting streaming data solutions and processing architectures for real-time or near-real-time applications.</li><li>
<strong>Data Governance and Security:</strong>Knowledge of data quality management, metadata, governance frameworks, access controls, security practices, and data lifecycle management.</li><li>
<strong>Performance Optimization:</strong>Ability to identify bottlenecks, troubleshoot complex data workloads, and improve processing efficiency, scalability, and resource utilization.</li><li>
<strong>Advanced English Proficiency:</strong>Fluent English at an expert professional level, with the ability to communicate technical information effectively and collaborate directly with clients and teams in the United States and Canada.</li><li>
<strong>Communication and Collaboration:</strong>Strong interpersonal and communication skills, with the ability to work effectively across multidisciplinary and geographically distributed teams.</li><li>
<strong>Proactivity and Ownership:</strong>A proactive approach to problem-solving, with the ability to take initiative, anticipate challenges, and drive technical tasks through to completion.</li><li>
<strong>Prioritization and Adaptability:</strong>Strong organizational skills, a sense of urgency, and the ability to prioritize competing demands while maintaining high standards of quality.</li><li>
<strong>Remote Work Readiness:</strong>Ability to work independently in a fully remote environment while maintaining effective communication, accountability, and collaboration with international stakeholders.</li><li>
<strong>Contract Availability:</strong>Willingness to work under a Brazilian service-provider arrangement (Pessoa Jurídica – PJ) for an indefinite-term engagement.</li><h2>Benefits:</h2><li>
<strong>Fully Remote Work:</strong>Work remotely from Brazil, with flexibility in managing your work environment.</li><li>
<strong>Long-Term Opportunity:</strong>Indefinite-term contract offering the potential for continued professional engagement.</li><li>
<strong>Learning and Development:</strong>Access to learning incentive programs, including Udemy resources, to support technical development and continuous learning.</li><li>
<strong>Corporate English Classes:</strong>Access to corporate English lessons at affordable rates to strengthen professional communication skills.</li><li>
<strong>International Collaboration:</strong>Work with clients and technical teams in the United States and Canada, gaining exposure to international projects and engineering practices.</li><li>
<strong>Technical Growth:</strong>Expand your expertise in Databricks, Microsoft Azure, Lakehouse architecture, advanced data processing, and modern data platforms.</li><li>
<strong>Meaningful Technical Impact:</strong>Contribute to scalable data solutions that support analytics, streaming, and AI initiatives across business environments.</li><li>
<strong>Collaborative Environment:</strong>Work with multidisciplinary professionals in an environment that values innovation, knowledge sharing, proactive problem-solving, and technical excellence.</li>