Sr. Data Engineer, Onboarding

<h3>Accountabilities</h3><li>
<strong>Design and optimize data pipelines:</strong>Build, maintain, and scale ETL/ELT pipelines using Databricks, PySpark, and Python, following a Bronze/Silver/Gold lakehouse architecture.</li><li>
<strong>Lead healthcare data onboarding:</strong>Ingest, parse, transform, and map healthcare claims data, including 837I/P/D transactions, 835 remittance advice, and EMR records, into the appropriate data models.</li><li>
<strong>Develop data warehouse solutions:</strong>Build and optimize Snowflake data models, SQL transformations, and data warehousing processes to support reliable reporting and analytics.</li><li>
<strong>Manage data migration:</strong>Lead the conversion and migration of data from legacy systems, including Microsoft SQL Server, into modern cloud-based data platforms.</li><li>
<strong>Drive automation and efficiency:</strong>Develop reusable frameworks, tools, and automated workflows that reduce manual effort, improve data accessibility, and enhance pipeline performance and cost efficiency.</li><li>
<strong>Ensure data quality and reliability:</strong>Implement validation checks, reconciliation processes, and monitoring solutions to identify discrepancies and maintain accurate, consistent data feeds.</li><li>
<strong>Integrate healthcare systems:</strong>Connect and validate EMR data from platforms such as Epic, Cerner, Meditech, and Athenahealth with claims data to enable comprehensive reporting.</li><li>
<strong>Resolve complex technical issues:</strong>Investigate ingestion and integration failures, perform root-cause analysis, implement permanent fixes, and address escalations promptly.</li><li>
<strong>Collaborate across teams:</strong>Partner with Implementation, Product, Support, and IT stakeholders to define requirements, establish data mappings, prioritize deliverables, and maintain project timelines.</li><li>
<strong>Provide technical leadership:</strong>Mentor junior engineers, conduct code reviews, share technical knowledge, and promote engineering standards and best practices.</li><li>
<strong>Manage documentation and handoffs:</strong>Maintain technical documentation, data flow diagrams, pipeline specifications, and operational runbooks to support ongoing maintenance and smooth transitions to Support teams.</li><li>
<strong>Maintain security and compliance:</strong>Follow HIPAA and other applicable regulatory requirements while safeguarding healthcare data and preserving its integrity.</li><li>
<strong>Support continuous improvement:</strong>Track project progress, communicate risks, provide regular stakeholder updates, and identify opportunities to improve data engineering processes and operational outcomes.</li><h2>Requirements</h2><li>
<strong>Education:</strong>Bachelor's degree in Computer Science, Data Science, Health Informatics, Information Systems, or a related discipline, or equivalent professional experience.</li><li>
<strong>Professional experience:</strong>At least 8 years of experience in data engineering, ETL/ELT development, and data warehousing.</li><li>
<strong>Programming expertise:</strong>At least 3 years of hands-on experience with Python and advanced SQL for data transformation, automation, and analytics.</li><li>
<strong>Databricks and PySpark:</strong>At least 2 years of practical experience with Databricks, including Delta Lake, notebooks, jobs, and workflows, alongside strong PySpark skills.</li><li>
<strong>Snowflake:</strong>Working experience with Snowflake, including data modeling, SQL transformations, and warehouse optimization.</li><li>
<strong>Healthcare industry knowledge:</strong>At least 2 years of healthcare experience, preferably in revenue cycle management (RCM), with a solid understanding of medical billing, claims processing, and reimbursement models.</li><li>
<strong>Healthcare data standards:</strong>Working knowledge of healthcare EDI and X12 transaction formats, particularly 837 claims and 835 remittance transactions.</li><li>
<strong>Cloud platforms:</strong>Experience with cloud environments such as AWS or Microsoft Azure.</li><li>
<strong>Data engineering best practices:</strong>Ability to develop scalable pipelines, implement automated data quality controls, troubleshoot complex integrations, and optimize data processing workflows.</li><li>
<strong>Analytical and problem-solving skills:</strong>Strong attention to detail and the ability to identify data inconsistencies, investigate root causes, and deliver effective technical solutions.</li><li>
<strong>Communication and collaboration:</strong>Excellent written and verbal communication skills, with the ability to work effectively with both technical and non-technical stakeholders.</li><li>
<strong>Leadership and mentoring:</strong>Demonstrated ability to guide less experienced engineers, review code, share knowledge, and influence technical decisions.</li><li>
<strong>Project management:</strong>Ability to manage multiple priorities, communicate progress and risks proactively, and deliver high-quality work in a fast-paced environment.</li><li>
<strong>Security awareness:</strong>Understanding of healthcare data privacy, HIPAA requirements, and secure data handling practices.</li><h2>Benefits</h2><li>
<strong>Competitive salary:</strong>Annual compensation ranging from<strong>$140,000 to $150,000</strong>.</li><li>
<strong>Fully remote work:</strong>Work remotely from the United States.</li><li>
<strong>Comprehensive healthcare coverage:</strong>Medical, dental, and vision insurance.</li><li>
<strong>Retirement savings:</strong>401(k) plan with an employer match.</li><li>
<strong>Unlimited paid time off:</strong>Flexible vacation policy designed to support rest and work-life balance.</li><li>
<strong>Professional development:</strong>Access to on-demand learning resources, career advancement opportunities, and continuous learning initiatives.</li><li>
<strong>Inclusive workplace:</strong>A commitment to diversity, equity, inclusion, and a culture that values different backgrounds and perspectives.</li><li>
<strong>Employee recognition:</strong>Peer-nominated awards and recognition programs that celebrate individual and team contributions.</li><li>
<strong>Remote team activities:</strong>Opportunities to participate in virtual cooking classes, yoga sessions, and other team-building activities.</li><li>
<strong>Meaningful impact:</strong>The opportunity to improve healthcare data infrastructure and support revenue cycle and compliance operations for healthcare organizations nationwide.</li>