AWS Glue Data Pipeline Tester

<h2>The candidate should be able to define and validate data quality rules covering:</h2><ul>
<li>Completeness</li>
<li>Accuracy</li>
<li>Consistency</li>
<li>Validity</li>
<li>Uniqueness</li>
<li>Timeliness</li>
<li>Referential integrity</li>
<li>Conformity to business rules</li>
<li>Schema and metadata consistency</li>
</ul><h2>Testing Areas</h2><h2>The role will include the following types of testing:</h2><ul>
<li>Functional testing</li>
<li>End-to-end integration testing</li>
<li>Data validation testing</li>
<li>Source-to-target reconciliation</li>
<li>Parallel Testing with legacy interfaces testing.</li>
<li>Regression testing</li>
<li>System integration testing</li>
<li>User acceptance testing support</li>
<li>Negative testing</li>
<li>Exception and error-path testing</li>
<li>Performance and volume testing</li>
<li>Scalability testing</li>
<li>Restart and recovery testing</li>
<li>Failover and resiliency testing</li>
<li>Security and access testing</li>
<li>Production smoke testing</li>
<li>Operational and monitoring validation</li>
</ul><h2>Requirements</h2><ul>
<li>AWS Glue Jobs</li>
<li>AWS Glue Workflows</li>
<li>Amazon S3</li>
<li>Amazon CloudWatch</li>
<li>AWS IAM</li>
<li>Amazon EventBridge</li>
<li>AWS Lambda</li>
<li>Amazon SNS</li>
<li>Amazon SQS</li>
<li>AWS Secrets Manager</li>
<li>AWS Step Functions</li>
<li>AWS KMS</li>
<li>Ability to review AWS Console configurations, job parameters, logs, metrics, and execution history.</li>
<li>Data Pipeline and File Processing Interface Testing</li>
<li>Strong understanding of Inbound and Outbound Data File Processing / Data Pipeline.</li>
<li>Experience testing inbound/outbound file transfers across S3, SFTP/FTPS, AWS Transfer Family, APIs, and external partner endpoints, including authentication, connectivity, retry, timeout, and delivery validation.</li>
</ul>