Sr AI Engineer

<h2>Databricks</h2><ol>
<li>Design and build pipelines for ingesting data into Databricks from various sources like SAP, website scraping. Core technical skill will be PySpark and PySQL</li>
<li>Write and do scenario-based testing, edge cases and discuss with the stake holders to finalize the necessary code changes and acceptance criteria.</li>
<li>Understanding of the Databricks Unity Catalog permissions model and how to use OBO tokens and configure Service Principals for Databricks Agents,Genie Spaces, Machine Learning and Foundation Models.</li>
<li>Knowledge of Databricks Apps. Ability to build and Deploy Databricks Apps using Visual Studio Code.</li>
<li>Sending custom notifications from Databricks using APIs to custom Team Channel Webhooks</li>
</ol><h2>AI:</h2><ol>
<li>Ability to use FastAPI /React front end and build minimal Single Page Applications(SPAs) using Chat UI interfaces and Claude Models/APIs</li>
<li>Ability to use defined System Prompts, User Prompts etc..(i..e,) skills in prompt engineering.</li>
<li>Basic Knowledge of Token Economics and ability use rule enforcement in prompts in addition to standard NLP language.</li>
<li>Ability to reengineer code and see what it does and map it to the requirement specifications from users</li>
<li>Ability to use Graphs to detect inter dependencies between rules and circular references.</li>
<li>Ability to use both Claude Vision API in addition to standard text processing.</li>
<li>Understand and develop Retrieval Augmented Generation specifically to Databricks like AI Search indexes, Hierarchical Chunking etc..</li>
<li>Know how to implement basic guard rails related to AI safety</li>
<li>Understand various caching mechanisms</li>
</ol><h2>Tools:</h2><ol><li>Ability to work with Claude Code and Genie.</li></ol>