Legal Expert - AI Training & Evaluation

<h3>Accountabilities:</h3><li>Design complex, realistic legal tasks covering legal research, contract interpretation, regulatory compliance, and advanced legal reasoning.</li><li>Develop clear, accurate, and defensible reference answers that establish the expected standard of legal analysis and reasoning.</li><li>Evaluate AI-generated legal responses line by line, assessing their factual accuracy, legal soundness, reasoning quality, and completeness.</li><li>Identify errors such as fabricated case law, misinterpreted contractual clauses, overlooked legal exceptions, unsupported conclusions, and misleading reasoning.</li><li>Provide detailed, evidence-based explanations of evaluation decisions, highlighting errors and clarifying the correct legal interpretation.</li><li>Apply rigorous legal judgment to distinguish genuinely correct answers from responses that appear convincing but contain substantive inaccuracies.</li><li>Work across multiple areas of law, applying strong research methods and analytical skills to varied legal questions and scenarios.</li><li>Ensure that submitted tasks meet high standards of precision, consistency, clarity, and professional quality.</li><li>Incorporate feedback and maintain reliable turnaround times to support project deadlines and evaluation standards.</li><li>Contribute to improving the performance, reliability, and practical usefulness of AI models in legal research, contract review, and compliance-related applications.</li><h2>Requirements:</h2><li>
<strong>Professional experience:</strong>At least 3 years of relevant legal experience as a practicing lawyer or legal professional, whether in private practice, a law firm, or an in-house legal department.</li><li>
<strong>Legal research:</strong>Strong research skills, including the ability to identify relevant legal authorities, assess their applicability, and support conclusions with reliable evidence.</li><li>
<strong>Analytical reasoning:</strong>Demonstrated ability to break down complex legal questions, interpret facts and legal principles, and develop logically sound conclusions.</li><li>
<strong>Contract analysis:</strong>Comfortable reviewing contractual provisions, identifying ambiguities and risks, and interpreting clauses in their legal and commercial context.</li><li>
<strong>Regulatory and compliance knowledge:</strong>Ability to analyze regulatory requirements and apply relevant legal principles to practical scenarios.</li><li>
<strong>Legal writing:</strong>Excellent written communication skills, with the ability to produce precise, structured, and well-supported legal analyses without unnecessary detail.</li><li>
<strong>Attention to detail:</strong>Strong commitment to accuracy and a high standard of scrutiny when reviewing legal arguments, citations, interpretations, and conclusions.</li><li>
<strong>Critical evaluation:</strong>Ability to identify subtle legal errors, unsupported claims, fabricated authorities, missing exceptions, and plausible-sounding but incorrect reasoning.</li><li>
<strong>Adaptability:</strong>Willingness to work across different legal subject areas and evaluate varied scenarios rather than focus exclusively on a single specialized niche.</li><li>
<strong>Reliability and time management:</strong>Ability to manage independent, task-based assignments and consistently deliver high-quality work within agreed deadlines.</li><li>
<strong>Interest in AI:</strong>Genuine curiosity about the application of artificial intelligence to legal services and motivation to help improve how AI systems perform complex professional tasks.</li><li>
<strong>Independent working style:</strong>Ability to work autonomously in a remote environment, exercise sound professional judgment, and incorporate feedback when needed.</li><h2>Benefits:</h2><li>
<strong>Competitive task-based compensation:</strong>Earn ₹20,000–25,000 per task, with compensation focused on the depth, rigor, and quality of your work rather than hours logged.</li><li>
<strong>Fully remote opportunity:</strong>Work from anywhere in India without a daily office commute.</li><li>
<strong>Flexible schedule:</strong>Choose when to complete assignments around your existing legal practice, full-time employment, or other professional commitments, subject to agreed deadlines.</li><li>
<strong>Meaningful professional impact:</strong>Help shape how advanced AI models understand, analyze, and respond to complex legal questions.</li><li>
<strong>Exposure to advanced AI:</strong>Gain firsthand insight into how sophisticated AI models are trained, tested, and evaluated on real-world legal tasks.</li><li>
<strong>Intellectually challenging work:</strong>Engage in substantive legal problem-solving rather than repetitive administrative tasks or routine data entry.</li><li>
<strong>Performance-based opportunities:</strong>Access additional assignments and larger projects as your work demonstrates consistent quality and rigor.</li><li>
<strong>Collaborative project environment:</strong>Work with a fast-moving team focused on improving AI capabilities through expert-led evaluation and high-quality training data.</li><li>
<strong>Flexible engagement model:</strong>Participate in a project-based contract without fixed working days or a prescribed daily schedule.</li>