About the job Remote | Hindi Audio Transcription & AI Evaluation Specialist — Up to $45/hour
We are sharing a specialised part-time consulting opportunity for Hindi-speaking professionals based in the San Francisco Bay Area with strong transcription, writing, linguistic analysis, annotation, and structured evaluation skills.
This short-term role supports an audio AI research initiative focused on training and benchmarking advanced language models. Selected professionals will transcribe Hindi audio and video content, evaluate model-generated outputs, develop bilingual grading standards, and document linguistic nuances across contemporary Hindi, regional variation, and Hindi-English code-switching.
Key Responsibilities
Hindi Audio & Video Transcription
- Listen to, analyse, and transcribe Hindi-language audio and video content
- Produce accurate written outputs in Hindi, with supporting English content when required
- Follow detailed formatting, stylistic, and task-specific instructions
- Capture tone, intent, register, pronunciation, regional vocabulary, and dialectal variation
- Review completed transcripts for clarity, completeness, and linguistic accuracy
Evaluation Standards & Rubric Development
- Define expectations for correct and high-quality responses in general consumer audio contexts
- Develop detailed evaluation rubrics and grading instructions in Hindi and English
- Document scoring standards that can be applied consistently across reviewers
- Identify grammatical complexities, colloquialisms, code-switching patterns, and language-specific edge cases
- Refine guidelines when ambiguity or inconsistent interpretation arises
Model Testing & Output Evaluation
- Run assigned prompts through language models and review generated responses
- Evaluate outputs for accuracy, completeness, fluency, relevance, and instruction adherence
- Assess whether model responses appropriately reflect spoken Hindi and contemporary usage
- Identify transcription errors, unnatural phrasing, missed context, and linguistic inconsistencies
- Provide structured written feedback supporting model improvement
Benchmarking & Quality Assurance
- Participate in review and quality-assurance cycles across tasks, rubrics, and outputs
- Maintain consistency before materials are incorporated into formal evaluation benchmarks
- Review the work of other contributors when required
- Collaborate with project leads to resolve unclear instructions and improve task design
- Apply feedback and calibration standards consistently across assignments
Ideal Profile
Strong candidates may have:
- Native or near-native spoken and written fluency in Hindi
- Professional fluency in English
- Current residence in the San Francisco Bay Area
- Strong familiarity with contemporary spoken Hindi, regional vocabulary, dialects, and informal usage
- Ability to recognise and evaluate Hindi-English code-switching
- Excellent writing, editing, critical-thinking, and analytical skills
- Experience accurately transcribing and analysing audio content
- Ability to work independently, manage deadlines, and follow detailed instructions
- Availability to contribute approximately 10–20 hours per week
Educational Background
- Current college students and recent graduates may be considered
- A background in linguistics, translation, localisation, humanities, journalism, social sciences, communications, or a technical discipline is helpful
- Academic or practical experience involving language analysis, research, annotation, or audio transcription is highly relevant
- Equivalent professional experience in Hindi-language content or evaluation work may also be considered
Nice to Have
- Previous experience with Hindi transcription, annotation, localisation, or language-quality review
- Familiarity with regional Hindi variation and contemporary colloquial language
- Experience reviewing Hinglish or other Hindi-English code-switching patterns
- Background in research, benchmarking, data annotation, or structured evaluation workflows
- Familiarity with generative AI, language models, speech technology, or applied language research
- Experience developing grading rubrics, reviewer guidelines, or quality standards
- Comfort participating in occasional in-person collaboration within the San Francisco Bay Area when required
Why This Opportunity
- Apply Hindi-language expertise to an advanced audio AI research initiative
- Work across transcription, linguistic analysis, rubric development, and model evaluation
- Help improve how language models understand contemporary and regionally varied Hindi
- Contribute to high-quality benchmarks used in audio and language-model research
- Participate in flexible part-time work with competitive hourly compensation
Contract Details
- Independent contractor role
- Primarily remote with flexible scheduling
- Candidates must be based in the San Francisco Bay Area
- Occasional in-person collaboration may be requested
- Expected commitment of approximately 10–20 hours per week
- Competitive compensation of up to $45 per hour depending on expertise and project scope
- Short-term, structured project engagement
- The selection process may include an AI-led interview lasting approximately 15 minutes
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or adjusted depending on scope and performance
- Work will not involve access to confidential or proprietary information from any employer, client, or institution
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.