Senior ML Engineer

Senior ML Engineer
Role Overview
You will lead the creation and productionization of our AI-driven search pipeline — from building vector indexes and deploying RAG-based systems to designing scalable APIs. You’ll work closely with our engineering team to ingest structured legal data, vectorize it, and ensure seamless integration with our user-facing web application. This role requires both deep technical expertise, a product-focused mindset and an enthusiasm to learn new techniques in the fast changing AI landscape.
Key Responsibilities
1. AI Based Search Development & Optimization
Design and build AI-powered search models that improve retrieval and ranking of legal documents.
Implement retrieval-augmented generation (RAG) workflows using pre-trained LLMs (e.g., OpenAI GPT-4).
Fine-tune LLMs for legal use cases where necessary (experience with custom LLM training is a strong plus).
Improve search quality through relevance testing, feedback loops, and query understanding.
Research and implement any new techniques for improving search result relevancy.
2. Data Processing & Vector Indexing
Build pipelines to ingest, chunk, and vectorize legal texts (case law, statutes, etc.).
Create and maintain indexes in Vector Databases, supporting fast and relevant results.
Maintain an evolving legal search index by ingesting new documents on a weekly basis.
3. Model Deployment & API Development
Deploy ML models into production using Azure cloud infrastructure.
Develop REST APIs (with FastAPI or Flask) to expose model functionality to the application layer.
Monitor and optimize latency, scalability, and reliability of deployed solutions.
4. Collaboration & Product Integration
Work closely with product managers and full-stack engineers to ship ML-backed features.
Participate in design reviews and own technical decisions around AI architecture.
Track and improve system performance using user feedback, telemetry, and experimentation.
Tech Stack & Tools
ML/NLP: Python, PyTorch/TensorFlow, Hugging Face, Azure OpenAI APIs
Vector Search: Azure AI Search (primary), experience with FAISS, Pinecone or Elasticsearch a plus
Deployment: Azure (App Services, Azure Functions, Blob Storage, Key Vault)
Data Processing: Pandas, NumPy, spaCy, NLTK
APIs: REST APIs built with FastAPI or Flask
Required Skills & Experience
5+ years of experience in machine learning, NLP, or AI-based search systems.
Strong knowledge of vector search, document embeddings, and retrieval techniques.
Experience building and scaling RAG pipelines with LLMs.
Proficiency with Azure AI Search for document indexing and search optimization.
Demonstrated ability to deploy models to production and build robust APIs.
Familiarity with search ranking algorithms (BM25, hybrid search, learning-to-rank).
Experience working with document-heavy datasets in legal, academic, or enterprise domains.
Experience with fine tuning models and creation of datasets used in fine tuning.
On-site position for Lucknow, India.
Nice to Have
Background in legal tech, contract analysis, or legal document retrieval.
Exposure to open-source search frameworks like Elasticsearch or OpenSearch.
Knowledge of observability, logging, and system performance profiling.