Santhi Sampath Gamidi

About

Built a production-grade LLM evaluation and regression system that stress-tests models across hundreds of iterations, combining LLM-as-judge, semantic similarity, statistical metrics, and rule-based checks, with results delivered via stakeholder-friendly HTML reports and dashboards. Experienced orchestrating multi-agent RAG workflows using LangChain/LangGraph and event-driven GenAI pipelines in n8n integrating OCR, speech-to-text, and external APIs, with strong emphasis on reliability, observability, and explainable failures.

Key Strengths

• built and deployed an end-to-end LLM stress-test/evaluation pipeline in production
• designs evaluations around semantic intent to manage LLM variability and reduce false positives
• production reliability engineering for LLM systems (rate limits, parallelism, retries, batching)
• creates explainable evaluation outputs (HTML reports/dashboards) for technical and non-technical stakeholders
• structured, layered testing strategy (unit/contract/scenario + multi-iteration stability tests)
• data-driven model/retrieval/prompt selection based on constraints (accuracy, latency, cost, consistency)

Experience

Education

Skills

Languages