Vetted Model Evaluation Professionals

“Built and shipped a production LLM hallucination detection and monitoring pipeline using semantic-level entropy (embedding-clustered multi-generation variance) to flag unreliable outputs in downstream automation. Implemented a scalable async architecture (FastAPI + Docker + Redis/Celery) with strong observability (structured logs + PostgreSQL) and developed evaluation loops combining controlled prompts and human review; also partnered with non-technical stakeholders on AI-driven form validation/document processing.”

“ML-focused builder who has shipped an end-to-end income-class prediction product: built the data pipeline, trained models, deployed via Streamlit with a live UI, and tracked success via accuracy (84%), adoption, and latency. Demonstrates strong practical MLOps instincts (Docker/Streamlit Cloud, logging/monitoring, caching) and data engineering reliability patterns (schema checks, idempotency, retries, backfills) while iterating quickly in ambiguous, solo-project environments.”

“Backend/platform engineer who built an LLM-driven QA automation system (“mockmouse”) using a Flask orchestration microservice, Socket.IO real-time updates, Redis caching, and strict Pydantic schemas to turn prompts into reliable action graphs and automated browser tests. Has hands-on Kubernetes delivery experience (Docker/Helm/Jenkins) and has supported large migration programs, validating ETL cutovers with 1M+ synthetic records and rigorous output comparisons; also built event-driven monitoring/anomaly detection streaming into Grafana.”

“Building and deploying production in-house, domain-specific LLM chatbots for enterprises that cannot use third-party GPT tools due to internal policies. Focused on reducing latency and improving domain awareness using fine-tuning, continual learning, and advanced RAG/agent retrieval strategies, with experience orchestrating multi-agent workflows via LangChain/LlamaIndex and vector DBs (FAISS, Weaviate, Chroma).”

“ML practitioner who built a production customer risk scoring system to replace slow manual approvals, owning the full pipeline from feature engineering and XGBoost training to deploying a Dockerized FastAPI prediction service. Emphasizes reliability and business-aligned evaluation (recall/ROC-AUC, threshold tuning, drift monitoring) and is comfortable translating model decisions into stakeholder metrics like conversion rate (experience at EasyBee AI).”

“Machine learning lab assistant at Eastern Illinois University who productionized a voice-enabled conversational AI system: redesigned it with RAG, LoRA fine-tuning (including text-to-SQL), and safety guardrails, then deployed a scalable API supporting ~1,000 daily queries. Also partnered with customer-facing teams during a BlueFi internship by building demos/APIs and accelerating releases via Terraform + AWS CI/CD automation.”

“Built a voice-driven desktop assistant for users with mobility impairments, integrating Whisper and Google Gemini and adding voice-authentication via speaker embeddings for secure command execution. Has hands-on experience with AWS serverless/microservices patterns (Lambda, S3, CloudFront, CloudWatch) and CI/CD, plus built an internal MySQL-to-MongoDB migration tool used by the CTO and dev team with an emphasis on safe, low-impact data transformation.”

“Master’s thesis focused on building and deploying a gait-based biometric authentication system using mobile accelerometer time-series data as an alternative to passwords/2FA. Emphasized real-world robustness by addressing sensor noise and variability (phone placement, walking speed, footwear) and improving safety using biometric metrics like FAR/FRR and EER, while collaborating closely with a non-ML thesis advisor.”