Vetted A/B Testing Professionals

“Internship experience building a production LLM-powered podcast operations agent that automated lead intake (HubSpot), guest research, scheduling (Calendly), meeting-summary evaluation (Gemini), and human approval via Slack bot—while retaining rejected candidates for future outreach. Also contributed to ideation of a multi-agent orchestration framework with parsing and task routing, and emphasized reliability via structured prompts, HITL feedback, and prompt-based test sets.”

“LLM engineer who has deployed privacy-preserving, real-time workplace risk monitoring over massive enterprise chat/email streams, tackling latency, hallucinations, and extreme class imbalance with model benchmarking, RAG + fine-tuning, and a pre-filter alerting layer. Also built an agentic legal contract drafting system (Jurisagent) using LangGraph/LangChain with deterministic multi-agent control flow, structured outputs, and reliability-focused evaluation/telemetry.”

“Built and deployed a production healthcare medical review agent that automates call-transcript summarization and medication reconciliation using a hybrid deterministic + LangGraph-orchestrated LLM workflow. Demonstrates strong reliability engineering (guardrails, schema validation, confidence thresholds, golden/adversarial eval, Langfuse monitoring) in a regulated environment, delivering 60% lower latency and 70%+ efficiency gains while partnering closely with care managers and operations.”

“Backend engineer who owned the AI/data pipeline layer for an EV-charging management platform (Ampure Intelligence), ingesting real-time charger telemetry via OCPP and serving FastAPI APIs to web/mobile clients. Strong in production reliability for asynchronous systems (state reconciliation, idempotency), Kubernetes GitOps (ArgoCD), Kafka streaming, and zero-downtime cloud-to-on-prem migrations; also improved LSTM-based forecasting through targeted preprocessing.”

“Full-stack engineer (~4 years) who has owned and shipped customer-facing SaaS onboarding and a role-based real-time analytics dashboard using TypeScript/React with a modular backend. Experienced in microservices with RabbitMQ and strong observability practices (correlation IDs, structured logging, queue metrics), and built an internal deployment tracker integrated with CI/CD that replaced manual spreadsheet/Slack processes.”

“AI/LLM engineer at Capital One who deployed a production RAG-powered fraud analysis and document intelligence platform using LangChain, OpenAI, Pinecone, Kafka, and AWS. Focused on reliability in real-time investigations via hybrid retrieval, schema-validated outputs, and LLM verification loops, reporting review-time reduction from hours to minutes and ~99% fraud detection precision.”

“Built and productionized a RAG-based analytics Q&A assistant for a financial analytics team, enabling natural-language querying across 200+ datasets (SQL tables, PDFs, compliance docs, wikis) and cutting turnaround time by 60%. Deep experience delivering regulated, audit-ready LLM systems on Azure (Azure OpenAI + LangChain) with strict grounding/citations, hybrid retrieval, and AKS-based low-latency deployment, plus strong collaboration with compliance analysts and auditors via iterative Gradio demos.”

“ML/LLM engineer building production, real-time fraud detection for financial transactions using a two-tier architecture (fast ML + GPT) to deliver both low-latency decisions and analyst-friendly risk explanations. Experienced orchestrating end-to-end retraining, drift monitoring, and automated model promotion with Databricks Jobs/Workflows and MLflow, and partnering closely with fraud analysts to tune alerts, thresholds, and dashboards.”

“ML/LLM practitioner with production experience building a healthcare review sentiment pipeline (RateMDs) using Hugging Face Transformers plus a LangChain+FAISS RAG layer for interactive querying. Also led orchestration-driven optimization of Nike’s Fusion ETL pipeline, improving runtime efficiency by 20%, and has experience translating ML outputs into Tableau dashboards for non-technical healthcare stakeholders (e.g., readmission risk).”

“ML/AI engineer with production experience at Shopify and Intel, building a deep learning product ranking system that lifted add-to-cart ~14% and serving real-time similarity search via FAISS+Redis under <20ms latency at massive scale. Also deployed computer vision models to 100+ retail edge locations using Docker/Ansible/k3s with zero-downtime rollouts, and applies strong MLOps practices (A/B testing, canary/shadow, observability) plus performance optimization (OpenVINO, INT8).”

“Worked on payments and wallet transactions, with an emphasis on observability and root-cause analysis. Delivered end-to-end A/B testing optimization and implemented Jenkins-based CI/CD automation that reduced manual implementation to 35% and cut deployments to ~2 minutes, with attention to operational considerations like on-call/call rotations.”

“Founder/CTO who built and shipped a consumer subscription-bundling platform end-to-end (architecture, implementation, testing) and scaled it to thousands of customers and major partners. Previously led a major reliability overhaul at Chan Zuckerberg Initiative for a Google-Docs-like ed-tech product—boosted observability, introduced incident management, and migrated to a Docker-based scalable architecture. Heavy user of AI tools (Cursor/Claude) for development, testing, and code review, with a strong bias toward lightweight, fast-moving execution.”

“Full-stack engineer with hands-on ownership of a customer-facing advanced performance metrics experience in the Amazon S3 console, spanning React UI, Python/Node services, Redshift/RDS data access, and AWS IaC/CI-CD with CloudWatch/Route53 operational readiness. Demonstrates strong production instincts around resilience (partial failures, multi-region inconsistencies), progressive rollouts/feature flags, and reliable ETL/integration patterns (idempotency, backfills, reconciliation).”

“Backend engineer focused on scalable, security-first platform architecture—recently built an end-to-end centralized access-control system that launched successfully with ~50k early adopters and was designed to support ~10x traffic growth. Experienced in production authn/authz (token verification, handoff/session migration), and in de-risking migrations via feature flags, phased rollouts, A/B testing, and Splunk-based monitoring.”

“Growth and partnerships marketer with experience spanning Coca-Cola brand/creator collaborations and CMC Markets performance acquisition. Has sourced and closed a Hong Kong Disneyland partnership built around a digital game activation, and runs data-driven Google Ads GTM and funnel experiments (Search/YouTube/Demand Gen, retargeting, landing page CRO) focused on lowering CPA and increasing qualified leads.”

“Founding product designer at a startup building RealSpend, an AI-powered fintech product centered on conversational decision support (contextual insights and in-flow actions). Also designed the companion app for Lasso Loop, an in-home recycling appliance, translating an industrial process into a warm, kitchen-friendly UX using layered information architecture and progressive disclosure, with strong design-system alignment to React/Tailwind/Ant Design engineering stacks.”

“Built and deployed a production multi-agent RAG system at JPMorgan Chase to automate regulated credit analysis and compliance clause discovery across large internal policy/document libraries. Implemented LangGraph-based supervisor orchestration with structured state management (Azure OpenAI) to support long-running, resumable workflows, plus hybrid retrieval + re-ranking and guardrails for reliability. Strong at evaluation/observability (trace logging, LLM-judge, HITL) and at communicating results to non-technical stakeholders via Power BI embeds and Streamlit prototypes.”

“Built and shipped a production LLM-powered multi-agent RAG system to automate complex internal support workflows, integrating tool execution (SQL/APIs) with validation guardrails to reduce hallucinations. Optimized for real-world latency and cost via model routing, caching, and async parallel tool calls, and enforced reliability with CI-gated golden test sets derived from anonymized production queries.”

“Built a production LLM-powered RAG agent for healthcare/insurance operations that retrieves and summarizes patient medical documents with grounded citations, scaling to ~4.5M records. Addressed medical shorthand and terminology by fine-tuning ~120 lightweight DistilBERT models by specialty and validating entities against SNOMED/RxNorm, while using SHAP/LIME and human-in-the-loop review to make decisions explainable to stakeholders.”

“VP-level marketing leader in proptech/real estate marketplaces who blends brand strategy with performance rigor. Repositioned RentSpree with a full narrative/IA and cross-channel messaging overhaul driving +32% conversions and major signup growth, and built an internal AI copy assistant to scale on-brand content across teams. At QuintoAndar, created the company’s first 360 mass media acquisition engine, delivering significant lifts in direct traffic, visits, and contracts while implementing CAC guardrails and MMM-style measurement.”

“Product/UX designer with hands-on experience designing AI-driven products end-to-end, including an AI shopping assistant (Stylaire) with multimodal conversational search (text/voice/image). Uses rapid prototyping and usability testing to simplify complex flows (e.g., reducing filter overload via progressive disclosure) and collaborates closely with engineers with working knowledge of HTML/CSS and component systems.”

“AI engineer with production experience building a high-accuracy (98%) fraud detection system operating at real-time latency (1–2s) over millions of transactions, using a multi-model pipeline approach to meet performance constraints. Also implemented Airflow-orchestrated workflows (DAGs, retries, alerts) to replace brittle cron scripts and is currently pursuing a master’s project on real-time ASL-to-text conversion.”

“ML/NLP practitioner working across healthcare and business/finance use cases: currently fine-tuning a domain-specific Llama 3.1 model for safe reasoning over EHRs/clinical notes using RAG + RL/DPO and RAGAS-based evaluation. Has built UMLS-driven entity normalization pipelines with quantified quality gains and developed embedding/vector-DB systems (FAISS) for semantic matching and forecasting/recommendation applications at Aurora AI and Banxico.”