Vetted A/B Testing Professionals

“ML/NLP practitioner with experience building an embedding-based ad matching and search system at Vericast (BERT embeddings + similarity search) to replace a third-party taxonomy approach, evaluated via a human-curated gold standard. Also built a custom NER pipeline at Allstate for auto accident claims calls using a bidirectional LSTM and achieved 90%+ F1, with a strong emphasis on production-grade ML workflows (testing, CI/CD, orchestration, versioning, validation).”

“字节跳动实习期间将内部AI重量预测模型从“可用但难上线”的单点能力，改造成可商业化复用的通用API：统一多地区接口与评估口径，设计分层兜底与置信度分级，先灰度上线SEA/JP并推动US/EU落地，结合线上结果进行模型微调。具备LLM/RAG/Agent系统的实战排障方法论，以及面向开发者与售前场景的技术演示与跨团队推进能力。”

“Built and productionized an AI-native, agentic appeals decisioning system for health insurance operations, automating 500k+ scanned appeals/year. Delivered measurable impact by cutting review time from 12–15 minutes to ~3 minutes and auto-resolving ~85% of cases with strong auditability, evaluations, and human-in-the-loop guardrails, deployed as containerized microservices on Azure AKS.”

“LLM engineer who has deployed production RAG systems for regulated document QA (PDFs/knowledge bases), emphasizing grounded answers with citations, RBAC, monitoring, and continuous feedback. Demonstrates deep practical expertise in retrieval quality (semantic chunking, hybrid BM25+embeddings, re-ranking), reliability (guardrails, deterministic workflows), and measurable evaluation (golden sets, log replay, A/B tests) while partnering closely with compliance/operations stakeholders.”

“Growth creative/performance marketer currently at Walmart who led Walmart+ checkout announcement/enhancement campaigns end-to-end, combining user behavior analysis, customer feedback, and multi-variant A/B testing. Reported measurable funnel and revenue-adjacent lifts (faster checkout, nearly doubled first-time completion, +18% repeat visits, +$1.2 basket size) and uses Power BI plus platform analytics (Meta/TikTok/YouTube) to drive rapid, modular creative iteration with creators and editors.”

“AI/ML practitioner with Northern Trust experience who has shipped production LLM systems (internal support assistant) using RAG, vector databases, orchestration (LangChain/custom pipelines), and rigorous monitoring/feedback loops. Also built AI-driven fraud detection/risk monitoring solutions in a regulated financial environment, emphasizing explainability (SHAP), audit readiness, and stakeholder trust through dashboards and clear communication.”

“Paid media performance marketer with hands-on ownership of $100K+/month Meta Ads spend for a luxury jewelry brand, using creative-first testing and funnel-building tactics (e.g., giveaways) to expand retargeting pools and drive attributed sales. Also experienced structuring full-funnel systems across Meta/TikTok/Google and diagnosing Performance Max declines by refining audience signals and bidding to improve lead quality and CPL.”

“At JP Morgan Chase, built and deployed a production LLM-powered RAG knowledge assistant to help fraud investigators and risk analysts quickly navigate regulatory updates and internal policies, reducing investigation delays and compliance risk. Strong focus on secure retrieval (RBAC filtering), reliability (layered testing + observability), and production constraints (latency/SLOs), with Airflow-orchestrated, auditable ML pipelines.”

“At Evoke Tech, built a production LLM "Testbench" to quickly compare LLMs/embedding models and RAG strategies (semantic, hybrid BM25, re-ranking, HyDE, query expansion) to select optimal architectures for different client needs. Also developed a multi-agent, multimodal (voice/text) RAG system for live catalog retrieval and safe product recommendations using LangGraph/LangChain with LangSmith monitoring, and regularly translated PM/UX goals into concrete agent behaviors via demos and flowcharts.”

“AI Product Manager who also operates as a product marketer/CRM lifecycle lead, focused on behavior-driven onboarding and retention. Has delivered measurable growth through segmentation, multi-channel lifecycle programs, and experimentation (e.g., activation +23%, TTFV -30%, retention +14%), and led a cross-functional chatbot integration that improved course completion (+23%) while reducing refunds (-15%).”

“Built and shipped a production LLM-powered personalized client engagement assistant in the financial domain, balancing real-time recommendations with strict privacy/compliance requirements. Demonstrates strong MLOps/LLMOps depth (Airflow + MLflow, containerized microservices, drift monitoring) and a privacy-by-design approach validated in collaboration with risk and compliance teams.”

“Frontend engineer with deep experience modernizing KYC flows at Carta, including rebuilding country-specific KYC forms into a scalable configuration + validation-schema system that cut new-jurisdiction support from 2–3 months to ~2 weeks. Strong on quality and rollout practices (E2E/backend testing, early QA engagement, staged/A-B rollouts) and performance optimization for heavy React/TypeScript dashboards using Intersection Observers for lazy loading.”

“Software engineer with deep experience in real-time payments and event-driven microservices. Built a React/TypeScript + Spring Boot system using RabbitMQ, and created an internal operations dashboard that improved visibility into message-processing workflows for engineering, support, and SRE. Strong in experimentation-driven product iteration (feature flags/A-B tests) and in scaling reliability via idempotent consumers and end-to-end observability.”

“Frontend engineer/lead focused on scalable architecture and reusable UI platforms: built a schema-driven, IoC-based unified filtering system across an app with feature-flagged rollout and strong TypeScript/testing discipline. Also created a standalone React NPS survey package that works across microfrontends (handling peer dependency/version issues) and implemented accessibility improvements for complex interactions like drag-and-drop while leading an Atomic Design → Feature-Sliced Design migration.”

“Growth-creative marketer in a club/sports-style environment focused on premium offerings, running structured creative experiments across multiple clubs/markets. Demonstrated measurable performance gains (≈20% lower CPA, ≈12% higher ROAS) by shifting from brand-led to value-forward messaging and translating channel-level performance insights into modular, rapid-iteration creative systems.”

“Procurement/sourcing professional with hands-on experience selecting and rolling out an analytics dashboard vendor end-to-end—using stakeholder discovery, POCs, and a scoring matrix—then negotiating a ~26% cost reduction and waiving implementation fees. Also demonstrates strong trade compliance instincts by catching and correcting an incorrect tariff code that would have increased duties ~18%, and uses structured milestone/risk tracking (RAG) to keep OTD and approvals on track.”

“Built and deployed a production LLM + vector search clinical decision support system at UnitedHealth Group, retrieving medical evidence and patient context in real time for prior authorization and risk scoring. Strong in end-to-end RAG architecture (Hugging Face embeddings, Pinecone/FAISS, SageMaker, Redis) plus orchestration (Airflow/Kubeflow) and rigorous evaluation/monitoring, with demonstrated ability to align solutions with clinical operations stakeholders.”

“Built and deployed an LLM-powered analytics assistant enabling business users to ask questions in plain English and receive validated Spark SQL executed in Databricks, with a Streamlit/Flask UI. Addressed strict client schema-privacy constraints by implementing a RAG strategy and ultimately leveraging AWS Bedrock and fine-tuned reference docs. Also has production ML pipeline experience using Docker + Airflow and AWS (S3/ECS/EC2) for financial classification models.”

“Built and productionized an NLP-powered customer support assistant at JPMorgan Chase for digital banking, focused on reducing response time for repetitive client queries. Strong in real-world AI deployment challenges—sensitive data handling, low-latency FastAPI services, and AWS/Kubernetes operations with CI/CD—plus a metrics- and guardrails-driven approach to reliable AI workflows.”

“AI/ML engineer with HP experience building and productionizing an LLM-powered document intelligence platform (LangChain + Pinecone) to deliver semantic search and contextual Q&A across millions of enterprise support documents. Demonstrates strong MLOps and scaling expertise (Airflow, Kubernetes autoscaling, Triton GPU inference, monitoring with Prometheus/W&B) plus a structured approach to evaluation (A/B tests, shadow deployments, failover) and effective collaboration with non-technical stakeholders.”

“GenAI/data engineering practitioner with production experience across Equinix, Optum, and Citibank—built an Azure OpenAI (GPT-4) + LangChain document intelligence platform processing 1.5M+ docs/month and a HIPAA-compliant Airflow healthcare pipeline handling 5M+ claims/day. Also delivered a real-time fraud detection + explainability system using LightGBM and a fine-tuned T5 NLG component, improving fraud accuracy by 15%+ while partnering closely with compliance stakeholders.”

“Engineering leader who proposed and delivered a new API-based document management platform to replace a vendor-dependent system, improving latency by ~1s and availability to 99.9% while migrating legacy data. Also drove Python-based automation of ~12 workflows via third-party API integrations and led an SSO/auth integration focused on backward compatibility and high login success rates.”

“Internship experience building a production RAG+LLM pipeline to map messy card transaction descriptions to merchant brands, including a custom modified-ROUGE evaluation approach for weak/variant ground truth. Improved scalability and cost by moving from a managed LLM endpoint (e.g., Bedrock) to self-hosted vLLM, and orchestrated massive embedding backfills (5,000+ files, 10B+ rows) using an Airflow-triggered SQS + ECS worker architecture with robust retry/DLQ handling.”

“Backend/platform engineer from Fanatics sportsbook core team with deep experience in real-time ingestion systems (Kafka) and high-throughput performance optimization. Delivered an 87% latency reduction on a Java API handling hundreds of thousands of updates per second, and improved reliability of shared internal libraries via deterministic recovery logic, strong testing, and feature-flagged rollouts.”