Vetted A/B Testing Professionals

“Built a production RAG-based healthcare chatbot to retrieve patient medical documents spread across multiple platforms, reducing manual and error-prone searching. Implemented semantic search with custom embeddings (Hugging Face) and Pinecone, deployed via FastAPI/Docker on AWS SageMaker with MLflow tracking, and optimized fine-tuning cost using LoRA while orchestrating retraining pipelines in Airflow.”

“GenAI/LLM engineer who built and deployed a production RAG system for enterprise document search and decision support, cutting manual lookup time by 40%+. Experienced with LangChain/LangGraph agent orchestration plus Airflow/Prefect for ingestion and incremental reindexing, with a strong focus on reliability (testing, observability) and stakeholder-driven metrics.”

“ML/LLM engineer with Meta experience building production AI systems for near real-time user-report classification and summarization under strict latency (<250ms), safety, cost, and privacy constraints. Has hands-on MLOps/orchestration experience (Airflow, Spark, MLflow, Kubernetes, Docker, GitHub Actions) plus observability (Prometheus/Grafana) and applies rigorous evaluation, staged rollouts, and A/B testing to keep agent workflows reliable in production.”

“LLM-focused engineer with end-to-end experience shipping an OpenAI-powered edtech teacher assistant into production, using Humanloop-driven prompt iteration, rigorous observability (Datadog), and A/B testing tied to real learning metrics (25% comprehension lift). Also led adoption-driving technical demos at SiriusXM (event-driven AWS Lambda/Kotlin/CDK pipeline cutting processing from 24 hours to seconds) and partnered with sales at Spresso.ai to close eCommerce SDK deals and boost activation from 40% to 85%.”

“Lifecycle/CRM marketer in the education/music curriculum space who builds segmented nurture programs and tests messaging to drive measurable outcomes. Notably delivered a 70% conversion post-training email sequence to upsell teachers into licensing a full curriculum, and uses tagging/lead magnets to boost opens and event signups by location-based interest.”

“Lifecycle/CRM marketer who built financing-journey email campaigns at Blue X Trade using Mailchimp and n8n, including an AI agent to validate user info and trigger instant correction emails—improving retention and ROI. Runs structured A/B tests on dynamic personalization (name/location/trading country) that increased engagement and bookings, and has led cross-functional promotions while managing third-party rewards integration issues with monday.com.”

“Built and deployed a production AI “term explainer” agent that adapts explanations to beginner/intermediate/expert users by combining multi-step LLM reasoning with grounded Wikipedia retrieval. Owns end-to-end agent orchestration (smolagents/Python), reliability patterns (fallback across LLM providers, retries, guardrails), and observability/metrics-driven evaluation; also partnered with a non-technical researcher to deliver a plain-language research assistant agent.”

“CRM/lifecycle marketer with experience reactivating inactive members in a gaming/loyalty context, using RFM-style segmentation and multi-channel journeys (email plus host phone outreach). Demonstrated measurable lift (20% reactivation/engagement) and optimization through A/B testing of incentive strategy, while coordinating closely with Creative, Operations, and Compliance during major campaigns.”

“LLM/MLOps engineer who has shipped a production RAG-based technical documentation assistant (FastAPI) cutting manual review by 45%, with deep hands-on retrieval optimization in Pinecone/LangChain (HNSW, hybrid + multi-query search, caching). Also brings healthcare domain experience—building Airflow-orchestrated EHR pipelines and delivering FDA-auditability-friendly predictive maintenance solutions using SHAP/LIME explainability surfaced in Power BI.”

“ML/LLM engineer with production experience building a compliant RAG-based virtual assistant at Intuit, optimizing embeddings and FAISS retrieval (including PCA) for low-latency, privacy-controlled search and deploying via AWS SageMaker containers. Also built scalable Airflow+MLflow pipelines using Docker and KubernetesExecutor, cutting training cycles by 37%, and partnered with civil engineers/project managers at Aegis Infra to deliver predictive maintenance for construction equipment.”

“Lifecycle/CRM marketer with DTC jewelry experience who built a segmented post-purchase workflow targeting engagement-ring buyers and drove repeat purchases from ~2% to ~30% within a 90-day window using personalized recommendations, educational/social-proof content, and incentive testing. Emphasizes rigorous segmentation, ongoing data audits, and continuous A/B testing to improve retention and revenue.”

“Full-stack engineer with ~20 years of experience (including 5–6 years in consultancy) who has shipped and operated production systems across a wide range of stacks. Recently owned an end-to-end receipts feature integrating Stripe, generating PDFs, and sending HTML emails, deployed via GitHub Flow to AWS ECS; handled real-world performance issues (oversized merchant images) with compression and server tuning.”

“Backend engineer who has owned end-to-end delivery of Python/FastAPI microservices for real-time data processing and alerting, including performance tuning (Postgres optimization, caching, async processing). Strong DevOps/GitOps background: Docker + Kubernetes deployments with GitHub Actions CI/CD and ArgoCD-driven GitOps, plus experience supporting phased on-prem to AWS migrations and building Kafka-based streaming pipelines.”

“LLM engineer/data engineer who has deployed production RAG systems for internal-document Q&A, building end-to-end ingestion, embedding, vector search, and FastAPI serving while actively reducing hallucinations and latency through rigorous retrieval tuning and caching. Also experienced in orchestrating cloud data pipelines (Airflow, AWS Glue, Azure Data Factory) and partnering with non-technical business teams to deliver AI solutions like automated document review.”

“AI Engineer Co-Op at Northeastern University who built a production Patient Persona Chat Bot to help nursing students practice clinical interactions, fine-tuning Llama 3 and integrating a LangChain + Pinecone RAG pipeline deployed on Amazon Bedrock. Emphasizes clinical accuracy and reliability with guardrails, retrieval filtering, and continuous evaluation, and also brings strong data engineering/orchestration experience (Airflow, EMR/PySpark, ADF, dbt, Databricks, Snowflake).”

“Backend engineer who built a stateless Python/Flask service supporting a healthcare-document ETL pipeline, offloading heavy processing to Celery workers and adding strong observability (metrics, structured logs, audits). Demonstrates practical performance/reliability work: batch chunking, priority queues, autoscaling by queue depth/CPU, DLQ routing, and PostgreSQL tuning (indexes, pagination) to cut slow API responses. Also has experience deploying real-time ML classification via TensorFlow Serving behind a FastAPI wrapper and integrating models via REST/gRPC.”

“LLM/GenAI engineer who built a production AI-powered credit risk policy summarization and compliance alerting platform at HCL Tech, focused on factual accuracy and auditability for a financial client. Implemented a multi-retriever LangChain RAG architecture with citations-only prompting, fallback agents, and human-in-the-loop legal review—cutting manual review time by 35% and scaling to 12 teams.”

“AI/NLP-focused practitioner who built a zero-/few-shot LLM event extraction system on the long-tail Maven dataset, combining prompt-structured outputs with LoRA/QLoRA fine-tuning and rigorous F1 evaluation. Also implemented entity resolution/data cleaning pipelines and embedding-based semantic search using Sentence-BERT + FAISS, and has healthcare experience delivering a multilingual speech/translation mobile prototype using HIPAA-compliant Azure Cognitive Services.”

“Marketing leader who has repeatedly been the first marketing hire, building the function from scratch while aligning sales, product, and leadership around shared positioning and goals. Strong in marketing ops and executive analytics—integrated multiple data platforms to track the full customer lifecycle (CLV, renewals, attribution) and drive KPI-focused decision-making while reducing reliance on vanity metrics.”

“ML/LLM engineer with production experience at General Motors building Transformer-based search and recommendation personalization for a high-traffic vehicle platform. Delivered significant KPI gains (17% conversion lift, 14% bounce-rate reduction) and optimized real-time inference via ONNX Runtime and INT8 quantization while implementing robust MLOps (Airflow/MLflow, monitoring, drift-triggered retraining) and stakeholder-facing explainability/dashboards.”

“AI/ML practitioner in healthcare/insurance (Blue Cross Blue Shield) who built and deployed a production NLP system to classify patient risk from unstructured clinical notes. Experienced in end-to-end pipeline orchestration (Airflow, AWS Step Functions/Lambda/SageMaker) and real-time optimization (BERT to DistilBERT on AWS GPUs), with strong clinician collaboration to drive adoption.”

“Product/full-stack engineer with analytics-dashboard experience at Kantar, owning features end-to-end from React/Next.js UI through Postgres data modeling and query optimization. Built a multidimensional filters/tags module that cut analyst discovery time by ~60% and also implemented durable backend workflows for bulk report generation with retries and idempotency, validated via EXPLAIN ANALYZE and production monitoring.”

“Built and launched a verified listings system for Burrow (student subleasing) after interviewing ~50 students about scam/fake listing concerns; chose a lightweight .edu-based verification approach to ship fast and then iterated with badges and clearer details, reducing churn from 15% to 7%. Also ran an LLM A/B test for auto-generating listing descriptions and improved trust/accuracy by updating prompts to prevent hallucinated details.”

“Core QA team member at 2K Madrid who supported AAA titles including The Quarry, WWE 2K22, and NBA 2K22. Specialized in high-risk online/co-op testing (multi-device, parallel playthroughs) and complex narrative decision-tree validation, while acting as a key communication bridge across QA teams in China and the US using Jira/Confluence/Kanban.”