Vetted PySpark Professionals

“Built and deployed a healthcare NLP application that used an LLM-style physician interface feeding a random forest model to predict treatment plans for hard-to-triage patient subgroups, backed by a Databricks medallion pipeline and heavy feature engineering to address missing/low-integrity data across ~50K patients. Also delivered an earlier Microsoft AI Builder automation that improved transportation bill payment workflows by training non-technical payroll/procurement teams to use automated outstanding-payables reporting.”

“Embodied AI/robotics ML engineer with hands-on experience deploying POMDP-based reinforcement learning controllers on real mobile robots and vehicle fleets. Strong in sim-to-real robustness (domain randomization) and production rollout practices (HIL, shadow-mode, canaries, safety instrumentation), and has published related work (mentions a NeurIPS paper).”

PoHung Chen

Screened

Junior AI/ML Engineer specializing in MLOps and real-time model serving

New York, NY2y exp

“Software engineer with Amazon experience who has built LLM-powered and hybrid ML systems for ad auction/relevance at massive scale. Most notably, they described redesigning brand-query classification with a GPT-4-assisted offline cache plus fallback architecture that improved accuracy from 72% to 99%, reduced latency and costs, and was credited with an estimated $130M revenue lift.”

“ML/LLM engineer with Stripe and Adobe experience who productionized a transformer-based Payments Foundation Model for real-time fraud detection at global scale (billions of transactions). Built petabyte-scale ETL/feature pipelines (Spark/EMR, Airflow, dbt, Kafka/Flink) and achieved <100ms multi-region inference (EKS, TorchServe, edge/Lambda, GPU/CPU routing) with strong PCI-DSS/GDPR compliance and explainability (SHAP/LIME), reporting a 64% fraud accuracy improvement.”

“Data science/NLP practitioner with experience at NVIDIA and Microsoft building production-grade NLP and data-linking systems. Has delivered high-performing pipelines (e.g., F1 0.92) and large-scale entity resolution (F1 0.89), plus semantic search using embeddings and Pinecone with ~30–40% relevance gains, backed by rigorous validation (A/B tests, ROUGE, MRR) and strong MLOps/workflow tooling (Airflow, Databricks, FastAPI, MLflow, Prometheus/ELK).”

“ML/NLP engineer with experience building production-grade legal-tech and data platforms, including a GPT-4/LangChain contract review system using ElasticSearch embeddings (RAG) deployed on AWS EKS. Strong in entity resolution and scalable batch/streaming pipelines (Kafka/Spark), with measurable impact (70%+ reduction in contract review time) and a focus on monitoring and CI/CD for reliable delivery.”

“Built and shipped production AI systems spanning customer support automation at Uber, privacy-preserving federated health modeling on iOS, and an open-source semantic search layer for Postgres. Stands out for combining strong LLM/product instincts with rigorous eval design, measurable production impact, and zero-to-one execution across backend, mobile, and developer infrastructure.”