Vetted PySpark Professionals

“Backend/data engineer focused on production ML/LLM systems: built a real-time FastAPI inference API on Kubernetes with strong reliability patterns (timeouts, idempotent retries, centralized error handling). Delivered AWS platforms using EKS + Lambda with GitHub Actions/Helm CI/CD and built Glue-based ETL from S3/Kafka into Snowflake with schema evolution and data-quality controls; also modernized legacy analytics/recommendation workflows into Python services with safe, feature-flagged cutovers.”

“Backend/data-platform engineer with Stripe and Salesforce experience focused on global payouts/treasury systems. Built an end-to-end payout settlement monitoring platform (FastAPI microservices, Kafka/Spark streaming, React dashboard, CloudWatch alerting) that cut settlement delays 25% and reconciliation time 30%, and productionized an ML anomaly detection service that reduced missed issues by 30%. Experienced modernizing monoliths into microservices with feature flags/canaries and close partnership with treasury/risk/CTO stakeholders.”

“AI/LLM engineer who built and productionized an internal RAG-based knowledge system that ingests diverse sources (PDFs, Markdown, Slack), scaled retrieval with distributed FAISS and parallel ingestion, and reduced hallucinations via re-ranking, grounding prompts, and post-generation validation. Also has hands-on orchestration experience with Airflow and Kubernetes for reliable ETL/model pipelines, monitoring, and staged rollouts; reports ~15% accuracy improvement and adoption as the primary internal knowledge tool.”

“Built and deployed a healthcare NLP application that used an LLM-style physician interface feeding a random forest model to predict treatment plans for hard-to-triage patient subgroups, backed by a Databricks medallion pipeline and heavy feature engineering to address missing/low-integrity data across ~50K patients. Also delivered an earlier Microsoft AI Builder automation that improved transportation bill payment workflows by training non-technical payroll/procurement teams to use automated outstanding-payables reporting.”

“Embodied AI/robotics ML engineer with hands-on experience deploying POMDP-based reinforcement learning controllers on real mobile robots and vehicle fleets. Strong in sim-to-real robustness (domain randomization) and production rollout practices (HIL, shadow-mode, canaries, safety instrumentation), and has published related work (mentions a NeurIPS paper).”

“ML/LLM engineer with Stripe and Adobe experience who productionized a transformer-based Payments Foundation Model for real-time fraud detection at global scale (billions of transactions). Built petabyte-scale ETL/feature pipelines (Spark/EMR, Airflow, dbt, Kafka/Flink) and achieved <100ms multi-region inference (EKS, TorchServe, edge/Lambda, GPU/CPU routing) with strong PCI-DSS/GDPR compliance and explainability (SHAP/LIME), reporting a 64% fraud accuracy improvement.”

“Data science/NLP practitioner with experience at NVIDIA and Microsoft building production-grade NLP and data-linking systems. Has delivered high-performing pipelines (e.g., F1 0.92) and large-scale entity resolution (F1 0.89), plus semantic search using embeddings and Pinecone with ~30–40% relevance gains, backed by rigorous validation (A/B tests, ROUGE, MRR) and strong MLOps/workflow tooling (Airflow, Databricks, FastAPI, MLflow, Prometheus/ELK).”

“ML/NLP engineer with experience building production-grade legal-tech and data platforms, including a GPT-4/LangChain contract review system using ElasticSearch embeddings (RAG) deployed on AWS EKS. Strong in entity resolution and scalable batch/streaming pipelines (Kafka/Spark), with measurable impact (70%+ reduction in contract review time) and a focus on monitoring and CI/CD for reliable delivery.”