Vetted PySpark Professionals

“Built and deployed an Azure-based, fine-tuned CLIP visual retrieval system at Staples for a ~300k-item product catalog, improving edge-case recall by 12% by engineering a custom delta-similarity/dynamic-margin loss. Also has robotics experience using ROS2 for sensor/compute orchestration, including GPS-time-synchronized sensor triggering for robot swarms and latency-bounded optical-flow benchmarking for edge deployment.”

“Backend/ML engineer who has shipped high-scale real-time systems across e-commerce and healthcare: built a PharmEasy real-time recommendation engine for ~2M monthly users (cut feature latency 5 min→30 sec; +15% cross-sell) and architected a HIPAA-compliant multimodal clinical diagnostic workflow (DICOM+EHR) with XAI, MLOps (MLflow/Airflow/K8s), and drift/monitoring guardrails supporting 10k+ daily predictions.”

“ML/AI practitioner in healthcare (Syneos Health) who has deployed production clinical NLP and risk models. Built a BERT-based physician-note information extraction system on Docker + AWS SageMaker (reported ~42% retrieval improvement) and automated retraining/deployment with Airflow and drift detection, while partnering closely with clinicians to drive adoption (reported ~18% readmission reduction).”

“Built and productionized a tool-first, multi-agent framework that augments an anomaly detection model with domain context to generate trustworthy, evidence-backed anomaly explanations (including false-positive likelihood). Architected the platform to be model/orchestration/vectorDB agnostic (e.g., GPT + CrewAI + ChromaDB vs Claude + LangGraph + other vector DB) with strong performance, reliability, and OpenTelemetry-based observability. Also built a personal LangGraph-based "mock interviewer" agent that asynchronously fuses voice + live code input using state reducers, stop conditions, and fallback routing.”

“Built and deployed a production LLM-powered document Q&A system enabling natural-language querying of large PDFs, focusing on retrieval quality (overlapped chunking) and low-latency performance (optimized embeddings + vector search). Experienced with scaling ML/LLM workflows using async/batch processing, caching, cloud storage, and orchestration via Apache Airflow with robust testing, monitoring, and failure handling.”

“Built and shipped multiple production LLM/agentic systems, including an agentic RAG NL-to-SQL analytics app that cut manual reporting from 9 hours/week to 15 minutes by grounding on schema-aware retrieval and robust fallback/monitoring. Also implemented a LangChain supervisor-orchestrated enterprise IT automation agent that routes requests for search, identity validation, and action execution, and created a RAG search tool spanning Jira/Confluence/SharePoint for operations stakeholders.”

“Built a production real-time fraud detection and customer-support automation platform at Citibank, tackling extreme class imbalance (reported ~1:5000) and strict latency constraints. Combines hands-on MLOps (Airflow, Kubernetes, MLflow; Snowflake/Spark/S3 integrations; CI/CD model promotion) with cross-functional delivery to Risk & Compliance focused on interpretability and reducing false positives.”