Vetted PySpark Professionals

“Data/ML practitioner focused on healthcare data quality and record linkage: analyzed 10M+ records, built anomaly detection and NLP-driven entity resolution, and automated AWS ETL/validation pipelines (Glue/Redshift/Lambda), cutting data errors by 40% and generating $500k in annual savings. Has hands-on experience with embeddings (Sentence Transformers/spaCy), FAISS vector search, and fine-tuning for domain-specific matching.”

“Backend/data platform engineer with production experience at Walmart and Molina Healthcare, building Python microservices on AWS (EKS + Lambda) for real-time inventory and recommendation systems. Strong in reliability/observability and incident leadership, plus modernizing legacy healthcare workflows and building resilient AWS Glue/PySpark pipelines with schema evolution and data quality controls.”

“Hands-on LLM practitioner who built a production document-processing pipeline in Python, tackling long-document handling and latency with chunking/batching and a user-driven correction feedback loop. Experienced operationalizing AI workflows with Kubernetes (CronJobs, autoscaling, scheduled data cleaning and weekly retraining) and applying structured testing/evaluation (E2E, LLM-as-judge, HITL) while communicating solutions clearly to non-technical clients using visual diagrams.”

“LLM/agentic systems practitioner who specializes in moving customer prototypes into production within microservices environments, emphasizing reliability, latency, security, and measurable success metrics. Experienced in real-time troubleshooting using logs/traces and in enabling adoption through hands-on developer workshops (including live coding in Java Spring Boot) and pre-sales POCs that address technical objections and integration risk.”

“Backend/event-driven systems engineer who built an end-to-end “software robot” for AI-driven invoice processing: FastAPI ingestion + OCR integration + classification mapping, with strong emphasis on reliability (idempotency, retries) and scalability (background workers, event-driven architecture). Experienced in production-grade distributed systems tooling (Kafka, Docker/Kubernetes, GitHub Actions, ArgoCD) and real-time debugging via tracing/telemetry, and expects $10k–$12k/month.”

“Robotics ML/software engineer focused on Vision-Language-Action control for 7-DoF robots, replacing tokenized action decoding with continuous regression heads (including a logit-weighted expectation approach) to improve stability and real-time behavior. Strong in ROS1/ROS2 systems integration and debugging closed-loop manipulation issues via latency instrumentation, QoS-aware distributed messaging, and sim-to-real validation using Gazebo/Unity, Docker, and CI pipelines.”

“Built a production AI agent for phishing fraud detection using n8n orchestration, Claude (Sonnet 4/MCP), VirusTotal, and JavaScript formatting to generate and deliver email-based reports via Gmail. Has experience evaluating detection accuracy against known examples, iterating via feedback, and presenting AI solutions to non-technical teams.”

“Backend engineer with deep experience building event-driven logistics systems (orders, warehouse execution, real-time delivery tracking) using Spring Boot/PostgreSQL/Redis and strong observability (Prometheus/Grafana). Led a zero-downtime migration from monolithic MySQL to a sharded architecture for ~2M users with dual-write, checksum validation, and fast auto-rollback, and has strong security expertise including PostgreSQL RLS for multi-tenant SaaS and robust OAuth/JWT handling.”

“Built and productionized LLM-driven sentiment scoring for earnings call transcripts at Goldman Sachs, replacing legacy NLP to deliver a cleaner trading signal while managing latency/cost via batching, caching, and distilled models. Also implemented an Airflow-orchestrated fraud modeling pipeline at MetLife with drift-based retraining and SageMaker deployment, and has a disciplined evaluation/rollout framework for reliable AI workflows.”

“FinTech/AI engineer who has shipped an end-to-end discrepancy-detection product for financial managers using Next.js, FastAPI/GraphQL, Pinecone, and AWS (with dev/staging/prod, observability, A/B testing, and documentation). Also built an AI-native “AI Genesis” system with agentic cyclic workflows, routing, and tool use, and has experience modernizing legacy systems via the strangler fig pattern while coordinating with senior stakeholders on a 5G autonomous simulation platform.”

“Backend/ML systems engineer with experience at SDSC, UCSD, and Media.net, building production semantic dataset/model discovery using embeddings + Solr KNN and LLM-based intent/reranking at 5M+ dataset scale. Emphasizes offline/online separation for predictable serving, has delivered measurable gains (23% retrieval accuracy, 38% latency reduction) and helped secure a $3M+ NSF grant.”

“Applied LLMs and a graph-RAG architecture in Neo4j to automate an accounting firm's cross-checking of transactional books against tax regulations, indexing 1,000+ pages into a knowledge graph with vector search. Combines agentic LLM workflows with classical NER (Hugging Face/NLTK) and validates using expert-labeled held-out data plus precision/recall and measured accountant time savings after deployment.”