Vetted Apache Spark Professionals

“Hands-on engineering manager at a marketing company leading a highly senior, distributed team (10 direct reports) while personally coding ~60–70% and owning end-to-end architecture across three interconnected products. Built agentic CRM automation and a reinforcement-learning-driven distribution layer for channel spend/bidding, with a strong focus on scalable design and observability (Prometheus/APM/logging) enabling frequent releases and few production incidents.”

“Software engineer with experience across Goldman Sachs, BYU Broadcasting, Juniper Networks, and an edtech startup (Doubtnut), spanning data migrations, AWS-based media backends, and microservices observability. Built a Redis/ElastiCache caching layer in front of DynamoDB/S3 to improve media delivery latency and cost, and created an SEO indexing automation tool using the Google Search Console API that saved ~15–30 person-hours per day.”

“Engineering leader (12+ years Director, 17 years lead) focused on developer productivity and platform/framework work across Oracle, PlayStation, Workday, and CafePress. Notable for building distributed teams from scratch and delivering high-impact platform architecture—e.g., re-architected PlayStation’s upload pipeline to support 500GB–5TB submissions using browser-to-AWS chunked uploads with SNS/SQS and deduplication/resume support.”

“ML/LLM engineer who has built and productionized a large multimodal LLM pipeline end-to-end—fine-tuning a 20B+ parameter model with distributed/FSDP training and deploying on Kubernetes via Triton for ~5x throughput. Strong focus on reliability and safety (monitoring with SHAP, guardrails, A/B testing) with reported ~22% relevance lift and reduced harmful/incorrect outputs, plus experience orchestrating ETL/retraining workflows with Airflow across S3/Snowflake/RDS.”

“Built and deployed a production LLM-powered clinical support assistant at BJC HealthCare (RAG + transformer) to answer patient questions, summarize clinical notes, and support appointment workflows. Implemented PHI-safe data pipelines (Spark/Hadoop/Kafka) with automated scrubbing, dataset versioning, and audit logs, and runs the system on Docker/Kubernetes with Pinecone vector search while partnering closely with clinical operations staff.”

“Amazon Alexa engineer who architected and shipped a GenAI Knowledge Agent used by 2M+ customers, focused on making LLM outputs auditable via citations and a verification layer that prevents hallucinations. Built the full vertical slice (FastAPI/LangChain backend + React/TypeScript streaming UI) while keeping p99 latency under 200ms, and has proven incident response experience on AWS (Lambda/DynamoDB scaling issues).”

“Entry-level full-stack engineer with internship experience at Amazon (Appstore IAP flow + uninstall recommendation workflow) and a health-tech startup (OneVector) where they built a DSUR reporting workflow end-to-end, including document generation, S3-backed versioning/metadata, and secure preview/download. Demonstrates strong production debugging and reliability mindset (instrumentation, deterministic retrieval, idempotent writes) and focuses on UX/performance in high-stakes user flows.”

“Backend/data-platform engineer with Stripe and Salesforce experience focused on global payouts/treasury systems. Built an end-to-end payout settlement monitoring platform (FastAPI microservices, Kafka/Spark streaming, React dashboard, CloudWatch alerting) that cut settlement delays 25% and reconciliation time 30%, and productionized an ML anomaly detection service that reduced missed issues by 30%. Experienced modernizing monoliths into microservices with feature flags/canaries and close partnership with treasury/risk/CTO stakeholders.”

“LLM/RAG practitioner who built an AWS-based enterprise document search and summarization platform with RBAC and scaled it to 10K+ users, solving relevance issues via contextual chunking and hybrid retrieval. Also designed agentic workflows for a telecom forecast-validation use case using sub-agents, tool APIs, and strict context management, and has proven pre-sales influence (supported a $300K manufacturing deal with a roadmap-driven pitch).”

“AI/LLM engineer who built and productionized an internal RAG-based knowledge system that ingests diverse sources (PDFs, Markdown, Slack), scaled retrieval with distributed FAISS and parallel ingestion, and reduced hallucinations via re-ranking, grounding prompts, and post-generation validation. Also has hands-on orchestration experience with Airflow and Kubernetes for reliable ETL/model pipelines, monitoring, and staged rollouts; reports ~15% accuracy improvement and adoption as the primary internal knowledge tool.”

“Robotics engineer who worked on a lunar rover program, building a simulation environment that mirrored real hardware interfaces and incorporated moon-terrain slip/friction modeling validated against a physical “moon yard.” Also integrated an ML-based munition X-ray inspection system via REST APIs, deploying and scaling inference on Azure with Kubernetes plus Prometheus monitoring, load balancing, and self-healing reliability mechanisms.”

“Engineering leader with experience building point-of-care diagnostics platforms (IoT-connected PCR device delivering results in <15 minutes) and scaling multidisciplinary teams (55+). Has led major data/IoT architecture decisions (multi-cluster Kubernetes with secure routing; Kafka + Gobblin over MQTT) and runs execution with Agile roadmaps tightly aligned to GTM and senior leadership.”

“ML/LLM infrastructure-focused engineer who built a production stateful LLM inference service that cuts latency and GPU compute for repeated/overlapping prompts via caching with correctness guardrails. Strong in Kubernetes-based deployment and reliability engineering, using A/B testing and similarity-based evaluation to quantify performance gains without sacrificing output quality.”

“Built and deployed a production LLM-powered RAG document intelligence system used by non-technical enterprise stakeholders, cutting document search time by 40%+ while improving answer consistency. Demonstrates strong MLOps/data workflow orchestration (Airflow, AWS Step Functions, managed schedulers across GCP/Azure) and a metrics-driven approach to reliability, evaluation, and cost/latency optimization with guardrails and observability.”

“ML/LLM engineer with Stripe and Adobe experience who productionized a transformer-based Payments Foundation Model for real-time fraud detection at global scale (billions of transactions). Built petabyte-scale ETL/feature pipelines (Spark/EMR, Airflow, dbt, Kafka/Flink) and achieved <100ms multi-region inference (EKS, TorchServe, edge/Lambda, GPU/CPU routing) with strong PCI-DSS/GDPR compliance and explainability (SHAP/LIME), reporting a 64% fraud accuracy improvement.”

“Data science/NLP practitioner with experience at NVIDIA and Microsoft building production-grade NLP and data-linking systems. Has delivered high-performing pipelines (e.g., F1 0.92) and large-scale entity resolution (F1 0.89), plus semantic search using embeddings and Pinecone with ~30–40% relevance gains, backed by rigorous validation (A/B tests, ROUGE, MRR) and strong MLOps/workflow tooling (Airflow, Databricks, FastAPI, MLflow, Prometheus/ELK).”

“ML/NLP engineer with experience building production-grade legal-tech and data platforms, including a GPT-4/LangChain contract review system using ElasticSearch embeddings (RAG) deployed on AWS EKS. Strong in entity resolution and scalable batch/streaming pipelines (Kafka/Spark), with measurable impact (70%+ reduction in contract review time) and a focus on monitoring and CI/CD for reliable delivery.”

“ML/robotics engineer with Apple experience who built a computer-vision-driven industrial defect detection system integrating a robotic arm with ROS-based real-time inference on an edge GPU. Drove major performance gains (cut inference time ~60% via quantization + TensorRT) and improved robustness to lighting/material variation, with strong emphasis on production reliability (health checks, watchdogs, observability, CI/CD) and interest in shaping early-stage startup engineering culture.”

“Fractional CTO supporting early-stage teams in the UAE and Ukraine to build platforms using an "Agentic OS" approach—one focused on reducing friction across patient/provider/payor engagement and another on enforcing transparency for international rebuilding investments to reduce fraud. Also exploring an alternative-energy feedstock plantation opportunity in Armenia with multi-industry downstream revenue potential; has created project-specific investor pitch decks and is actively engaging potential investors.”