Vetted Apache Spark Professionals

“Backend/data engineer with strong authorization and compliance-domain experience: led a phased migration from a simplistic role model to modern RBAC on a Python serverless stack (Auth0 + AWS Lambda/API Gateway), coordinating changes across 5 repos with extensive manual and automated validation. Previously built and operated custom ETL pipelines (Airflow + Groovy/Java on Spark/YARN/Hadoop) to normalize messy customer email/chat/voice data for NLP-driven financial compliance indicators, including complex email journaling metadata enrichment and large-scale remediation reprocessing after production bugs.”

“Amazon data engineer who built a real-time fraud detection pipeline for AWS Lambda, tackling multi-region telemetry quality issues and scaling stream processing for billions of daily requests. Strong in production-grade data/ML workflows on AWS (EMR, Glue, Kinesis, SageMaker) with hands-on entity resolution and anomaly detection.”

“Former Walmart Director of Software Engineering who left in March 2025 to build products for clients. Recently delivered an LLM/RAG-based UNSPSC classification solution for an MRO client using a multi-stage retrieval + web search + prompt-engineering workflow, and has led large-scale retail forecasting initiatives and high-severity cloud-migration incidents end-to-end.”

“Backend/data engineer with production experience building FastAPI services with strong reliability patterns (circuit breaker, rate limiting, caching, graceful degradation) and JWT/OAuth2 auth. Has delivered AWS EKS deployments via Terraform with Secrets Manager/IRSA and HPA autoscaling, and built Glue/Spark ETL pipelines on S3 Parquet with schema-evolution and idempotent reruns; also demonstrated measurable SQL tuning impact (20–30s to <10s).”

“Backend/data engineering candidate with Netflix experience designing and migrating analytics platforms from batch to real-time streaming (Kafka/Flink) across AWS and GCP. Delivered measurable improvements (40% lower data delay, 99.9% accuracy) using phased rollouts, automated data validation (Great Expectations), and strong observability (Prometheus/Grafana), and proactively hardened pipelines with idempotency to prevent duplicate Kafka processing.”

“Backend/distributed-systems engineer with Uber experience building real-time telemetry and safety signal pipelines. Strong in Kafka-based event-driven architectures, low-latency processing under peak load, and production reliability via monitoring, retries, and fallback logic; has Docker/Kubernetes and CI/CD deployment experience.”

“Internship experience at Intuit building an LLM-grounded QA system for internal microservice data across 100+ microservices, using a graph database approach (evaluated Neo4j and selected AWS Neptune for production alignment). Also has UC Berkeley research experience (including work with Prof. Dawn Song / Berkeley Eye Research Lab) and cross-functional collaboration with bioinformatics/biology teams to deploy software systems on research servers.”

“AI/LLM practitioner with internships at Dell Technologies and Roche who built and deployed a healthcare-focused "Doctor LLM" by fine-tuning Meta Llama 3.2 on healthcaremagic.json, emphasizing safety guardrails to prevent harmful medical advice. Experienced in productionizing AI workflows with monitoring, testing, and orchestration (Airflow, Kubernetes), and in delivering AI-agent-driven competitive landscape insights to non-technical business stakeholders.”

“Product-minded full-stack engineer who has owned customer-facing platforms end-to-end, including a unified web UI platform that increased adoption by 30% using feature flags and phased rollouts. Experienced designing TypeScript/React systems with microservices and RabbitMQ at scale, addressing reliability issues with DLQs, retries, and idempotent consumers, and building internal analytics tooling adopted company-wide within weeks.”

“Gameplay engineer with hands-on ownership of a real-time C++ combat ability system, including diagnosing and eliminating large-scale combat frame spikes by refactoring hit detection to an event-driven, animation-notify approach (cut collision checks ~80%). Also implemented UE5 networked abilities (dash) with client-side prediction and server-authoritative reconciliation, plus projectile ballistics validated through debug spline visualizations and unit tests.”

“Data/ML engineer who has owned end-to-end systems across email deliverability/segmentation and production LLM apps. Built a Spark+Airflow segmentation engine that materially improved deliverability (99.9%) and open rates (>50%), and shipped a PDF-to-quiz RAG product using LangChain/Vertex AI/Chroma with strong guardrails and an eval loop that cut hallucinations to <5%.”