Vetted PySpark Professionals

“Built and productionized a real-time enterprise RAG pipeline to improve factual accuracy and reduce LLM hallucinations by grounding responses in constantly changing internal knowledge bases (policies, manuals, FAQs). Experienced in orchestrating end-to-end ML workflows (Airflow/Kubernetes), handling messy multi-format data with schema enforcement (Pydantic/Hydra), and maintaining freshness via streaming incremental embeddings plus batch refresh. Also delivers applied ML solutions with non-technical teams (marketing/CRM) for segmentation and personalized engagement.”

“Built and shipped an LLM-powered data quality assistant that generates maintainable validation checks from metadata while executing validations via Great Expectations, exposed through FastAPI and integrated into Airflow-managed pipelines. Emphasizes production reliability (structured outputs, guardrails, monitoring, versioning, human review) and works closely with compliance/operations teams to deliver clear, auditable, user-friendly AI outputs.”

Abhinav Bandaru

Screened

Junior Data Scientist specializing in Generative AI and agentic LLM systems

San Jose, CA1y exp

“LLM/agentic-systems builder who has shipped production tools for investment research and procurement insights, including a company screener that processes thousands of conference-listed companies using FireCrawl + Google Search + Gemini. Demonstrates strong orchestration expertise (LangGraph multi-agent graphs), performance optimization (async/batching to sub-30s), and pragmatic reliability/evaluation practices with stakeholder-friendly UX (real-time cost tracking and model/parameter toggles).”

Ahmed Sadaqat

Screened

Senior Machine Learning Engineer specializing in production ML and predictive analytics

Los Angeles, CA7y exp

“ML/AI engineering leader who has owned end-to-end production systems from experimentation through deployment, monitoring, and iteration at meaningful scale. They describe running a 1M+ records/day prediction platform with 99.9% availability, shipping a RAG-based conversational AI feature for 50,000 active users, and consistently improving precision, latency, reliability, and cost with measurable business impact.”

“Backend/data engineer with Amazon supply-chain experience building production serverless Python services and ETL pipelines on AWS (Lambda, API Gateway, S3, RDS, Glue). Has modernized legacy SAS jobs into Python with rigorous parity testing and phased migrations, and has delivered major SQL performance gains (minutes down to seconds) through indexing and partitioning.”

“Backend/data engineer from Oscar Health specializing in healthcare claims systems on AWS. Built HIPAA-compliant real-time services (FastAPI/Postgres/Kafka on EKS) and serverless ingestion pipelines, and led modernization of a legacy SAS claims pricing system to Python/Spark with rigorous parity validation. Demonstrated measurable impact with high uptime/low latency services and major Snowflake performance and cost reductions.”

“Backend/data engineer with hands-on production experience across GCP (FastAPI microservices on Kubernetes) and AWS (Lambda, ECS Fargate, Glue). Has modernized legacy SAS batch systems into Python services with parallel-run parity validation, and has strong operational rigor in ETL reliability/monitoring plus proven SQL tuning impact (25s to <300ms, ~60% CPU reduction).”

“Built and shipped a production LLM-powered medical scribe that generates structured clinical visit summaries using RAG, strict JSON schemas, and post-generation validation to reduce hallucinations. Experienced in making LLM workflows deterministic and observable (structured logging/metrics/tracing) and in evaluation-driven iteration with metrics like schema pass rate and edit rate; collaborated closely with clinicians and policy stakeholders at Scale AI to drive adoption.”

“Backend/data engineer with healthcare/telehealth domain experience, building patient appointment and data-processing systems on AWS. Has delivered production microservices and ETL pipelines (Flask/Celery, Glue/PySpark) with strong reliability/observability practices (JWT, retries/timeouts, Sentry/CloudWatch) and modernization experience migrating SAS workflows to Python services, including a documented 10min→30sec SQL performance win.”

“Technology/architecture leader with Accenture experience delivering data- and AI/ML-driven products, including a legal contract search solution and customer sales analytics for AWS. Known for scaling distributed teams (onshore/offshore), making pragmatic architecture decisions, and solving hard data problems (proprietary sources, data quality) while implementing scalable integrations like Redshift-to-Salesforce via parallelized pipelines.”