Vetted PySpark Professionals

“Data engineer with ~4 years of experience building Python-based data ingestion/processing services and real-time streaming pipelines (Kafka/PubSub + Spark Structured Streaming). Has deployed containerized data applications on Kubernetes with GitLab CI/Jenkins pipelines and applied GitOps to cut deployment time ~40% while reducing config drift. Also supported a legacy on-prem data warehouse/backend migration to GCP using phased migration and parallel validation to meet strict reliability/SLA needs.”

“Built and deployed a production LLM-powered demand and churn forecasting system for an e-commerce client, combining open-source LLMs (LLaMA/Mistral) and Sentence-BERT embeddings to generate business-friendly explanations of forecast drivers. Strong focus on data quality and model trust (validation, baselines, segmented monitoring) and production reliability via Airflow-orchestrated pipelines with readiness checks, retries, and ongoing drift/A-B testing.”

“AI/ML engineer who shipped a production blood-test report understanding and personalized supplement recommendation product, using a LangGraph multi-agent pipeline on AWS serverless with OCR via Bedrock and RAG over vetted clinical research. Also built end-to-end recommender system pipelines at ASANTe using Airflow (ingestion, embeddings/features, training, registry, batch scoring/monitoring) with KPI reporting to Tableau, with a strong focus on safety, evaluation, and measurable reliability.”

“ML engineer with hands-on experience taking a Gaussian Process Regression-based intelligent survey timing system from build to real-world deployment, including a 3-week RCT on 120 participants and measurable improvements (15% response rate, 23% data quality). Also served as a key technical resource at CData for customer-facing demos and debugging hundreds of production issues, bridging engineering with Sales and Customer Success.”

“AI/LLM engineer who has shipped production systems end-to-end, including a note-taking product (Notey) combining audio/image capture, ASR, summarization, and a semantic chat agent over past notes. Also has applied ML experience in healthcare, collaborating directly with doctors to validate an EEG seizure-detection pipeline, and uses Kubernetes to optimize GPU usage for LLM training.”

“AI Engineer with production experience building an LLM-powered conversational scheduling assistant (rules-based + OpenAI GPT agents) and improving responsiveness by ~40% through architecture optimization. Strong in orchestration (Airflow), containerized deployments, and data quality (Great Expectations/PySpark), with prior work automating population health reporting pipelines (Azure Data Factory → Snowflake) and delivering insights via Tableau to non-technical stakeholders.”

“Robotics software engineer with hands-on ROS (ROS 1) experience building sensor-processing and state-based control pipelines in Python/C++. Demonstrated measurable reliability and performance gains in autonomous navigation—cut runtime failures by 30%, reduced replanning by 35%, and improved debugging efficiency by 40%—using timing-aware state machines, message/interface discipline, and simulation/testing with Gazebo, rosbag, Docker, and CI/CD.”

“PhD researcher (University of Utah) who built a production RAG-powered Virtual Reality Research Assistant to answer lab research questions with concrete citations. Implemented an end-to-end LangChain pipeline using PyPDFLoader, chunking strategies, OpenAI embeddings, and ChromaDB, with emphasis on grounding to reduce hallucinations and ensure research-grade accuracy. Collaborated closely with a non-technical PhD advisor to scope requirements, manage cost constraints, and demo iterative progress.”