Vetted Apache Spark Professionals

“Backend engineer who built an agentic LLM system for private equity/finance that answers questions over enterprise contracts and documents using a vector-db RAG pipeline. Differentiator is a trust-focused citation framework (with highlighted source text) to reduce hallucinations in high-stakes workflows, plus strong DevOps experience deploying microservices on Kubernetes with Helm/GitOps and building Kafka real-time pipelines.”

“AI/ML manager who has deployed production NLP in healthcare—mining unstructured clinical notes and combining them with structured patient data to predict readmissions, with strong emphasis on data alignment and terminology normalization. Also experienced operationalizing ML with Airflow/MLflow and AWS Step Functions/SageMaker, plus stakeholder-facing Power BI dashboards (e.g., marketing customer segmentation).”

“AI automation builder who shipped an OpenAI-powered weekly "trending AI tools" WoW reporting system (65 categories) that reduced a 6–7 hour manual process to ~10 minutes at negligible API cost. Also building a RAG-based content creation prompt engine that turns PDFs into storyboards with fact-checking/traceback to source lines, plus experience with AWS deployment components (Lambda, ECR, App Runner, Bedrock, API Gateway) and GitHub Actions.”

“AI Engineer with production experience building an LLM-powered conversational scheduling assistant (rules-based + OpenAI GPT agents) and improving responsiveness by ~40% through architecture optimization. Strong in orchestration (Airflow), containerized deployments, and data quality (Great Expectations/PySpark), with prior work automating population health reporting pipelines (Azure Data Factory → Snowflake) and delivering insights via Tableau to non-technical stakeholders.”

“Backend engineer with deep experience modernizing a provider credentialing/compliance platform with multiple upstream/downstream integrations. Focused on building predictable, scalable REST APIs (primarily ASP.NET Core; framework-agnostic approach applicable to FastAPI), improving performance via DB/query optimization, and hardening workflows with idempotency, transactions, feature flags, and strong auth/RBAC patterns.”

“Built and deployed production LLM systems for summarizing sensitive legal and financial documents, emphasizing GDPR-aligned privacy controls and scalable hybrid cloud architecture. Experienced with Kubernetes/Airflow orchestration and rigorous testing/monitoring practices, and has delivered measurable business impact (18% conversion lift) by translating AI outputs for non-technical marketing stakeholders.”

“Built and shipped a production GPT-4 + RAG customer support chatbot that materially improved support operations (response time 4 hours to <3 minutes; ~65% tier-1 ticket automation). Demonstrates strong end-to-end LLM engineering across retrieval (Sentence Transformers/Pinecone), safety (multi-layer moderation), cost/latency optimization (caching/streaming, Celery/Redis), and rigorous evaluation/monitoring (shadow deploys, Datadog, 500+ test cases), plus proven stakeholder buy-in leading to 80% adoption.”

“Built and productionized a clinical NLP + patient risk stratification platform at Dermanture, combining Spark/PySpark pipelines with BERT/BioBERT for entity extraction and text classification and downstream risk models in TensorFlow/scikit-learn. Experienced running regulated, auditable ML workflows with Airflow and AWS SageMaker, emphasizing data validation (Great Expectations), drift monitoring, and explainability (SHAP) to drive clinician trust and adoption.”

“Built a production "Mini RAG Assistant" for internal document Q&A, focusing on grounded answers (anti-hallucination), retrieval quality, and latency/cost optimization. Uses LangChain/LangGraph for orchestration and applies a metrics-driven evaluation loop (including reranking and semantic chunking improvements) while collaborating closely with product stakeholders.”

“Built and deployed a production LLM-powered RAG knowledge system to unify operational/policy information across PDFs, wikis, and databases, emphasizing auditability and low-latency/cost performance. Improved answer relevance at scale by moving from pure vector search to hybrid retrieval with metadata filtering and reranking, and partnered closely with healthcare operations/compliance to define acceptance criteria and human-in-the-loop guardrails.”

“At Liberty Mutual, built a production underwriting decision assistant combining LLM reasoning with quantitative models and strong auditability. Implemented a claims-based response verification pipeline that cut hallucinations from 18% to 3% and materially improved user trust/validation scores. Experienced orchestrating ML/LLM workflows end-to-end with Airflow, Kubeflow Pipelines, and Jenkins, including SLA-focused pipeline hardening.”

“Full-stack engineer focused on data-heavy platforms, building Spring Boot microservices and Angular/React dashboards end-to-end. Has hands-on experience improving large-scale API and UI performance (including cutting 8–10s response times) and ensuring cross-service consistency using Kafka, idempotent consumers, and strong validation/transaction patterns on AWS with CI/CD and observability (Prometheus/ELK).”

“Senior Data Scientist in consulting who has built production RAG systems for insurance/annuity document search at large scale (100K+ PDF pages), emphasizing grounded answers, guardrails, and low-latency retrieval. Experienced in end-to-end MLOps for LLM apps—monitoring, evaluation sets, drift handling, and safe rollouts—and in orchestrating complex pipelines with Prefect/Airflow and deploying services on Kubernetes.”

“ML/NLP engineer with banking domain experience who built a GenAI-powered fraud detection and risk intelligence system at Origin Bank, combining RAG (LangChain + FAISS), fine-tuned BERT NER, and GPT-4/Sentence-BERT embeddings. Delivered measurable impact (25% higher fraud detection accuracy, 40% less manual review) and emphasizes production-grade pipelines on AWS SageMaker/Airflow with strong data validation and scalable PySpark processing.”

“Backend-focused TypeScript/Node.js engineer who owned a production microservice for transactional workflows in a React + microservices platform, integrating REST and Kafka event processing. Emphasizes operability and correctness (idempotency keys, exponential backoff retries, DLQs, centralized logging/metrics/alerts) plus strong API DX via versioning and Swagger/OpenAPI with improved error contracts based on developer feedback.”

“Backend/AI engineer who has shipped production LLM systems end-to-end, including an AI request-routing service (FastAPI + BART MNLI + OpenAI/Gemini) that improved accuracy ~25% after launch via eval-driven prompt/category iteration. Also built an enterprise document intelligence/RAG platform on Azure (Blob/SharePoint/Teams ingestion, OCR/NLP chunking, embeddings in Azure Cognitive Search) with PII guardrails (Presidio), confidence gating, and scalable event-driven pipelines handling millions of documents.”

“Full-stack engineer with strong production ownership across React/TypeScript, Node.js, and AWS (EC2/ECS/RDS/CloudWatch), including CI/CD, observability, and incident response. Delivered a secure RBAC workflow module end-to-end and achieved measurable gains (~30–40% latency reduction, ~50% error reduction) that lowered infra/ops costs. Comfortable in high-ambiguity startup environments—shipped a payment module within 2 days of joining with no documentation.”

“Backend/AI engineer with internship experience building an AI-powered financial insights platform (FastAPI, Redis, BigQuery) and prior HCL experience leading a monolith-to-microservices refactor (Flask, Kafka) using blue-green deployments. Demonstrates strong performance/security focus (OAuth/JWT/RBAC, encryption) and measurable impact on latency, downtime, and ML model reliability; MVP was submitted to Google’s accelerator program.”