Vetted Apache Spark Professionals

“Built and deployed a production generative-AI copilot at Tungsten that automates invoice/form extraction template creation, reducing weeks of manual model-building work. Combines fine-tuned LLMs (PyTorch/HuggingFace) with OpenCV layout grounding to reduce hallucinations, and runs an end-to-end Kubeflow-based MLOps pipeline with drift monitoring, canary releases, and automated retraining.”

“LLM engineer who has deployed a production RAG system (LangChain/FAISS/FastAPI) for enterprise semantic search, tackling real-world latency by LoRA/PEFT fine-tuning and grounding outputs with retrieval. Brings strong MLOps (Docker, AWS EKS, CI/CD, MLflow) plus stakeholder-facing explainability experience using SHAP to align ML-driven financial guidance with non-technical domain experts.”

“Senior backend/data engineer who has built and maintained HIPAA-compliant, real-time clinical FastAPI services on AWS, orchestrating ML/LLM and vector DB calls with strong reliability patterns (auth, timeouts/retries, graceful degradation, idempotency). Also delivered AWS IaC/CI-CD (Terraform/Helm/GitHub Actions) across EKS/Lambda/SageMaker and built Glue/Spark ETL with schema evolution and data quality controls, plus demonstrated large SQL performance wins (15 min to <9 sec) and hands-on incident ownership.”

“Built and deployed a production AI accessibility platform that turns chart and image-based graphs into real-time audio narratives for visually impaired users. Implemented a ResNet-based CV + OCR + NLP + TTS pipeline and improved performance through preprocessing, Redis caching, and Kubernetes autoscaling/rolling updates on AWS to handle traffic spikes with no downtime.”

“Built a production multi-agent RAG assistant using LangChain/LangGraph with OpenAI embeddings and FAISS, focusing on retrieval quality and latency (Redis caching, parallel retrieval, precomputed embeddings). Experienced orchestrating ETL/ML pipelines with Airflow and Databricks Workflows, and has delivered an AI assistant for business ops to extract insights from policy/compliance documents through close non-technical stakeholder collaboration.”

“Built and deployed a production-grade LLM agent for credit management and accounts receivable automation, integrating ERP/MySQL data via a RAG pipeline and exposing services through FastAPI with Pydantic-validated outputs on AWS Bedrock. Emphasizes reliability and compliance for financial operations using schema validation and human-in-the-loop review, reporting ~32% reduction in manual work and ~41% improvement in response time/reliability.”

“Built and deployed production LLM applications including a natural-language-to-read-only-SQL system focused on ambiguity handling and query safety (schema whitelisting, intent validation, confidence checks, deterministic execution). Experienced with LangChain-based, modular agent orchestration and RAG document QA for large PDFs, with a metrics-driven testing/evaluation approach and cross-functional delivery with marketing on an AI content recommendation/search tool.”

“Built and deployed a production AI-powered personalized learning platform (Django + FastAPI) featuring an LLM+RAG tutoring assistant and automated grading. Demonstrates strong applied LLM reliability engineering (structured JSON outputs with Pydantic validation, hallucination control via FAISS-based RAG thresholds and refusals) plus scalable async microservice design and Airflow-orchestrated ETL across AWS/GCP.”

“Built a production-style AI meeting summarization and action-item extraction system (Azure Speech-to-Text + transformer summarization/NER) exposed via a Flask REST API, with explicit guardrails to prevent hallucinated tasks. Strong focus on reliability: modular agent/workflow design, precision-first evaluation with human-validated golden notes, and practical orchestration patterns (tool-augmented agents; ready to scale into Airflow/LangGraph/Prefect).”

“Co-op engineer who owned and shipped a Python/Flask backend for automating architecture reviews and system metadata processing, including ingestion from multiple internal APIs, RBAC, testing, and deployment. Has hands-on Kubernetes + GitOps (ArgoCD) experience, built Kafka-based real-time ingestion, and supported a cloud-to-on-prem migration with phased cutover, smoke tests, and performance tuning.”

“PhD in computer engineering who has built production-oriented ML/NLP systems for space-weather prediction using Spark-based ETL on noisy satellite sensor logs. Strong in entity resolution and semantic search—fine-tuned E5 embeddings with contrastive learning and deployed to Pinecone, improving top-5 retrieval precision by 25%—and emphasizes scalable, observable pipelines with Airflow, Docker, and CI/CD.”

“Backend/full-stack engineer who owned a cloud-native, AWS-based microservices backend for an HRIS product used by ~10,000 users, including onboarding and workflow orchestration. Strong production focus on event-driven architecture, idempotency/retries, observability, and developer-friendly API design (OpenAPI, versioning, JWT), plus hands-on Selenium automation for resilient checkout-style flows.”