Vetted PySpark Professionals

“Data/ML engineer in financial services (Northern Trust) who built a production RAG-based LLM system to connect structured transaction/portfolio data with unstructured market and internal documents for risk teams. Strong in end-to-end pipelines (AWS Glue/Airflow/PySpark), entity resolution, and taking models from prototype to reliable daily production with performance tuning (LoRA + TensorRT) and monitoring.”

“Built and productionized an internal GenAI chatbot that makes company policy/SOP knowledge instantly searchable, using a secure RAG architecture on AWS (Bedrock/Titan embeddings/OpenSearch Serverless, Textract/Lambda/S3 ingestion, Claude 3 Sonnet). Demonstrates strong MLOps/orchestration experience (Airflow, Step Functions with Lambda/Glue/SageMaker) and a rigorous reliability approach (RAGAS metrics, A/B testing, citation validation, monitoring), including collaboration with compliance stakeholders via review dashboards.”

“Built and deployed a production RAG pipeline at PNC Financial Services to let risk/compliance analysts query millions of internal financial documents in natural language, reducing manual search and speeding regulatory validation. Demonstrates deep practical experience with large-scale document ingestion/OCR cleanup, retrieval performance tuning (hierarchical indexing, caching), and LLM reliability controls (grounding, citations, abstention), plus cloud orchestration on Azure and AWS.”

“AI/LLM engineer with healthcare domain experience who built a production clinical support “chart bot” for Molina, including PHI-safe ingestion of 200k+ PDF policies, vector retrieval, and a fine-tuned LLaMA served via vLLM on ECS Fargate. Demonstrated measurable performance wins (HNSW + namespace partitioning; 30% inference latency reduction) and a rigorous evaluation/monitoring approach, while partnering closely with nurses and operations teams to shape workflows and guardrails.”

“LLM/agent engineer at USAA who built a production GPT-4o RAG conversational assistant for financial analysts, focused on regulatory interpretation and internal documentation search. Emphasizes compliance-grade reliability with strict grounding, safe fallbacks, and full auditability via MLflow/DVC plus human-in-the-loop review; reports ~45% reduction in ticket resolution time.”

“Infrastructure security/DevSecOps engineer who led security and automation patterns during a large Azure migration (30+ legacy apps, wave-based execution), enforcing zero-trust controls by baking CrowdStrike/Illumio into golden images and adding CI/CD security gates. Experienced integrating GitLab runners and Terraform agents as containerized services with strong secrets management (Azure Key Vault) and disciplined image/versioning practices, and has hands-on troubleshooting of ACI runtime constraints under load.”

“Backend/data engineer who reports building production Python services (FastAPI + JWT) backed by Postgres and Redis, and modernizing data workflows using AWS Glue + PySpark with S3/RDS. States experience delivering AWS solutions (S3, SES, Cognito) and using golden datasets/snapshot testing for migration parity, with many details withheld due to NDAs. Seeking fully remote work with a $300k base salary expectation.”

“Built and deployed a production LLM-powered support assistant for customer support agents using a RAG architecture over internal docs and past tickets, with human-in-the-loop review. Demonstrates strong applied LLM engineering focused on real-world constraints (hallucinations, latency, cost) using routing to smaller models, reranking, caching, and rigorous evaluation/monitoring (offline eval sets, A/B tests, KPI tracking).”

“At FiVerity, built and deployed a production LLM/RAG-based Information Gathering Tool for credit union fraud analysts that generates auditable investigation summaries from verified evidence. Focused on high-stakes constraints—hallucination prevention, cross-entity leakage controls, compliance/PII-safe monitoring, and latency—while also shipping customer-facing agentic workflows using CrewAI and LangGraph in close partnership with fraud and compliance stakeholders.”