Vetted Apache Airflow Professionals

“Backend engineer who built and iterated a secure, multi-tenant RAG system over a large document corpus, emphasizing strict RBAC/ACL isolation, hybrid retrieval (vector+keyword), reranking, and strong observability to balance relevance, latency, and cost. Also led production refactors/migrations using strangler + feature flags/dual writes and has experience catching subtle real-world failure modes (including in a sensor calibration optimization pipeline).”

“ML/AI engineer focused on production-grade model reliability: built a monitoring and validation framework to detect drift, trigger anomaly alerts/retraining, and maintain consistent performance for device intelligence workflows at scale. Strong MLOps background with Python pipelines, Docker/Kubernetes deployments, Airflow orchestration, and real-time monitoring dashboards; experienced partnering with product managers to deliver business-facing insights.”

“Built a production LLM/RAG assistant for insurance/health claims agents that ingests 100–200 page patient PDFs via OCR (migrated from local Tesseract to Azure Document Intelligence) and delivers grounded claim detail retrieval plus summaries with PII/PHI guardrails. Experienced orchestrating large workflows with Celery worker pipelines and AWS Step Functions (S3-triggered, Fargate-based batch inference/accuracy aggregation), and collaborates closely with non-technical SMEs (claims agents/nurses) through shadowing, iterative demos, and SME-defined evaluation.”

“AI engineer at Anote.ai who built and shipped a production multi-agent LangGraph/LangChain/Ray RAG platform for enterprise search and workflow automation, supporting 3 commercial products and 100+ developers. Drove measurable gains (30% accuracy improvement, lower latency) and improved reliability with Redis-based state checkpointing, message-queue synchronization, and Milvus retrieval optimizations, while partnering with PMs/clients to add transparency features like confidence scores and real-time logs.”

“Data engineer at Plaid who built greenfield, end-to-end real-time transaction pipelines and FastAPI data services for fraud detection and analytics, handling millions of events per day. Strong focus on reliability and data integrity via Great Expectations validation, Airflow-based monitoring/SLAs, quarantine/staging patterns, and robust external data ingestion with schema versioning and backfills (reported 50% fewer anomalies and ~40% fewer failures).”

“Built and shipped production improvements to a Paylocity RAG-based AI assistant, redesigning retrieval into a hybrid HNSW + keyword pipeline and using tuned RRF to fuse rankings—cutting latency by ~2s and reducing token usage by ~5000. Previously spearheaded Apache Airflow integration across ETL pipelines at Acuity Knowledge Partners, creating reusable templates and automated triggers to reduce manual job monitoring.”