Vetted Databricks Professionals

“Data engineer with healthcare (CVS Health) experience who migrated production PySpark workloads to native BigQuery SQL and built a Great Expectations-based validation microservice on GKE (Flask + REST) integrated into Cloud Composer. Has operated high-volume pipelines (~300–400GB/day) and designed external vendor ingestion on AWS (Lambda/Step Functions/Glue) with schema-drift detection, alerting, and backfill-safe controls to protect downstream Snowflake/BigQuery tables.”

Lavanya Chilakalapudi

Screened

Mid-level Full-Stack Developer specializing in cloud-native web apps and APIs

Tampa, FL5y exp

“Backend engineer with experience building microservice-based systems that integrate LLM workflows (code review suggestions, documentation generation, test scaffolding) using REST APIs, Celery/Redis, and OpenTelemetry for observability. Demonstrates hands-on database and performance optimization in PostgreSQL/SQLAlchemy (bulk inserts, lock mitigation, cursor-based pagination) plus multi-tenant data isolation via tenant-aware models, middleware scoping, and schema/row-level strategies.”

Bhanu Chander

Screened

Senior Data Engineer specializing in cloud data platforms and real-time pipelines

New York, NY6y exp

“Data engineer focused on reliability and observability, building end-to-end pipelines processing millions of records/day from sources like S3 and Kafka. Has hands-on experience with Airflow-based data quality automation, PySpark/Databricks transformations, and shipping versioned Python REST APIs deployed via Docker/Kubernetes with CI/CD (Jenkins) and monitoring (CloudWatch/Azure Logs).”

Abraham Musa

Screened

Senior Solutions Architect specializing in cloud AI infrastructure and security

Union City, NJ9y exp

“Cloud-native architect focused primarily on AWS, with experience designing Kubernetes and AI/ML infrastructure for customers rather than owning day-to-day operations. Particularly interesting for AI platform roles: they described using Amazon Bedrock to analyze Terraform and automatically generate compliant IaC templates and runbooks for new multi-cloud AI environments.”

“Built a production agentic AI system to automate data science work using a layered architecture (executive-summary handling, tool-based execution, and on-the-fly code generation). Demonstrates strong end-to-end agent development practices including RAG with vector databases, prompt engineering, and multi-method evaluation (LLM-as-judge/human/code-based), plus Airflow-based orchestration for ML data pipelines and close collaboration with business end users.”

“LLM/MLOps engineer who has shipped production systems for complaint intelligence and contact-center NLU, including LoRA/RLHF-tuned LLaMA models deployed on GKE with vLLM and Vertex AI batch pipelines to BigQuery. Demonstrates strong practical focus on hallucination control, data imbalance mitigation, and production monitoring (Langfuse) with regression testing and canary rollouts, plus experience orchestrating complex workflows with AWS Step Functions.”

“AI/ML engineer (Cognizant) who built a production, real-time credit card fraud detection platform combining deep-learning anomaly detection with an LLM-based explanation layer. Strong focus on regulated deployment: addressed class imbalance and feature drift, and added guardrails (SHAP/structured inputs, fine-tuning on analyst reports, rule-based validation) to keep explanations accurate and compliant. Orchestrated the full pipeline with Airflow + Databricks/Spark and used MLflow/Prometheus plus A/B and shadow deployments for measurable reliability.”

“Backend/microservices engineer with fintech loan-lifecycle experience operating low-latency (sub-250ms) services in production using Kafka, idempotent transaction design, and Datadog observability. Also built an end-to-end LLM chatbot (React + Flask) with a decoupled model integration layer (FLAN-T5 via Hugging Face) and has experience designing partner-facing REST APIs with OAuth2/JWT and Swagger documentation.”

Vivek Shrivastava

Screened

Director-level Technology Leader specializing in data platforms, AI, and media/AdTech transformation

Los Angeles, California24y exp

“Technology leader who built a unified platform for Fox live sports production operations starting in 2019, delivering an initial operational system on an ~18-month timeline while simultaneously scaling an in-house engineering team from a service-provider partnership. Led a security architecture for external vendors/partners using a separate Okta instance with zero-trust and passwordless authentication, and drove adoption through strong change management, documentation, and agile execution.”

“Engineering leader (player-coach) recently at Autodesk driving a major sales-motion transformation spanning account hierarchy, commissions/quotas, and downstream financial/sales forecasting impacts. Led cross-functional design with enterprise architects and shipped the end-to-end release, using POCs and Anaplan what-if modeling to validate a risky hierarchy change while coordinating delivery across India/Singapore teams and instituting structured Jira-based tech debt/support tracking and automation (dbt, GitHub Copilot).”

“ML/AI engineer with hands-on ownership of both classical ML and GenAI systems in production. They built an end-to-end churn prediction service on AWS and also shipped RAG-based document search/summarization features, with clear experience in monitoring, hallucination reduction, cost/latency optimization, and creating shared Python/LLM infrastructure used across teams.”