.png){kind=logo}
Rahul Reddy
Senior Data Engineer specializing in cloud data platforms and big data pipelines
Connect with Rahul
Rahul already has a relationship with Reval, so a warm intro from us gets a much better response than cold outreach.
Recommended
Already have an account?
About
Data engineer with healthcare (CVS Health) experience who migrated production PySpark workloads to native BigQuery SQL and built a Great Expectations-based validation microservice on GKE (Flask + REST) integrated into Cloud Composer. Has operated high-volume pipelines (~300–400GB/day) and designed external vendor ingestion on AWS (Lambda/Step Functions/Glue) with schema-drift detection, alerting, and backfill-safe controls to protect downstream Snowflake/BigQuery tables.
Find your next great hire
Our AI agents source, screen, and vet candidates for your open roles. Get qualified candidates within 48 hours.
Key Strengths
- Owned end-to-end data pipeline migration from PySpark to native BigQuery SQL
- Built and deployed a data validation microservice (Great Expectations) on GKE with REST endpoints
- Implemented automated data quality gates (schema/null/business-rule checks) to reduce schema drift and data mismatches
- Handled large daily data volumes (~300–400 GB/day) with incremental/full loads and backfills
- Designed external vendor ingestion with AWS Lambda + Step Functions, including early-fail validation before Snowflake landing
- Implemented robust failure handling (retries, exponential backoff, throttling, API key rotation) for rate-limited APIs
- Set up CI/CD with Jenkins and production observability/alerting (Stackdriver/Composer, CloudWatch/SNS/email)
- Improved developer usability via Swagger docs, JSON rule templates, versioned API routes, and clear error messaging
Like what you see? We'll introduce you to Rahul directly.
Experience
Education
Skills
Languages
Browse Similar
Similar Candidates
Rom Manzano
Executive technical founder and full-stack engineer specializing in AI, SaaS, and FinTech
“Engineer coming out of a venture studio as it winds down, now seeking another zero-to-one environment with strong studio support and go-to-market playbooks. They show a thoughtful founder mindset centered on rapid shipping, design-partner validation, lean execution, and testing whether users will actually pay for a workflow-specific solution.”
Thuc Duong
Senior Data Engineer specializing in AI-driven GTM analytics and LLM evaluation
“Data/analytics engineer who stood up foundational pipelines and services at Meta for the Ray-Ban Meta launch—building a retailer sales ingestion system (S3/Hive) with rigorous DQ checks, 1-day SLAs, and dimensional rollups used by GTM to track sales trends. Also built a modular multi-retailer web-scraping system for out-of-stock alerts and shipped internal GraphQL APIs and an n8n-like workflow builder using serverless (AWS Lambda) with strong testing and observability practices.”
Mid-level Data Engineer specializing in big data platforms and analytics infrastructure
Staff-level Software Engineer specializing in AI, data platforms, and cloud infrastructure
Interested in Rahul?
We'll personally introduce you - no strings attached.
Build your dream team with Reval
Our AI agents source, screen, and vet candidates for your open roles. Get qualified, high-intent candidates on your desk within 48 hours.
Discover more candidates like Rahul
Search across thousands of pre-screened, high-quality, high-intent candidates on Reval.
Search Talent