.png){kind=logo}
Jaideep Janapati
Mid-level Data Engineer specializing in cloud data platforms and real-time pipelines
Connect with Jaideep
Jaideep already has a relationship with Reval, so a warm intro from us gets a much better response than cold outreach.
Recommended
Already have an account?
About
Data engineer who has owned production pipelines end-to-end—from Kafka/Airflow ingestion through SQL/Python validation and dbt transformations into Redshift/BI. Also built and operated a large-scale distributed web scraping platform (50–100 sites daily, ~5–10M records/day) with Kubernetes, Kafka queues, robust retries/DLQ, anti-bot measures, and backfill-safe raw HTML storage.
Find your next great hire
Our AI agents source, screen, and vet candidates for your open roles. Get qualified candidates within 48 hours.
Key Strengths
- Owned end-to-end near real-time customer engagement data pipeline (events + transactions + CRM) for dashboards/experiments
- Built data validation and quality framework (schema/type checks, freshness, volume anomaly detection) with automated Slack alerts
- Implemented transformations and standardized data models using SQL/dbt (cleaning, deduplication, joins, aggregated metrics)
- Designed large-scale distributed web scraping system (50–100 sites/day; ~5–10M records/day) using Scrapy on Kubernetes with Kafka queues
- Robust scraping reliability patterns: multi-tier retries, dead-letter queue, domain-level monitoring/alerting, anti-bot tactics, raw HTML storage for parser fixes/backfills
- Early-stage delivery in ambiguous environment: scoped MVP metrics/events, chose batch-first tradeoffs, set up CI/testing, observability, idempotency, and backfill capability
Like what you see? We'll introduce you to Jaideep directly.
Experience
Education
Skills
Languages
Certifications
Browse Similar
Interested in Jaideep?
We'll personally introduce you - no strings attached.
Build your dream team with Reval
Our AI agents source, screen, and vet candidates for your open roles. Get qualified, high-intent candidates on your desk within 48 hours.
Discover more candidates like Jaideep
Search across thousands of pre-screened, high-quality, high-intent candidates on Reval.
Search Talent