Mid-Level Data Engineer specializing in cloud data pipelines and big data platforms
Newark, NJData Engineer3 years experienceMid-LevelHealthcareHealthcare ITTechnology
ScreenedIdentity Verified
Connect with bharath
bharath already has a relationship with Reval, so a warm intro from us gets a much better response than cold outreach.
Recommended
Already have an account?
About
Data engineer with ~4 years of experience building Python-based data ingestion/processing services and real-time streaming pipelines (Kafka/PubSub + Spark Structured Streaming). Has deployed containerized data applications on Kubernetes with GitLab CI/Jenkins pipelines and applied GitOps to cut deployment time ~40% while reducing config drift. Also supported a legacy on-prem data warehouse/backend migration to GCP using phased migration and parallel validation to meet strict reliability/SLA needs.
Experience
Data EngineerHorizon BCBS
Data EngineerAltair Engineering India Pvt Ltd
Intern - Data ScienceIris Software
Education
The University of Memphismaster, Data science
Sri Sai Degree & PG Collegebachelor, Computer Science
Key Strengths
Built Python data-ingestion services integrating relational DBs and APIs with validation/business rules
Orchestrated and monitored backend data jobs with Airflow (retries/failure handling)
Performance tuning at scale: optimized SQL/PySpark and reduced processing time by addressing memory/timeouts
Strong data platform fundamentals: schema design and query tuning across MySQL and BigQuery
Kubernetes production deployment experience (manifests, ConfigMaps/Secrets, resource limits, health checks, autoscaling)
Designed CI/CD pipelines with GitLab CI and Jenkins (lint/unit tests, Docker build/versioning, deploy via manifests)
Supported on-prem to cloud migration to GCP using phased migration and parallel runs with validation to minimize downtime
Built real-time streaming pipelines with Kafka/PubSub and Spark Structured Streaming; resolved consumer lag via partition/concurrency tuning and robust schema validation with DLQ
Applied GitOps to reduce deployment time ~40% and eliminate configuration drift
Discover more candidates like bharath
Search across thousands of pre-screened, high-quality, high-intent candidates on Reval.