Vetted Apache Spark Professionals

David Pang

Screened

Intern Full-Stack Software Engineer specializing in web apps and healthcare APIs

1y exp

“Full-stack developer who built an end-to-end e-commerce application with admin/blog/announcement features using Node/Express and AWS S3, emphasizing security via expiring presigned URLs. Also has strong distributed-systems fundamentals from implementing the Raft consensus algorithm (replication logs, majority acks, leader elections) and has created build automation tools (GNU Makefiles/scripts) to streamline team workflows.”

Dhairya Shah

Screened

Entry-level Machine Learning Engineer specializing in computer vision and systems

Buffalo, NY1y exp

“ML-focused builder who has shipped an end-to-end income-class prediction product: built the data pipeline, trained models, deployed via Streamlit with a live UI, and tracked success via accuracy (84%), adoption, and latency. Demonstrates strong practical MLOps instincts (Docker/Streamlit Cloud, logging/monitoring, caching) and data engineering reliability patterns (schema checks, idempotency, retries, backfills) while iterating quickly in ambiguous, solo-project environments.”

Akash Mishra

Screened

Mid-level Data Engineer specializing in ETL pipelines on GCP

Miami, Florida5y exp

“Full-stack engineer from Larix Technologies who led a Next.js migration feature: an internal real-time workflow status dashboard built with App Router/TypeScript using server components for initial render and client polling for live updates. Demonstrates strong post-launch ownership—monitoring latency/error rates, adding caching and payload reductions, and optimizing Postgres queries/indexes—plus experience building durable RabbitMQ-based message routing workflows with idempotency, retries, and dead-letter queues.”

“Full-stack and AI product engineer who built and deployed two end-to-end projects: TrekTale, a travel story management app, and PromptCraft Finance, an AI-powered financial assistant using multiple open-source LLMs. Particularly strong in turning ambiguous product ideas into modular, production-oriented systems with typed frontend/backend contracts, multi-model inference pipelines, structured outputs, and monitoring for latency, reliability, and regressions.”

“Data engineer focused on building reliable, production-grade pipelines and data services end-to-end, including a 50+ GB/day pipeline ingesting from APIs/files into Snowflake with PySpark/SQL transformations. Emphasizes strong data quality controls, monitoring/retries, and performance optimization, and has also shipped a Python data API with caching and backward-compatible versioning.”

Habtom Desta

Screened

Mid-level Data Scientist specializing in Python, ML, and BI dashboards

Dallas, TX5y exp

“Data/NLP practitioner who builds production-oriented pipelines for unstructured text: entity extraction, topic modeling (LDA/BERTopic), and semantic search using Sentence-BERT embeddings with FAISS. Emphasizes rigorous evaluation (coherence/silhouette + manual review), entity resolution with validation, and scalable workflow orchestration using Airflow/Prefect with Spark/Dask.”

“Machine learning lab assistant at Eastern Illinois University who productionized a voice-enabled conversational AI system: redesigned it with RAG, LoRA fine-tuning (including text-to-SQL), and safety guardrails, then deployed a scalable API supporting ~1,000 daily queries. Also partnered with customer-facing teams during a BlueFi internship by building demos/APIs and accelerating releases via Terraform + AWS CI/CD automation.”

“ML/NLP engineer who has built production systems end-to-end: a real-time recommendation platform (100k+ profiles) using BERTopic-style clustering and a RAG-based news summarization/recommendation stack with ChromaDB. Strong focus on scaling and reliability (GPU batching, Redis caching, Kafka ingestion, Docker/Kubernetes, Prometheus/Grafana) and on maintaining model quality over time via drift monitoring and retraining triggers.”

“Builder with hands-on experience shipping full-stack products across AWS cloud infrastructure, React/TypeScript apps, SQL-backed systems, and privacy-focused AI workflows. Stands out for combining cost-aware architecture, strong debugging instincts, and product thinking—from an e-commerce platform automated with IaC to a university admin portal serving 10,000+ users and a locally run AI assistant with configurable guardrails.”

“Built a university campus assistant chatbot (BabyJ/WWJ) using RAG and agentic routing with a FastAPI + React stack and JWT auth, focusing heavily on production concerns like latency and reliability. Uses techniques like speculative prefetching, smart intent routing, and rigorous eval/testing (golden sets, regression, edge cases) while collaborating closely with campus admin/advising teams to iterate based on real user feedback.”