Kishan Mehta

Experience

1. Zyte

   Team Lead Current Feb 2023 – Present

   • Lead a team of 3 engineers managing 40–50 active customer Scrapy projects simultaneously
   • Architect distributed crawling pipelines handling millions of records per day across e-commerce, finance, and real estate
   • Design anti-bot strategies, proxy-based scraping solutions, and middleware engineering for high-demand accounts
   • Built internal AI-powered weekly SLA reviewer and profitability reviewer automations, reducing manual review overhead
   • Mentor engineers on Python best practices, system design, and Scrapy internals; conduct technical interviews

   • Python
   • Scrapy
   • Django
   • AWS
   • Docker
2. Zyte

   Senior Python Developer May 2019 – Feb 2023

   • Built high-volume Scrapy crawlers for complex websites across diverse client industries
   • Processed and maintained datasets exceeding 20M records, improving reliability and data availability
   • Investigated crawler blocking issues and worked with anti-ban capabilities to improve resilience
   • Designed data pipelines for cleaning, normalization, and structured JSON/CSV delivery

   • Python
   • Scrapy
   • Django
   • PostgreSQL
   • Redis
3. Mobifly

   Full Stack Developer Nov 2016 – Apr 2019

   • Built a mediation engine syncing data from multiple ad networks in real time
   • Implemented an Ad-units project that increased revenue by 25%
   • Built an in-house ad-verification tool, eliminating the cost of a third-party service
   • Evaluated message queue migration from CloudAMQP to RabbitMQ on AWS for infrastructure optimization

   • Python
   • JavaScript
   • Django
   • React
   • RabbitMQ
   • AWS
4. Plancess EduSolutions

   Python / Django Developer Aug 2015 – May 2016

   • Built REST APIs with Django Rest Framework; implemented SMS-based phone verification
   • Set up Celery queues for transactional email delivery at scale
   • Automated log rotation to Amazon S3 via gunicorn/nginx scripts

   • Python
   • Django
   • DRF
   • Celery
   • AWS
5. Capgemini

   Senior Software Engineer Jun 2013 – Aug 2015

   • Application support and maintenance including weekend outage coverage
   • Significantly increased unit test coverage across legacy modules
   • Automated documentation-heavy tasks using cron jobs

   • Java
   • SQL
   • Python

Skills

Education & Certifications

Projects

A collection of personal experiments and learning projects — built to deepen expertise in Python, Scrapy, and React.

Python

Web Crawler

A depth-first web crawler built in Python that starts from a seed URL and follows links up to a configurable limit.

Python · Scrapy

Product Information Scraper

A Scrapy-based spider that extracts structured product data from e-commerce sites and delivers clean JSON/CSV output.

Python · Scrapy

Reports Information Scraper

Scrapy spider that follows paginated report listings and exports structured CSV output, demonstrating pagination and link-following.

React · Redux

Mini Twitter Clone

Built to learn React state management, component architecture, and Redux patterns. Supports timeline, posting, replies, and likes.

React · Redux

Would You Rather

Polling web app with user-created questions, vote tracking, and a leaderboard. Focused on Redux data flow and auth patterns.

React · Redux

MyReads

Personalised bookshelf app. Users search for books and move them between "read", "want to read", and "currently reading" shelves.

React Native

Mobile Flashcards

Cross-platform iOS/Android flashcard study app. Users create decks, add Q&A cards, and run timed quiz sessions.

Contact

The best way to reach me is via LinkedIn or email. Open to opportunities