Scrapy Use Cases and References on the web

  1. Extracting data from Websites : https://kaismh.wordpress.com/tag/scrapy/
  2. Web Scraping AirBnB : http://www.verginer.eu/blog/web-scraping-airbnb/
  3. Recursively scraping a blog with Scrapy : https://milinda.svbtle.com/recursively-scraping-a-blog-with-scrapy
  4. Tutorial , How to scrapte amazon.com using python scrapy : http://blog.datahut.co/tutorial-how-to-scrape-amazon-using-python-scrapy/
  5. Email harvesting using web scraping : http://blog.datahut.co/email-harvesting-using-web-scraping-is-broken-here-is-how-to-fix-it/
  6. Scraping Real-Estate portals to stay ahead of your competitors : http://blog.datahut.co/scraping-real-estate-portals-to-stay-ahead-of-your-competitors/
  7. Managing anti-scraping mechanism used by target websites : use of websites like IP-address rotators and anonymous networks.
  8. Pricing logic for we data extraction service : http://blog.datahut.co/how-to-understand-the-pricing-logic-of-a-web-data-extraction-project/
  9. Business directory scraping : http://blog.datahut.co/tips-for-scraping-business-directories/
  10. Webscraping product data from e-commerce websites : http://blog.datahut.co/web-scraping-for-the-extraction-of-product-data-from-e-commerce-sites/
  11. Building an Events aggregator using web scraping : http://blog.datahut.co/building-an-event-aggregator-using-web-scraping/

Scrapy links :

  1. http://hopefulramble.blogspot.com/2014/08/web-scraping-with-scrapy-first-steps_30.html
  2. https://amaral.northwestern.edu/blog/quick-introduction-web-crawling-using-scrapy-part-
  3. https://realpython.com/blog/python/web-scraping-and-crawling-with-scrapy-and-mongodb/
  4. http://docs.python-guide.org/en/latest/scenarios/scrape/
  5. http://blog.danwin.com/examples-of-web-scraping-in-python-3-x-for-data-journalists/
  6. https://blog.scrapinghub.com/2016/05/25/data-extraction-with-scrapy-and-python-3/
  7. using XPath Selectors with Scrapy : https://doc.scrapy.org/en/latest/topics/selectors.html
  8. http://www.blog.pythonlibrary.org/2016/08/04/a-simple-intro-to-web-scraping-with-python/