Skip to content Skip to sidebar Skip to footer
Home / C# / Ironpython / Python / Scrapy

.net Framework With Scrapy Python

Post a Comment
Is it possible to use .NET framework with the Python scrapy framework to scrape data from different sites? I am working on my final year project in which I want to use C# as front

Solution 1:

I don't think it is possible, because Scrapy uses twisted networking engine which can not run on IronPython

Alternatively, you may start your spider/crawler through command line using C# and then interact with it using JSON API

Solution 2:

Take a look at ScrapySharp, also described on this blog, which is the C# version of python's Scrapy.

Post a Comment for ".net Framework With Scrapy Python"