Skip to content Skip to sidebar Skip to footer

Scrapy: Dealing With Special Characters In Url

I'm scraping an XML sitemap which contains special characters like é, which results in ERROR: Spider error processing How do I get

Solution 1:

I don't think you can do that as Scrapy usessafe_url_string from w3lib library before storing Requests URL. You would somehow have to reverse that.

Solution 2:

You may use 'r' letter before your URL: url = r'name of that url'

Post a Comment for "Scrapy: Dealing With Special Characters In Url"