Python Channel

I have a developed a part of code which I use from web scraping: link = 'http://www.cmegroup.co… Read more Urlopen [errno -2] Python

I faced with strange bug: urllib2 catches 404 error, while openning a valid url. I tryed it in brow… Read more Urllib2 Catches 404 Error While Url Exists

Is there an easy way to scrape Google and write the text (just the text) of the top N (say, 1000) .… Read more Python - Easy Way To Scrape Google, Download Top N Hits (entire .html Documents) For Given Search?

I am trying to scrape the website http://www.nseindia.com using urllib2 and BeautifulSoup. Unfortun… Read more Web Scraping Using Python

I have posted to this site and received really helpful guidance, i return with another question. Wh… Read more Urllib2 Error 403: Forbidden

Python novice here. I'm making a lot of asynchronous http requests using eventlet and urllib2. … Read more How To Fix Python, Urlopen Error [errno 8], Using Eventlet Green

I get the following an error when downloading html pages from the urls. Error: raise URLError(err) … Read more Timeout Error When Downloading .html Files From Urls

def make_req(data, url, method='POST') params = urllib.urlencode(data) headers = … Read more Gaierror: [errno -2] Name Or Service Not Known

Python beginner here. I want to be able to timeout my download of a video file if the process takes… Read more Timeout A File Download With Python Urllib?

I am trying to develop a python script to run REST backup procedure as shown in http://confluence.j… Read more Python Rest / Teamcity Backup

My goal is to come up with a portable urllib2 solution that would POST a form and then redirect the… Read more Urllib2: Submitting A Form And Then Redirecting

I've just inherited some Python code and need to fix a bug as soon as possible. I have very lit… Read more Timing Out Urllib2 Urlopen Operation In Python 2.4

I've been scraping websites before using this same technique. But with this website it seems to… Read more Issue Scraping With Beautiful Soup

I'm new to web scraping, have little exposure to html file systems and wanted to know if there … Read more Pin Down Exact Content Location In Html For Web Scraping Urllib2 Beautiful Soup

Is it possible using urllib or urllib2 to send no data with a POST request? Sounds odd, but the API… Read more How To Send Post Request With No Data

I'm trying to open a local file using urllib2. How can I go about doing this? When I try the … Read more Opening Local File Works With Urllib But Not With Urllib2

So i am fairly fluent with python and have used urllib2 and Cookies a lot for website automation. I… Read more Opening A Website Frame Or Image In Python

I am trying to get all the historical information of a particular stock from yahoo finance. I am ne… Read more Python Web Scraping On Large Html Webpages

[Windows 7 64 bit; Python 2.7] If I try to use Urllib2, I get this error Traceback (most recent cal… Read more Proxy Authentication Error In Urllib2 (python 2.7)

Ok so I need to download some web pages using Python and did a quick investigation of my options. I… Read more Which Is Best In Python: Urllib2, PycURL Or Mechanize?