You can use the App Engine to retrieve web pages or other information from foreign servers and process them in your python program.<\/p>\n
This must obviously be limited, because the abuse potential is very high. Therefore you can not call all possible Internet services. You can retrieve only “web pages” or everything that a Web server is offering on port 80 or 443.<\/p>\n
The module urlfetch implements it. A simple usage is:<\/p>\n
response = urlfetch.fetch(url)\r\ncontent = response.content<\/pre>\nIf everything goes well, this is enough. So far, this is very convienent. But in most real world scenarios, you need to handle all kind of error conditions. Like in this skeleton:<\/p>\n
try:\r\n response = urlfetch.fetch(jadurl)\r\n if response.status_code == 200:\r\n self.xxheaders = response.headers\r\n self.xxcontent = response.content\r\n self.xxFetched = True\r\n elif response.status_code == 404:\r\n self.errortext = \"File not found\"\r\n self.xxcontent = \"not found\"\r\n else:\r\n self.errortext = \"Bad Response Code\"\r\n self.xxcontent = response.status_code\r\n except InvalidURLError:\r\n self.errortext = \"Invalid URL\"\r\n except DownloadError:\r\n self.errortext = \"Error downloading file\"\r\n except ResponseTooLargeError:\r\n self.errortext = \"File to large\"<\/pre>\nHTTP-Headers<\/h3>\n
You can also access to the HTTP headers. For example, if you want to access the mime type:<\/p>\n
response.headers['content-type']<\/pre>\nIn my particular use case I am also interested whether a header is sent twice. It seems that you can not get this information.<\/p>\n
SSL<\/h3>\n
You can also access SSL-protected pages with “https: \/ \/ . Unfortunately, according to the documentation as of version 1.1, the certificate is not checked. This means, the increased security is not there. This restricts the possible application range.<\/p>","protected":false},"excerpt":{"rendered":"
You can use the App Engine to retrieve web pages or other information from foreign servers and process them in your python program. This must obviously be limited, because the abuse potential is very high. Therefore you can not call all possible Internet services. You can retrieve only “web pages” or everything that a Web … <\/p>\n