Path: csiph.com!usenet.pasdenom.info!aioe.org!news.stack.nl!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
MIME-Version: 1.0
Sender: chris@rebertia.com
In-Reply-To: <tencent_60EA94C653DEE92B0EC0ED9E@qq.com>
References: <tencent_60EA94C653DEE92B0EC0ED9E@qq.com>
Date: Thu, 28 Mar 2013 21:58:19 -0700
Subject: Re: Curl and python httplib?
From: Chris Rebert <clp2@rebertia.com>
Cc: python-list <python-list@python.org>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Precedence: list
Newsgroups: comp.lang.python
Message-ID: <mailman.3935.1364533107.2939.python-list@python.org>
Lines: 62
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: csiph.com comp.lang.python:42221

On Wed, Mar 27, 2013 at 7:54 PM, =E5=B0=8F=E5=AD=A6=E5=9B=ADPHP <xxy-php@qq=
.com> wrote:
> Guys,
>
> I take a project that need send request to Hadoop by curl.
> But now, the curl and pycurl can't satisfy my project. So i need use the
> powerful httplib.

I would say that `requests`
(http://docs.python-requests.org/en/latest/ ) is generally preferable
to httplib these days.

> But failed.
>
> my curl request:
> curl -i -X PUT "http://localhost:50070/webhdfs/v1/levi/7?op=3DCREATE"
>
> my return:
> HTTP/1.1 307 TEMPORARY_REDIRECT
> Content-Type: application/octet-stream
> Location:
> http://58.53.211.47:50075/webhdfs/v1/levi/7?op=3DCREATE&overwrite=3Dfalse
> Content-Length: 0
> Server: Jetty(6.1.26)
>
> Now, i change the curl request to httplib:
> import httplib
> import urllib
>
> params=3Durllib.urlencode({"@op":"CREATE","@user.name":"levi"})
> headers=3D{"Content-type": "application/x-www-form-urlencoded","Accept":
> "text/plain"}
> conn=3Dhttplib.HTTPConnection("localhost:50070")
> conn.request("PUT","/webhdfs/v1/levi/7.txt",params,headers)
> response=3Dconn.getresponse()
> print response.status, response.reason
> data=3Dresponse.read()
> print data
> conn.close()
>
> But it failed:
> #print response.status, response.reason
> 500 Internal Server Error
> #print data
> '{"RemoteException":{"exception":"WebApplicationException","javaClassName=
":"javax.ws.rs.WebApplicationException","message":null}}'
>
> Who knows why? It's OK when i use curl, so where is the problem in httpli=
b
> method?
> Or some other reasons?

It's rather hard to say when neither the base URL, nor querystring
parameters, nor request body are the same between your curl example
and your httplib example, making them rather incomparable.
Part of the problem may be that you are passing what may have been
intended as querystring parameters (`params`) as the `body` argument
to HTTPConnection.request().
In any case, I would suggest trying to use the `requests` library instead.

Cheers,
Chris