Google Appengine: Requests Alternative

Question

I have a non-GAE application/request-handler that uses the Python requests module in a to post an uploaded imaged via a POST request, as binary:

headers = {"MyAuth" : "xyz"}
r = requests.post(base_uri, data=open('0.jpg')), headers=headers)

The user uploads an image, the uploaded image is saved locally, opened for reading, then sent to a remote classifier pipeline via post request - this returns some JSON regarding the image features, which can then be returned to the user.

I need to implement this behaviour in a GAE app, but know that GAE has no traditional file system, so I will have to use StringIO:

data = ... #some jpg => str
headers = {"MyAuth" : "xyz"}
r = requests.post(base_uri, data=StringIO.StringIO(data), headers=headers)

How could I completely replace the requests module in this example in a GAE friendly way?

Many thanks.

Community · Accepted Answer · 2017-05-23 12:31:38Z

1

Commonly used module for making HTTP requests on app engine is urlfetch, it is available in the default runtime via google.appengine.api.urlfetch. Supposedly urllib2 and/or urllib3 are also options, but I have not used those myself so I can't say for sure.

You can also install requests in your app engine directory and upload it with the project, but I find that a bit of a hassle, since requests has its own dependencies that you will need to include as well.

Also see Using the Requests python library in Google App Engine

edited May 23, 2017 at 12:31

CommunityBot

11 silver badge

answered Jun 1, 2016 at 11:18

Tim

43.6k19 gold badges138 silver badges152 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

torrange Over a year ago

Thanks Tim. I took a look at urlfetch and it got me most of the way, however the binary upload, whilst it did upload the data and return a 200, the classifier could not extract any usable features from the data. Bizarre, I'm clearly missing something very simple. Unfortunately time is against me on this project, so I managed to get requests 2.3.0 working in production.

torrange · Accepted Answer · 2016-06-02 08:17:11Z

0

Although probably not the best solution to this problem, I managed to get requests 2.3.0 to work in the GAE project with:

pip install --target myproject/externals/ requests==2.3.0

I can now use requests as I would normally.

answered Jun 2, 2016 at 8:17

torrange

811 silver badge5 bronze badges

Collectives™ on Stack Overflow

Google Appengine: Requests Alternative

2 Answers 2

1 Comment

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Linked

Related