current community

your communities

more stack exchange communities

Stack Exchange
tour help
stack overflow careers
Take the 2-minute tour ×
Stack Overflow is a question and answer site for professional and enthusiast programmers. It's 100% free, no registration required.
up vote 5 down vote favorite

I am trying to access amazon s3 using boto library to access common crawl data availble in amazon 'aws-publicdatasets'.

i created access config file in ~/.boto

[Credentials]
aws_access_key_id = "my key"
aws_secret_access_key = "my_secret"

and while creating connection with amazon s3 i see below error in logs.

2014-01-23 16:28:16,318 boto [DEBUG]:Retrieving credentials from metadata server.
2014-01-23 16:28:17,321 boto [ERROR]:Caught exception reading instance data
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/boto-2.13.3-py2.6.egg/boto/utils.py", line 211, in retry_url
    r = opener.open(req)
  File "/usr/lib64/python2.6/urllib2.py", line 391, in open
    response = self._open(req, data)
  File "/usr/lib64/python2.6/urllib2.py", line 409, in _open
    '_open', req)
  File "/usr/lib64/python2.6/urllib2.py", line 369, in _call_chain
    result = func(*args)
  File "/usr/lib64/python2.6/urllib2.py", line 1190, in http_open
    return self.do_open(httplib.HTTPConnection, req)
  File "/usr/lib64/python2.6/urllib2.py", line 1165, in do_open
    raise URLError(err)
URLError: <urlopen error timed out>
2014-01-23 16:28:17,323 boto [ERROR]:Unable to read instance data, giving up

In other way I tried to give credentials while creating connection object also as shown below

from boto.s3.connection import S3Connection
from boto.s3.bucket import Bucket
boto.set_stream_logger('boto')
connection = S3Connection('______','__________')    
bucket = Bucket(connection.get_bucket('aws-publicdatasets'))

Still i am seeing the same error in logs

share|improve this question
    
using bucket = connection.get_bucket('aws-publicdatasets') and your code works fine for me. Maybe it there is something prevent your request (firewall?). –  andpei Jan 23 '14 at 13:05
    
Thanks @andpei. but my firewall is turned off. Error is seen while connecting to s3. I executed program with 3 lines of code: import boto boto.set_stream_logger('boto') conn = boto.connect_s3(anon=True) but still the error is seen –  user2695817 Jan 23 '14 at 13:36
    
I am getting the same error, did you solve it ? –  romain jouin Nov 28 '14 at 9:17
    
Same here. Just doing connect_s3(anon=True) suffices to have the error message printed by the library. –  Davi Feb 12 at 10:00

2 Answers 2

up vote 0 down vote

You can try the following, its work for me 


from boto.api import env
env.aws_access_key_id = boto.config.get("Credentials", "aws_access_key_id")
env.aws_secret_access_key = boto.config.get("Credentials", "aws_secret_access_key")

share|improve this answer
up vote 0 down vote

I had the same error when using a .boto file in the same folder as the script. It has to be on the base of the home folder.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.