Skip to content

ENH: Support reading from S3 #3504

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
3 commits merged into from
May 10, 2013
Merged

ENH: Support reading from S3 #3504

3 commits merged into from
May 10, 2013

Conversation

pjob
Copy link

@pjob pjob commented May 1, 2013

Tests not written. Will need a way to mock boto.

@ghost
Copy link

ghost commented May 1, 2013

IMO this doesn't belong in pandas (neither are other API storage services),
users can implement that in their own scripts.

@pjob
Copy link
Author

pjob commented May 2, 2013

Thanks and I understand your point.

Retrieving files from S3 offers a powerful io experience in pandas given the way people use S3 for logs and other historical record and pandas' handling of compressed files. Perhaps this would be better as its own IO tool similar to the sql wrappers. It would aid the user in retrieving from and setting to S3.

Feel free to close this or move the discussion to a better resource (mailing list, issue tracker).

@ghost
Copy link

ghost commented May 3, 2013

This has me really stumped for some reason. But I guess I should err on the side of "it's useful",
and we do want to make it as easy to get data into pandas as possible.

Please add a note in RELEASE.rst, and mention boto as an optional dependency in README.md
for this functionality, I'll merge this for 0.11.1.

@nehalecky
Copy link
Contributor

That's the spirit all!

@pjob
Copy link
Author

pjob commented May 6, 2013

@y-p Thank you. Everything should be up to date.

@ghost
Copy link

ghost commented May 10, 2013

@pjob , can you please add a blurb to io.rst in the docs?

@pjob
Copy link
Author

pjob commented May 10, 2013

@y-p sure.

ghost pushed a commit that referenced this pull request May 10, 2013
ENH: Support reading from S3
@ghost ghost merged commit 1381c39 into pandas-dev:master May 10, 2013
@ghost
Copy link

ghost commented May 10, 2013

Thanks.

@cpcloud cpcloud mentioned this pull request Jun 15, 2013
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants