Skip to content

Store SPY in csv instead? #111

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
twiecki opened this issue Aug 4, 2015 · 7 comments
Closed

Store SPY in csv instead? #111

twiecki opened this issue Aug 4, 2015 · 7 comments

Comments

@twiecki
Copy link
Contributor

twiecki commented Aug 4, 2015

Although hdf5 is certainly the better format it's an additional requirement. For this simple file we might want to just use csv instead.

@humdings
Copy link
Contributor

humdings commented Aug 4, 2015

Pandas doesn't support hdf5 natively? What's the additional requirement?

@twiecki
Copy link
Contributor Author

twiecki commented Aug 4, 2015

pytables

@gusgordon
Copy link
Contributor

We could also store in a zip, the file sizes may get large

@twiecki
Copy link
Contributor Author

twiecki commented Aug 4, 2015

I'm not overly worried about that since it's only one ticker. I just remembered that we also have the fama french stuff in hdf5. That one might be a bit larger. Anyway, if size is indeed a concern we should probably stick to hdf5 and eat the dependency.

@twiecki twiecki removed this from the 0.1 release milestone Aug 5, 2015
@twiecki
Copy link
Contributor Author

twiecki commented Aug 14, 2015

Seems like csv is actually smaller, at least for the fama french factors.

-rw-rw-r-- 1 wiecki wiecki 1.4M Aug 14 11:00 factors.csv
-rw-rw-r-- 1 wiecki wiecki 2.3M Aug 14 10:20 factors.h5
-rw-rw-r-- 1 wiecki wiecki 264K Aug 14 10:43 spy.csv
-rw-rw-r-- 1 wiecki wiecki 138K Aug 14 10:20 spy.h5

@twiecki
Copy link
Contributor Author

twiecki commented Aug 14, 2015

#119

@twiecki
Copy link
Contributor Author

twiecki commented Aug 15, 2015

Closed with #119.

@twiecki twiecki closed this as completed Aug 15, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants