Skip to content
#

pydata

Here are 71 public repositories matching this topic...

molmutius
molmutius commented Oct 24, 2019

IEX has a free plan which offers 500.000 messages per month, the next cheapest paid plan gets you 5.000.000 per month.

Their API offers a way to only retrieve adjusted close for historical data, which will return a df with date, close, and volume only. open, low and high are dropped and not transmitted so you won't be billed for it. This will save you 50% messages if you don't need those values

quasiben
quasiben commented Apr 4, 2019

When workers die or halted it can be useful to see when that worker was last seen by the scheduler. We should bubble this information up to the dashboard

client.scheduler_info()

'tcp://172.17.0.2:43161': {'type': 'Worker',
   'id': 'tcp://172.17.0.2:43161',
   'host': '172.17.0.2',
   'resources': {},
   'local_directory': '/notebooks/dask-worker-space/worker-k540965f',
   'name':
fjetter
fjetter commented Oct 21, 2019

Problem description

The distributed scheduler usually relies on knowledge about the size of the computation result and based on this makes certain scheduling decisions (e.g. work stealing). Our main data class, the MetaPartition should implement a __sizeof__ which performs a deep size calculation (including data frames, indices, etc.) too give the scheduler the best chance on making the

randyzwitch
randyzwitch commented Mar 28, 2019

In trying to write tests for #189, I'm finding very difficult to add columns to existing tests, as in some cases like the all_types table, the table is defined in a separate file than the tests and multiple tests try to write to the same table.

Additionally, our test suite doesn't prove that the data that are uploaded are the same as the data downloaded for all types.

We should consider m

Improve this page

Add a description, image, and links to the pydata topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the pydata topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.