Skip to content

Commit 14110a0

Browse files
committed
Clean up previous work and add release note.
1 parent 3eb0b26 commit 14110a0

File tree

3 files changed

+50
-9
lines changed

3 files changed

+50
-9
lines changed

docs/source/whatsnew/0.6.0.txt

Lines changed: 45 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,45 @@
1+
Release |version|
2+
-----------------
3+
4+
:Release: |version|
5+
:Date: TBD
6+
7+
New Features
8+
------------
9+
10+
None
11+
12+
Experimental Features
13+
---------------------
14+
15+
.. warning::
16+
17+
Experimental features are subject to change.
18+
19+
None
20+
21+
New Backends
22+
------------
23+
24+
None
25+
26+
Improved Backends
27+
-----------------
28+
29+
* Optimized `chunks` backend to allow parallel evaluation using `dask`
30+
whenever the iteratable is a list of callables.
31+
32+
API Changes
33+
-----------
34+
35+
None
36+
37+
Bug Fixes
38+
---------
39+
40+
None
41+
42+
Miscellaneous
43+
-------------
44+
45+
None

odo/chunks.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,9 @@ def __init__(self, data):
3535
def __iter__(self):
3636
if callable(self.data):
3737
return self.data()
38-
elif isinstance(self.data, list) and len(self.data) and callable(self.data[0]):
38+
elif (isinstance(self.data, list) and
39+
len(self.data) and
40+
callable(self.data[0])):
3941
# If this is a set of callables, evaluate
4042
# them using dask before returning an iterator for them
4143
p = []

odo/convert.py

Lines changed: 2 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -218,14 +218,8 @@ def iterator_to_DataFrame_chunks(seq, chunksize=1024, **kwargs):
218218
return chunks(pd.DataFrame)(data)
219219

220220
# TODO: Decide whether we should support the `add_index` flag at all.
221-
# If not, the following code can be removed (and an exception be
222-
# raised.
223-
#
224-
#else:
225-
# raise ValueError("The 'add_index' flag is not supported by this backend.")
226-
227-
# Otherwise, we need to post-process the converted DataFrame objects,
228-
# so we use an iterator...
221+
# If so, we need to post-process the converted DataFrame objects sequencially,
222+
# so we can't parallelize the process.
229223
try:
230224
first, rest = next(seq2), seq2
231225
except StopIteration:

0 commit comments

Comments
 (0)