Skip to content

Commit

Permalink
clean up dstream.py
Browse files Browse the repository at this point in the history
  • Loading branch information
giwa committed Sep 20, 2014
1 parent 0b09cff commit 932372a
Showing 1 changed file with 0 additions and 6 deletions.
6 changes: 0 additions & 6 deletions python/pyspark/streaming/dstream.py
Original file line number Diff line number Diff line change
Expand Up @@ -140,12 +140,6 @@ def combineByKey(self, createCombiner, mergeValue, mergeCombiners,
def combineLocally(iterator):
combiners = {}
for x in iterator:

#TODO for count operation make sure count implementation
# This is different from what pyspark does
#if isinstance(x, int):
# x = ("", x)

(k, v) = x
if k not in combiners:
combiners[k] = createCombiner(v)
Expand Down

0 comments on commit 932372a

Please sign in to comment.