Skip to content

Commit

Permalink
[SPARK-34996][PYTHON] Port Koalas Series-related unit tests into PySpark
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?
Now that we merged the Koalas main code into the PySpark code base (#32036), we should port the Koalas Series related unit tests to PySpark.

### Why are the changes needed?
Currently, the pandas-on-Spark modules are not fully tested. We should enable the Series related unit tests first.

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Enable Series-related unit tests.

Closes #32117 from xinrong-databricks/port.test_series_related.

Lead-authored-by: Xinrong Meng <[email protected]>
Co-authored-by: xinrong-databricks <[email protected]>
Signed-off-by: HyukjinKwon <[email protected]>
  • Loading branch information
2 people authored and HyukjinKwon committed Apr 13, 2021
1 parent aae4ab2 commit a392633
Show file tree
Hide file tree
Showing 5 changed files with 3,660 additions and 0 deletions.
4 changes: 4 additions & 0 deletions dev/sparktestsupport/modules.py
Original file line number Diff line number Diff line change
Expand Up @@ -616,6 +616,10 @@ def __hash__(self):
"pyspark.pandas.tests.test_ops_on_diff_frames_groupby",
"pyspark.pandas.tests.test_ops_on_diff_frames_groupby_expanding",
"pyspark.pandas.tests.test_ops_on_diff_frames_groupby_rolling",
"pyspark.pandas.tests.test_series",
"pyspark.pandas.tests.test_series_conversion",
"pyspark.pandas.tests.test_series_datetime",
"pyspark.pandas.tests.test_series_string",
],
excluded_python_implementations=[
"PyPy" # Skip these tests under PyPy since they require numpy, pandas, and pyarrow and
Expand Down
Loading

0 comments on commit a392633

Please sign in to comment.