Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

String dtype: allow string dtype for non-raw apply with numba engine #59854

Merged

Conversation

jorisvandenbossche
Copy link
Member

#55104 enabled using numba with raw=False in apply() (BTW, this seems rather undocumented?), but that PR had some specific hack for object dtype index. Extending that hack to also convert str dtype index to numpy strings under the hood (this might hurt performance, but for now just want to get this working)

xref #54792

@jorisvandenbossche jorisvandenbossche added Strings String extension data type and string data Apply Apply, Aggregate, Transform, Map numba numba-accelerated operations labels Sep 20, 2024
@jorisvandenbossche jorisvandenbossche added this to the 2.3 milestone Sep 20, 2024
@jorisvandenbossche jorisvandenbossche marked this pull request as ready for review September 21, 2024 08:38
@mroeschke mroeschke merged commit c8a6740 into pandas-dev:main Sep 25, 2024
51 checks passed
@mroeschke
Copy link
Member

Thanks @jorisvandenbossche

@jorisvandenbossche jorisvandenbossche deleted the string-dtype-apply-numba branch October 10, 2024 09:05
jorisvandenbossche added a commit to jorisvandenbossche/pandas that referenced this pull request Oct 10, 2024
…andas-dev#59854)

* String dtype: allow string dtype for non-raw apply with numba engine

* remove xfails

* clean-up
jorisvandenbossche added a commit that referenced this pull request Oct 10, 2024
…59854)

* String dtype: allow string dtype for non-raw apply with numba engine

* remove xfails

* clean-up
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Apply Apply, Aggregate, Transform, Map backported numba numba-accelerated operations Strings String extension data type and string data
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants