[R] lubridate::as_datetime() in dplyr query should be able to handle time in sub seconds

[asfimport]

Since the current unit is fixed to "s", an error will occur if a time containing sub-seconds is given.

"1970-01-01T00:00:59.123456789" |>
  arrow::arrow_table(x = _) |>
  dplyr::mutate(x = lubridate::as_datetime(x, tz = "UTC")) |>
  dplyr::collect()
#> Error in `dplyr::collect()`:
#> ! Invalid: Failed to parse string: '1970-01-01T00:00:59.123456789' as a scalar of type timestamp[s]

I thought that nanoseconds should be used, but it should be noted that POSIXct is currently supposed to be converted to microseconds, as shown in ARROW-17424.
 
 
 

 

Reporter: SHIMA Tatsuya / @eitsupi
Assignee: SHIMA Tatsuya / @eitsupi

Related issues:

• [R] Convert a column as a sub-second timestamp from CSV file with the T col type option (relates to)
• [R] Microsecond is not sufficient unit for POSIXct (relates to)

PRs and other links:

• GitHub Pull Request #13890

_{Note: This issue was originally created as ARROW-17425. Please see the migration documentation for further details.}

[raulcd]

Thanks for pointing this out @eitsupi I am closing this manually as was merged in the interim of the migration! We have updated the merge scripts to avoid this in the future for happening.