You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The most fundamental operation we need, besides the FFT, is the ability to do image resampling, this is crucial to many tasks from convolution to shearing.
Right now, we are relying on existing TF tools. Namely, for the x_interpolant in our convolution tools we are using the built-in tf.image.resize, this has a lot of limitations, and in particular makes weird assumptions about pixel centers, which can induce shifts. We also use the tensorflow addons image resample tool, but this one is limited to linear interpolation.
So... we want a generic tool that can resample an image using linear, cubic, quintic and lanczos kernels, and this needs to be differentiable with respect to all the inputs, including the resampling grid.
The text was updated successfully, but these errors were encountered:
After further thought, shouldn't be impossible to do to add a higher order interpolation kernel given that pretty much all utilities for that are already in place in TFA. So, I'm opening a fork: https://github.com/DifferentiableUniverseInitiative/addons
The most fundamental operation we need, besides the FFT, is the ability to do image resampling, this is crucial to many tasks from convolution to shearing.
Right now, we are relying on existing TF tools. Namely, for the x_interpolant in our convolution tools we are using the built-in tf.image.resize, this has a lot of limitations, and in particular makes weird assumptions about pixel centers, which can induce shifts. We also use the tensorflow addons image resample tool, but this one is limited to linear interpolation.
So... we want a generic tool that can resample an image using linear, cubic, quintic and lanczos kernels, and this needs to be differentiable with respect to all the inputs, including the resampling grid.
The text was updated successfully, but these errors were encountered: