Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Usability issues, feature requests #152

Open
acardona opened this issue Aug 31, 2022 · 1 comment
Open

Usability issues, feature requests #152

acardona opened this issue Aug 31, 2022 · 1 comment

Comments

@acardona
Copy link

acardona commented Aug 31, 2022

When using the bigwarp over several hours to painstakingly align an LSM to an EM volume, a number of usability issues became evident:

  1. One is always one tiny left-mouse drag event from navigating away from the current view in an irreparable way. The present very costly solution is to zoom out, find again the correct orientation which can take several minutes, and zoom back into the area of interest.

A proposed solution: store a sequence of views, each one stored upon mouse or key release. To reduce the listing of keys, compress multiple subsequent key presses (key presses within less than a second from each other) for the same key into just one event. Then offer ways to navigate these past views.
Another, complementary solution: the "Save settings" must also store the views of each volume.
Yet another complementary solution: like in CATMAID, add means to store named views. So that one can swiftly go back to that view, by choosing it from a menu. And have these stored views be saved in the settings XML too.
Yet another: allow sort of locking the view, or rather constraining the possible movements, so that only panning and view Z axis movement is allowed. This restriction alone would do wonders.
The above are general issues with the BigDataViewer.

  1. Upon adding a new landmark in fused transformed mode, the transformation moves the view away from the landmark. Automatically scroll in the Z axis (relative to view) to find it again.

  2. When in transformation mode, offer means to have the same view on both the moving and fixed image. As in, add a menu item in the fixed image window to see it in the same view than the moving image, and viceversa. This alone would cut down user time enormously.

  3. Selecting landmarks is too difficult. The '+' pointer is as large. Make perhaps one like in CATMAID: an empty circle, so one can see what is inside. Additionally, the landmark ought to grow in diameter, or change color, or something, to notify the user that the mouse has gotten close enough that it can click on it to select it, instead of adding a new landmark.

  4. Finding landmarks is too difficult. I would like to scroll while e.g., holding down alt key, or something, and have the scrolling in the view Z axis stop when it hits a landmark. Or draw a rectangle and have the view automatically scroll down or up to find the nearest landmark. Or some such system.

  5. Consider enabling changing the diameter of landmarks and their colors, so they are more visible.

  6. Enable/disable synchronizing moving and fixed windows when in transformation mode. So that one can navigate both simultaneously without having to guess.

  7. When exiting transformation mode, the moving image is often terribly zoomed out or zoomed in, and often outside the field of view. One has to go to the landmarks, double-click on one to bring the volume into view, then zoom in or out. Make this easier by storing the view one had prior to entering transformation mode, and then restoring the view to that. Here, solutions to (1) above would also help lots.

  8. When in transformation, fused mode, moving a landmark is often catastrophic: a very strong, warped deformation. Control+z works here, thankfully, but why should this happen in the first place. A toggle to prevent dragging landmarks would be helpful.

  9. Another BigDataViewer issue: show me info. As in, which images are being shown? If the image is wrapping an ImagePlus, tell me about the image properties of that ImagePlus. In particular the calibration and the file path in the hard drives alone would be very helpful.

  10. Related, and BigDataViewer issue: have a button that emits a script to access the underlying data. As in, via Frame.getFrames(), traverse down the swing or awt components hierarchy until reaching the class that points to the data. Emiting this 2-3 line script would enable one to work on the data that BigWarp is using. To change its values, to measure it, to visualize it elsewhere simultaneously.

  11. Another related to BigDataViewer: enable browsing without pixelation. As in, the data is loaded already, no need to use first the low-res levels of the multi-res pyramid. Use directly the best level, and render directly with interpolation if that's enabled. CPUs are fast and can deliver seamless browsing anyway. The pixelation can be extremely distracting.

Thanks so much for BigWarp!

@bogovicj
Copy link
Contributor

Hi @acardona

I hope Bigwarp has been useful, and thanks for the feedback! you have lots of good points.
There are some existing features of Bigwarp might be helpful for you immediately though.

add means to store named views.

bigdataviewers bookmarks sort-of do this, but structuring them better would be a great feature, agreed.

Finding landmarks is too difficult.

There are many ways to navigate to landmarks

  • Double clicking on a moving / fixed landmark in the table centers the moving / fixed window on that landmark
  • E centers the viewer on the landmark closest to the cursor
  • D centers on the currently selected landmark (highlighted in the table)
  • D centers on the currently selected landmark (highlighted in the table)
  • ctrl+D centers on the currently selected landmark (highlighted in the table)
  • ctrl+shift+D centers on the currently selected landmark (highlighted in the table)

(some of those need documenting - whoops)

Consider enabling changing the diameter of landmarks and their colors, so they are more visible.

This is possible with Setting > Bigwarp Options (or U), with landmark vis options on the top of the dialog.

Selecting landmarks is too difficult.

Increasing the landmark size will make them easier to select.

Enable/disable synchronizing moving and fixed windows when in transformation mode.

and

When in transformation mode, offer means to have the same view on both the moving and fixed image.

auto-synching is a good idea, but this is easy to do yourself with my favorite hotkeys:

  • Q makes the non-active viewer match the active viewer
  • W makes the active viewer match the non-active viewer

And as you said, many of your other ideas are "bdv" ideas, but I agree, those would be nice to have.

Upon adding a new landmark in fused transformed mode, the transformation moves the view away from the landmark.

I'm going to be pedantic here. The transformation moved the landmark away from the view, but can see how that would feel bad.

Some tips or "how I like to work with bigwarp"
That behavior happens if you click in the fixed image first, then click in the moving image second [1],
but I usually recommend doing the opposite: first clicking points in the moving image, then in the fixed.

Another nice pattern if your images are close is to shift-click + drag when you have the moving image displayed. Usually I'll do a smallish number of landmarks to get close, then find nearby things, use shift+click+drag in one plane, then change the plane to check / adjust the other orientations

Thanks again!

[1] because once a pair is completed, it triggers an update of the transform.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants