The predictions by Command line and GUI are different

[ycwei0321]

Hello,

I'm recently using the CellPose to do the cell count. However, I found the predictions between GUI and command line are very different that the GUI gave me a better prediction, can you give me some suggestions?

Here is the command I used:
cellpose --dir “D:/user/CellPose/input” --image_path “D:/user/CellPose/Input” --add_model “C:/Users/winshah/.cellpose/models/cyto2_cp3.npy” --chan 0 --use_gpu --flow_threshold 0.4 --cellprob_threshold 0 --save_rois --save_png --save_outlines --savedir “D:/user/CellPose/Output”

Here is the screenshot of the GUI I use:

If I want to get the similar result by command line, whant kind of parameter should I use?

I found if I use the pretrained model named cyto3, it gave me the opposite results. The result from command line is much better than the GUI.

Thanks for your help.

[ReallyCoolBean]

I also have the issue of different output in the GUI and from the command line using Cellpose2.0 and we are not alone, as I found others reporting that, however no good explanation or solution to the problem: #843 and #758

I trained a model using command line and now when I evaluate it through the command line in PyTorch, I have good results. Here is the code snippet:

and here is one of my images, a z-stack of dimensions: (41,2,2045,2046), here visualised in napari 15th slice in a stack with predicted masks. I am using 2 channels: green (2) as the main channel labelling cells and red (1) with nuclei.

Now this is what happens when I run the model with the same parameters in GUI:

Model does a poorer job, it predicts sometimes many tiny masks eg. top right corner instead of a one normal mask.

To make things even more confusing, when I try to run the same model on the same image in Arivis with the same parameters, this is what happens (again showing 15th slice from the z-stack).

Prediction is different than from Cellpose GUI and different than from the command line. Everything is run in the same environment. Does anyone have any idea what's going on? I don't know which result to trust. I have the best results fromt he command line and this is also where I did evaluation of different parameters and now I want to give the model to another person so they can work with it in Arivis and we can't replicate the results.

[carsen-stringer]

can you please check if this is the case in cellpose v3? this is the old GUI. also it would be helpful if you could please provide the image that has discrepancies in segmentation, then I can debug it, thanks

[ReallyCoolBean]

Hey, thank you for looking into this! I cloned our environment and upgraded to cellpose3 and the problem persists in the new GUI (screenshot attached). What is the best way to provide you with the image? It's 680MB, so I can't upload it here.

[carsen-stringer]

if you can provide a google drive link that would be great thanks, and the CLI command you are using

[ycwei0321]

if you can provide a google drive link that would be great thanks, and the CLI command you are using

Hi

Thanks for your response. I can also provide some example images I tried before. Please see them in this drive link: https://drive.google.com/drive/folders/1UKnCFPk5G3RQkn65VJcfyzjkuvu7y-I4?usp=sharing

Below is the command I used for the cell count, I tried to keep the parameter same with the GUI.

cellpose --dir “D:/Yichao/CellPose/input” --image_path “D:/Yichao/CellPose/Input” --add_model “C:/Users/winshah/.cellpose/models/cyto2_cp3.npy” --chan 0 --use_gpu --flow_threshold 0.4 --cellprob_threshold 0 --save_rois --save_png --save_outlines --savedir “D:/Yichao/CellPose/Output”

If you have any questions, please let me know. Thanks for your kind help.

[carsen-stringer]

you've added ".npy" to the end of the model name, I think the command you want is

python -m cellpose --verbose --dir /path/to/images/ --pretrained_model cyto2_cp3 --chan 0 --flow_threshold 0.4 --cellprob_threshold 0 --save_rois --save_png --save_outlines

with this command and using the "cyto2_cp3" model in the GUI I got the exact same result (using CPU, got 1012 cells for img1t.tif in both cases).

going to close this issue for now, but let me know if you have more questions

[ReallyCoolBean]

Here is a folder with my example image and the model I trained:
https://drive.google.com/drive/folders/1ptaGPKS77ihv1Ewwte1eVuVbX1r-_wPg?usp=sharing
Perhaps I didn't describe correctly what I'm doing, I am actually not using cellpose CLI, but cellpose API by running code in PyCharm. I was inspired by the colab notebook you posted here. Here is the line of code that I am using:

masks = model.eval(test_data,
channels=[2, 1],
diameter=123,
cellprob_threshold=0,
flow_threshold=0.4,
stitch_threshold=0.2)[0]

where model is the model that I provided in the google drive and test_data is the image. The same model and the same image were loaded in GUI and I believe the parameters in GUI were also the same as in my code (see screenshots).

[carsen-stringer]

Since this is 3D, can you please check if the normalization parameters are the same in both cases? They are printed in the GUI as a dictionary, and you can input that dictionary into normalize in eval.

Regarding arivis outputs, their code is closed source and I don't have a license so we can't verify whether it would work the same way

[ReallyCoolBean]

Thank you for the advice! Sadly, I still get different results: GUI predicts 871 ROIs while the python script predicts 149. I ran again the model in Cellpose3 GUI and I got the same result as before (here showing plane 14):

I checked the output in the terminal and normalization parameters:

I then run the following python script:

and this is my result:

[carsen-stringer]

Can you include what is printed when the script runs? I think you're missing the do_3D=True flag in model.eval

[carsen-stringer]

Oh I see you are stitching, please do include what the script is printing

[ReallyCoolBean]

Well, it doesn't print much, just that images from my test set were loaded and that model finished finished running for the one image that I selected. I'm not sure why it says 40/40 while the image had 41 planes.

[carsen-stringer]

hmm I am confused because in the GUI it looks like you have cell fragments that result from running the 2.5D model not the stitching model, are you sure that the screenshot is from running with stitch_threshold=0.2?

[ReallyCoolBean]

I loaded the image, set the settings like it's shown in the screenshot and then pressed 'run' and that's the result. I repeated that several times, on different days, just to make sure I didn't click something wrong by accident, and it's always the same result.
What is the 2.5D model?

[carsen-stringer]

the 2.5d model is described in the Cellpose1 paper (runs on YX, ZY and ZX), can you please post the command line info that prints when you run in the gui vs in the API?

[ReallyCoolBean]

So that's what I posted above, but I think the screenshot didn't capture everything from the GUI, so here it is again:


and from running my script:

and here is a gain the line of the script that produced the output above:
masks = model.eval(test_data[0],
channels=[2, 1],
diameter=123.9,
cellprob_threshold=0,
flow_threshold=0.4,
stitch_threshold=0.2,
normalize={'lowhigh': None, 'percentile': [1.0, 99.0], 'normalize': True, 'norm3D': True, 'sharpen_radius': 0,
'smooth_radius': 0, 'tile_norm_blocksize': 0, 'tile_norm_smooth3D': 1, 'invert': False})[0]

[carsen-stringer]

thanks can you run the script with io.logger_setup() declared before you run cellpose so we can see the loaded model and the output of the script.

[carsen-stringer]

it looks like in the script you are running many images, and you may be comparing the output potentially from two different tiffs (indeed it should say 41 if it has 41 planes it loads in)

[ReallyCoolBean]

Yes, I am laoding initially everything that is in the test set directory (3 images), but then I do prediction only on the first image (test_data[0]), when I was running the script in iPython I visualised the output with Napari and that's what I posted in the screenshots above and it's definitely the same image that I load in the GUI.

thanks can you run the script with io.logger_setup() declared before you run cellpose so we can see the loaded model and the output of the script.

one difference between the output from the script and GUI is that GUI says that it loads a tiff image of 41 planes and 3 channels, whereas the script correctly reads it as 41 planes with 2 channels. Not sure why it is like that, it is definitely the same image analysed in both cases.