Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Include plugins in docker image #138

Open
wants to merge 1 commit into
base: preview
Choose a base branch
from

Conversation

kvalev
Copy link
Owner

@kvalev kvalev commented Jun 12, 2023

related to #130, #131
closes #137

@kvalev kvalev force-pushed the kvv-docker-include-plugins branch 2 times, most recently from bf3ba19 to fe44633 Compare June 12, 2023 21:02
@kvalev kvalev temporarily deployed to uffizzi June 12, 2023 21:25 — with GitHub Actions Inactive
@github-actions
Copy link

github-actions bot commented Jun 12, 2023

Uffizzi Ephemeral Environment deployment-28317

☁️ https://app.uffizzi.com/github.com/kvalev/photoprism/pull/138

📄 View Application Logs etc.

⏰ This Preview will be destroyed in 48 hours at: Thu Jun 15 23:42:41 UTC 2023

What is Uffizzi? Learn more!

@rickysarraf
Copy link

Trying to help you with this PR. I tested it and unfortunately this incarnates a golang issue.

DEBU[2023-06-13T09:33:43Z] migrate: completed in 454.411464ms           
INFO[2023-06-13T09:33:43Z] indexing originals in /photoprism/originals  
DEBU[2023-06-13T09:33:43Z] plugins: found plugin file /photoprism/storage/plugins/demo.so 
WARN[2023-06-13T09:33:43Z] plugin demo: plugin was loaded, but is not enabled 
DEBU[2023-06-13T09:33:43Z] plugins: found plugin file /photoprism/storage/plugins/realesrgan.so 
ERRO[2023-06-13T09:33:43Z] plugins: plugin.Open("/photoprism/storage/plugins/realesrgan"): plugin was built with a different version of package github.com/photoprism/photoprism/internal/hub (when opening plugin solib /photoprism/storage/plugins/realesrgan.so) 
DEBU[2023-06-13T09:33:43Z] plugins: found plugin file /photoprism/storage/plugins/yolo8.so 
ERRO[2023-06-13T09:33:43Z] plugins: plugin.Open("/photoprism/storage/plugins/yolo8"): plugin was built with a different version of package github.com/photoprism/photoprism/internal/hub (when opening plugin solib /photoprism/storage/plugins/yolo8.so) 
INFO[2023-06-13T09:33:43Z] classify: loading nasnet                     
2023-06-13 09:33:43.536650: I tensorflow/cc/saved_model/reader.cc:31] Reading SavedModel from: /opt/photoprism/assets/nasnet
2023-06-13 09:33:44.166200: I tensorflow/cc/saved_model/reader.cc:54] Reading meta graph with tags { photoprism }
2023-06-13 09:33:44.712052: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA
2023-06-13 09:33:46.350266: I tensorflow/cc/saved_model/loader.cc:202] Restoring SavedModel bundle.
^C

Quick search pointed at: golang/go#51955

@kvalev kvalev force-pushed the kvv-docker-include-plugins branch 4 times, most recently from 01f9525 to bf58330 Compare June 13, 2023 22:39
@kvalev kvalev temporarily deployed to uffizzi June 13, 2023 23:02 — with GitHub Actions Inactive
@kvalev
Copy link
Owner Author

kvalev commented Jun 13, 2023

@rickysarraf Go is quite picky about those plugin builds - not only the code has to match, but also the build flags (used for the plugin and the binary). The latest version of this PR works and the plugin solibs are loaded correctly, but the build code is not pretty. I need to think of a way to integrate it nicely into the current build, without having to copy-paste it for everyone of the dozens of Dockerfiles.

Also given Go's plugin pickiness, it's even worth considering integrating those few plugins natively into the codebase, instead of dynamically loading them at runtime. And if someone wants to develop their own plugin, at the end it might be easier to just include it in this repository, than having to recompile it with every new version.

@rickysarraf
Copy link

@rickysarraf Go is quite picky about those plugin builds - not only the code has to match, but also the build flags (used for the plugin and the binary). The latest version of this PR works and the plugin solibs are loaded correctly, but the build code is not pretty. I need to think of a way to integrate it nicely into the current build, without having to copy-paste it for everyone of the dozens of Dockerfiles.

Thank you @kvalev

I finally got it working with this current PR.

$ docker exec -it testing-photoprism_photoprism_1 bash
photoprism@:/photoprism$ photoprism index -c

DEBU[2023-06-14T07:35:16Z] config: successfully initialized [10.077549ms] 
INFO[2023-06-14T07:35:16Z] migrate: running database migrations         
DEBU[2023-06-14T07:35:16Z] migrate: 20221015-100000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20221015-100100 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20211121-094727 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20211124-120008 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-030000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-040000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-050000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-060000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-061000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-070000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-071000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-080000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-081000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-083000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-090000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-091000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220329-093000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220421-200000 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220521-000001 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220521-000002 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220521-000003 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20220927-000100 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20221002-000100 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20230102-000001 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20230211-000001 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20230309-000001 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: 20230313-000001 skipped             
DEBU[2023-06-14T07:35:16Z] migrate: completed in 426.54008ms            
INFO[2023-06-14T07:35:16Z] indexing originals in /photoprism/originals  
DEBU[2023-06-14T07:35:16Z] plugins: found plugin file /photoprism/storage/plugins/demo.so 
WARN[2023-06-14T07:35:16Z] plugin demo: plugin was loaded, but is not enabled 
DEBU[2023-06-14T07:35:16Z] plugins: found plugin file /photoprism/storage/plugins/realesrgan.so 
DEBU[2023-06-14T07:35:16Z] plugin realesrgan: configuration loaded &main.Config{Hostname:"realesrgan", Port:"5001", Scale:2, ThresholdResolution:3, ThresholdQuality:3} 
INFO[2023-06-14T07:35:16Z] plugin realesrgan: successfully loaded plugin 
DEBU[2023-06-14T07:35:16Z] plugins: found plugin file /photoprism/storage/plugins/yolo8.so 
DEBU[2023-06-14T07:35:17Z] plugin yolo8: configuration loaded &main.Config{Hostname:"yolo8", Port:"5000", ThresholdConfidence:0.4} 
INFO[2023-06-14T07:35:17Z] plugin yolo8: successfully loaded plugin     
INFO[2023-06-14T07:35:17Z] classify: loading nasnet                      
2023-06-14 07:35:17.159664: I tensorflow/cc/saved_model/reader.cc:31] Reading SavedModel from: /opt/photoprism/assets/nasnet
2023-06-14 07:35:17.786264: I tensorflow/cc/saved_model/reader.cc:54] Reading meta graph with tags { photoprism }
2023-06-14 07:35:18.282474: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA
2023-06-14 07:35:20.234013: I tensorflow/cc/saved_model/loader.cc:202] Restoring SavedModel bundle.
2023-06-14 07:35:28.033317: I tensorflow/cc/saved_model/loader.cc:311] SavedModel load for tags { photoprism }; Status: success. Took 10880273 microseconds.
INFO[2023-06-14T07:35:29Z] classify: loading labels from labels.txt     

Instead of copying the shared object files, I just symlinked the folder so that it is auto-updated.

photoprism@:/photoprism$ ls -lh storage/
total 8.0K
drwxrwxr-x 1 photoprism photoprism  68 Apr  1  2022 albums
drwxrwxr-x 1 photoprism photoprism  22 Oct  6  2022 backup
drwxrwxr-x 1 photoprism photoprism  88 Feb 25 19:34 cache
drwxrwxr-x 1 photoprism photoprism 102 Dec 30 14:51 config
lrwxrwxrwx 1 root       root        32 Jun 13 09:30 plugins -> /opt/photoprism/storage/plugins/
-rwxrwxr-x 1 photoprism photoprism  16 Mar 31  2022 serial
drwxrwxr-x 1 photoprism photoprism 418 May 28 05:43 sidecar
drwxrwxr-x 1 photoprism photoprism   0 Dec 30 14:51 users

As for the plugins, they seem to be working. Though I'll wait for the final results to reflect in the WebUI, which is going to take time until the index -c completes.

Right now, I have:

INFO[2023-06-14T07:35:50Z] index: ignored "Imgs"                        
DEBU[2023-06-14T07:35:54Z] metadata: 20230611_224608_EC0BA4A6.mp4 uses utc by default (video/mp4) 
INFO[2023-06-14T07:35:54Z] convert: converting 20230611_224608_EC0BA4A6.mp4 to 20230611_224608_EC0BA4A6.mp4.jpg (ffmpeg) 

INFO[2023-06-14T07:36:20Z] convert: 20230611_224608_EC0BA4A6.mp4.jpg created in 26.51190488s (ffmpeg) 
DEBU[2023-06-14T07:36:20Z] index: created 20230611_224608_EC0BA4A6.mp4.jpg 
DEBU[2023-06-14T07:36:21Z] metadata: no XMP data in 20230611_224608_EC0BA4A6.mp4.jpg (read xmp) 
DEBU[2023-06-14T07:36:21Z] metadata: 2084232de281c07aeacd073fa3e31fc478c6590b_exiftool.json not found (no such file or directory) 
DEBU[2023-06-14T07:36:21Z] metadata: found no exif header in 20230611_224608_EC0BA4A6.mp4.jpg 
DEBU[2023-06-14T07:36:21Z] media: opened Pictures/Misc/test/20230611_224608_EC0BA4A6.mp4.jpg [8.3 MB] 
INFO[2023-06-14T07:36:21Z] media: created 8 thumbnails for Pictures/Misc/test/20230611_224608_EC0BA4A6.mp4.jpg [896.10747ms] 
ERRO[2023-06-14T07:36:24Z] plugin realesrgan: image: unknown format (importing file frw8fsn19aao1x35) 
ERRO[2023-06-14T07:36:24Z] plugin yolo8: image: unknown format (importing file frw8fsn19aao1x35) 
INFO[2023-06-14T07:36:24Z] index: added main mp4 file Pictures/Misc/test/20230611_224608_EC0BA4A6.mp4 
DEBU[2023-06-14T07:36:24Z] media: created no new thumbnails for Pictures/Misc/test/20230611_224608_EC0BA4A6.mp4.jpg [382.458µs] 
INFO[2023-06-14T07:36:36Z] index: matched 1 label with 20230611_224608_EC0BA4A6.mp4.jpg [10.856289856s] 
DEBU[2023-06-14T07:36:36Z] photo: changing location of Pictures/Misc/test/20230611_224608_EC0BA4A6 from zz to s2:3bae0b21763c 
DEBU[2023-06-14T07:36:37Z] photo: Pictures/Misc/test/20230611_224608_EC0BA4A6 title based on label Portrait 
DEBU[2023-06-14T07:36:37Z] photo: Pictures/Misc/test/20230611_224608_EC0BA4A6 has new title 'Portrait / India / 2023' [8.468713ms] 
DEBU[2023-06-14T07:36:39Z] search: updated index by photo id [132.272609ms] 

DEBU[2023-06-14T07:36:39Z] search: updated index by photo id [132.272609ms] 

ERRO[2023-06-14T07:37:39Z] plugin realesrgan: Post "http://realesrgan:5001/superscale": context deadline exceeded (Client.Timeout exceeded while awaiting headers) (importing file frw8ft23bzokprj5) 
DEBU[2023-06-14T07:37:44Z] search: updated index by photo id [137.756181ms] 
DEBU[2023-06-14T07:37:44Z] search: updated index by photo id [4.341329ms] 
DEBU[2023-06-14T07:37:44Z] index: updated yaml file 20230611_224608_EC0BA4A6.yml 
INFO[2023-06-14T07:37:44Z] index: stacked related jpg file Pictures/Misc/test/20230611_224608_EC0BA4A6.mp4.jpg 
DEBU[2023-06-14T07:37:47Z] exiftool: extracting metadata from Pictures/Misc/test/20230611_224858_96B74A59.mp4 
DEBU[2023-06-14T07:37:48Z] index: created 4ba92430bf8f1d44d63860cfedfd3c6cc8e3015e_exiftool.json 
DEBU[2023-06-14T07:37:48Z] metadata: 20230611_224858_96B74A59.mp4 uses utc by default (video/mp4) 
INFO[2023-06-14T07:37:48Z] convert: converting 20230611_224858_96B74A59.mp4 to 20230611_224858_96B74A59.mp4.jpg (ffmpeg) 

ERRO[2023-06-14T07:37:39Z] plugin realesrgan: Post "http://realesrgan:5001/superscale": context deadline exceeded (Client.Timeout exceeded while awaiting headers) (importing file frw8ft23bzokprj5) 
DEBU[2023-06-14T07:37:44Z] search: updated index by photo id [137.756181ms] 
DEBU[2023-06-14T07:37:44Z] search: updated index by photo id [4.341329ms] 
DEBU[2023-06-14T07:37:44Z] index: updated yaml file 20230611_224608_EC0BA4A6.yml 
INFO[2023-06-14T07:37:44Z] index: stacked related jpg file Pictures/Misc/test/20230611_224608_EC0BA4A6.mp4.jpg 
DEBU[2023-06-14T07:37:47Z] exiftool: extracting metadata from Pictures/Misc/test/20230611_224858_96B74A59.mp4 
DEBU[2023-06-14T07:37:48Z] index: created 4ba92430bf8f1d44d63860cfedfd3c6cc8e3015e_exiftool.json 
DEBU[2023-06-14T07:37:48Z] metadata: 20230611_224858_96B74A59.mp4 uses utc by default (video/mp4) 
INFO[2023-06-14T07:37:48Z] convert: converting 20230611_224858_96B74A59.mp4 to 20230611_224858_96B74A59.mp4.jpg (ffmpeg) 
INFO[2023-06-14T07:38:02Z] convert: 20230611_224858_96B74A59.mp4.jpg created in 13.865998887s (ffmpeg) 
DEBU[2023-06-14T07:38:02Z] index: created 20230611_224858_96B74A59.mp4.jpg 
DEBU[2023-06-14T07:38:02Z] metadata: no XMP data in 20230611_224858_96B74A59.mp4.jpg (read xmp) 
DEBU[2023-06-14T07:38:02Z] metadata: f8db58d11b81c704a9bc714228dbdc40a7e36082_exiftool.json not found (no such file or directory) 
DEBU[2023-06-14T07:38:02Z] metadata: found no exif header in 20230611_224858_96B74A59.mp4.jpg 
DEBU[2023-06-14T07:38:02Z] media: opened Pictures/Misc/test/20230611_224858_96B74A59.mp4.jpg [8.3 MB] 
INFO[2023-06-14T07:38:03Z] media: created 8 thumbnails for Pictures/Misc/test/20230611_224858_96B74A59.mp4.jpg [1.029605459s] 
ERRO[2023-06-14T07:38:03Z] plugin realesrgan: image: unknown format (importing file frw8fvf1fvhktmod) 
ERRO[2023-06-14T07:38:03Z] plugin yolo8: image: unknown format (importing file frw8fvf1fvhktmod) 
INFO[2023-06-14T07:38:03Z] index: added main mp4 file Pictures/Misc/test/20230611_224858_96B74A59.mp4 
DEBU[2023-06-14T07:38:03Z] media: created no new thumbnails for Pictures/Misc/test/20230611_224858_96B74A59.mp4.jpg [422.887µs] 
DEBU[2023-06-14T07:38:08Z] photo: changing location of Pictures/Misc/test/20230611_224858_96B74A59 from zz to s2:3bae0b21763c 
DEBU[2023-06-14T07:38:08Z] photo: Pictures/Misc/test/20230611_224858_96B74A59 title based on label 'Portrait' 
DEBU[2023-06-14T07:38:08Z] photo: Pictures/Misc/test/20230611_224858_96B74A59 has new title 'Portrait / India / 2023' [3.183344ms] 
DEBU[2023-06-14T07:38:09Z] search: updated index by photo id [160.587797ms] 

ERRO[2023-06-14T07:39:10Z] plugin realesrgan: Post "http://realesrgan:5001/superscale": context deadline exceeded (Client.Timeout exceeded while awaiting headers) (importing file frw8fvk3ovc8uh8k) 

But both YoLo and Realesgran plugins are working, as per the server-side logs:

photoprism_1  | 2023-06-14T07:59:02.238229493Z time="2023-06-14T07:59:02Z" level=debug msg="covers: updated 2 smart albums [1.356434308s]"
photoprism_1  | 2023-06-14T07:59:02.239569383Z time="2023-06-14T07:59:02Z" level=error msg="invalid ID specified"
photoprism_1  | 2023-06-14T07:59:02.239652830Z time="2023-06-14T07:59:02Z" level=debug msg="albums: flushed cover cache"
photoprism_1  | 2023-06-14T07:59:02.241983980Z time="2023-06-14T07:59:02Z" level=debug msg="server: POST /api/v1/batch/photos/private (200) [18.800989914s]"
photoprism_1  | 2023-06-14T07:59:06.277875189Z time="2023-06-14T07:59:06Z" level=debug msg="server: GET /api/v1/photos?count=240&offset=0&merged=true&country=&camera=0&lens=0&label=&year=0&month=0&color=&person=&subject=&order=newest&q=&public=true&quality=3 (200) [6.112011778s]"
photoprism_1  | 2023-06-14T07:59:10.017797049Z time="2023-06-14T07:59:10Z" level=debug msg="photos: found 360 results for public:true dist:20 year:0 month:0 quality:3 camera:0 lens:0 count:360 order:newest merged:true [3.621800321s]"
photoprism_1  | 2023-06-14T07:59:18.911107033Z time="2023-06-14T07:59:18Z" level=debug msg="server: GET /api/v1/photos?count=360&offset=0&merged=true&country=&camera=0&lens=0&label=&year=0&month=0&color=&person=&subject=&order=newest&q=&public=true&quality=3 (200) [12.515514023s]"
realesrgan_1  | RealESRGAN input shape: (1080, 1920, 3), scale: 2
photoprism_1  | 2023-06-14T07:59:42.853547204Z time="2023-06-14T07:59:42Z" level=info msg="libx264: created 20230611_232718_8AB96626.mp4.avc [2m19.796362219s]"
photoprism_1  | 2023-06-14T07:59:42.855813985Z time="2023-06-14T07:59:42Z" level=info msg="libx264: transcoding Pictures/Misc/test/20230611_232711_9DF09F11.mp4 to avc"
photoprism_1  | 2023-06-14T07:59:42.858833264Z time="2023-06-14T07:59:42Z" level=debug msg="server: GET /api/v1/videos/70653c92f26ec5c28cfc86c472d905f6408741c8/ee9sdi43/avc (206) [2m20.423299608s]"
yolo8_1       | 2023-06-14T08:00:22.563051679Z 
yolo8_1       | 2023-06-14T08:00:24.085702543Z 0: 224x224 bathtub 0.21, tub 0.11, diaper 0.07, quilt 0.05, bassinet 0.04, 1332.4ms
yolo8_1       | 2023-06-14T08:00:24.086801406Z Speed: 4.7ms preprocess, 1332.4ms inference, 0.2ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-06-14T08:00:24.089616334Z 192.168.80.5 - - [14/Jun/2023 08:00:24] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-06-14T08:00:35.169291476Z time="2023-06-14T08:00:35Z" level=debug msg="server: GET /api/v1/config (200) [1.40074807s]"
realesrgan_1  | RealESRGAN input shape: (1080, 1920, 3), scale: 2
photoprism_1  | 2023-06-14T08:01:21.212646890Z time="2023-06-14T08:01:21Z" level=info msg="libx264: created 20230611_232711_9DF09F11.mp4.avc [1m38.356184868s]"
photoprism_1  | 2023-06-14T08:01:21.224931352Z time="2023-06-14T08:01:21Z" level=info msg="libx264: transcoding Pictures/Misc/test/20230611_232701_ECB97F1B.mp4 to avc"
photoprism_1  | 2023-06-14T08:01:21.231528372Z time="2023-06-14T08:01:21Z" level=debug msg="server: GET /api/v1/videos/54ab0a0157988a3cc0c241cc5966348de1bc627d/ee9sdi43/avc (206) [3m58.737817113s]"
yolo8_1       | 2023-06-14T08:02:31.137899022Z 
yolo8_1       | 2023-06-14T08:02:38.091687940Z 0: 224x224 diaper 0.57, crib 0.05, bath_towel 0.03, quilt 0.03, bassinet 0.02, 2949.9ms
yolo8_1       | 2023-06-14T08:02:38.092412098Z Speed: 3380.2ms preprocess, 2949.9ms inference, 0.2ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-06-14T08:02:38.145975025Z 192.168.80.5 - - [14/Jun/2023 08:02:38] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-06-14T08:04:07.203043639Z time="2023-06-14T08:04:07Z" level=info msg="libx264: created 20230611_232701_ECB97F1B.mp4.avc [2m45.961730158s]"
photoprism_1  | 2023-06-14T08:04:07.332581470Z time="2023-06-14T08:04:07Z" level=debug msg="server: GET /api/v1/videos/c00eb73613318f83f49415832d8b9a199171df65/ee9sdi43/avc (206) [6m44.597632781s]"
photoprism_1  | 2023-06-14T08:04:07.334133781Z time="2023-06-14T08:04:07Z" level=debug msg="server: GET /api/v1/videos/c00eb73613318f83f49415832d8b9a199171df65/ee9sdi43/avc (206) [6m3.660509846s]"
photoprism_1  | 2023-06-14T08:04:07.425841724Z time="2023-06-14T08:04:07Z" level=debug msg="server: GET /api/v1/videos/54ab0a0157988a3cc0c241cc5966348de1bc627d/ee9sdi43/avc (206) [6m2.838830458s]"
realesrgan_1  | RealESRGAN input shape: (1080, 1920, 3), scale: 2
realesrgan_1  | RealESRGAN output shape: (3840, 2160, 3)
realesrgan_1  | INFO:werkzeug:192.168.80.5 - - [14/Jun/2023 08:05:08] "POST /superscale HTTP/1.1" 200 -
photoprism_1  | 2023-06-14T08:05:21.225762831Z time="2023-06-14T08:05:21Z" level=debug msg="server: GET /api/v1/config (200) [2.52268635s]"
yolo8_1       | 2023-06-14T08:05:25.511272300Z 
yolo8_1       | 2023-06-14T08:05:28.315452920Z 0: 224x224 diaper 1.12, shower_cap 0.08, sleeping_bag 0.06, nipple 0.05, bath_towel 0.05, 751.3ms
yolo8_1       | 2023-06-14T08:05:28.316720669Z Speed: 188.6ms preprocess, 751.3ms inference, 1.2ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-06-14T08:05:28.342094964Z 192.168.80.5 - - [14/Jun/2023 08:05:28] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-06-14T08:06:45.086799258Z time="2023-06-14T08:06:45Z" level=debug msg="server: GET /api/v1/config (200) [1.552910424s]"
realesrgan_1  | RealESRGAN input shape: (1080, 1920, 3), scale: 2
photoprism_1  | 2023-06-14T08:07:32.923161024Z time="2023-06-14T08:07:32Z" level=debug msg="server: GET /api/v1/config (200) [2.927114621s]"

@rickysarraf
Copy link

ERRO[2023-06-14T07:39:10Z] plugin realesrgan: Post "http://realesrgan:5001/superscale": context deadline exceeded (Client.Timeout exceeded while awaiting headers) (importing file frw8fvk3ovc8uh8k)

The realesrgan picture scaling tool turned out to be quite resource intensive, resulting on frequent OOMs on the Docker host. I'm disabling this service to continue with the rest of the tests.

@kvalev
Copy link
Owner Author

kvalev commented Jun 14, 2023

The realesrgan picture scaling tool turned out to be quite resource intensive, resulting on frequent OOMs on the Docker host. I'm disabling this service to continue with the rest of the tests.

Indeed, it can be quite memory hungry, especially if you feed it larger images. And to be honest, I was not very happy with the results that I got for my low resolution images, but given that I had already implemented it, I left it in the codebase. The yolo8 classification plugin is way more practical.

@rickysarraf
Copy link

About the objects detected by Yolo, how do those detections get fed to PP ? I couldn't find a strong debug statement there about populating the detected objects into PP.

yolo8_1       | 2023-06-17T18:44:52.641362538Z 
yolo8_1       | 2023-06-17T18:44:53.679396738Z 0: 224x224 shopping_cart 0.14, crane_(machine) 0.10, bannister 0.09, pole 0.09, bow 0.06, 48.5ms
yolo8_1       | 2023-06-17T18:44:53.680166941Z Speed: 3.8ms preprocess, 48.5ms inference, 9.6ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-06-17T18:44:53.682956399Z 172.19.0.5 - - [17/Jun/2023 18:44:53] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-06-17T18:44:53.919849269Z time="2023-06-17T18:44:53Z" level=debug msg="search: updated index by photo id [3.468225ms]"
photoprism_1  | 2023-06-17T18:44:54.861908893Z time="2023-06-17T18:44:54Z" level=debug msg="search: updated index by photo id [4.252086ms]"
photoprism_1  | 2023-06-17T18:44:54.866644024Z time="2023-06-17T18:44:54Z" level=debug msg="index: updated yaml file 20200930_214439.yml"
photoprism_1  | 2023-06-17T18:44:54.867559148Z time="2023-06-17T18:44:54Z" level=info msg="index: updated main jpg file Pictures/2020_Processed/20200930_214439.jpg"
photoprism_1  | 2023-06-17T18:44:55.334121500Z time="2023-06-17T18:44:55Z" level=debug msg="metadata: successfully decoded Samsung trailer data for 20201118_084525.jpg"
photoprism_1  | 2023-06-17T18:44:55.499775970Z time="2023-06-17T18:44:55Z" level=debug msg="media: created no new thumbnails for Pictures/2020_Processed/20201118_084525.jpg [157.863005ms]"
photoprism_1  | 2023-06-17T18:45:00.704598215Z time="2023-06-17T18:45:00Z" level=debug msg="search: updated index by photo id [3.193381ms]"
photoprism_1  | 2023-06-17T18:45:00.710303862Z time="2023-06-17T18:45:00Z" level=debug msg="photo: Pictures/2020_Processed/20201118_084525 title based on label Processed"
photoprism_1  | 2023-06-17T18:45:00.724761308Z time="2023-06-17T18:45:00Z" level=debug msg="search: updated index by photo id [2.888371ms]"
photoprism_1  | 2023-06-17T18:45:00.994548610Z time="2023-06-17T18:45:00Z" level=debug msg="search: updated index by photo id [4.005766ms]"
yolo8_1       | 2023-06-17T18:45:06.891593554Z 
yolo8_1       | 2023-06-17T18:45:08.270413130Z 0: 224x224 radiator 0.25, window_screen 0.19, doormat 0.14, solar_dish 0.04, space_heater 0.04, 51.1ms
yolo8_1       | 2023-06-17T18:45:08.270605374Z Speed: 4.6ms preprocess, 51.1ms inference, 6.0ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-06-17T18:45:08.274598526Z 172.19.0.5 - - [17/Jun/2023 18:45:08] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-06-17T18:45:08.508866825Z time="2023-06-17T18:45:08Z" level=debug msg="search: updated index by photo id [3.122882ms]"
photoprism_1  | 2023-06-17T18:45:08.830165395Z time="2023-06-17T18:45:08Z" level=debug msg="search: updated index by photo id [4.011299ms]"
photoprism_1  | 2023-06-17T18:45:08.860445459Z time="2023-06-17T18:45:08Z" level=debug msg="index: updated yaml file 20201118_084525.yml"
photoprism_1  | 2023-06-17T18:45:08.861983306Z time="2023-06-17T18:45:08Z" level=info msg="index: updated main jpg file Pictures/2020_Processed/20201118_084525.jpg"
photoprism_1  | 2023-06-17T18:45:09.427534439Z time="2023-06-17T18:45:09Z" level=debug msg="metadata: successfully decoded Samsung trailer data for 20201118_084533.jpg"
photoprism_1  | 2023-06-17T18:45:09.830782116Z time="2023-06-17T18:45:09Z" level=debug msg="media: created no new thumbnails for Pictures/2020_Processed/20201118_084533.jpg [394.60633ms]"
photoprism_1  | 2023-06-17T18:45:14.868937383Z time="2023-06-17T18:45:14Z" level=debug msg="search: updated index by photo id [5.12019ms]"
photoprism_1  | 2023-06-17T18:45:14.881785857Z time="2023-06-17T18:45:14Z" level=debug msg="photo: Pictures/2020_Processed/20201118_084533 title based on label Car"
photoprism_1  | 2023-06-17T18:45:15.617202737Z time="2023-06-17T18:45:15Z" level=debug msg="search: updated index by photo id [4.488076ms]"
photoprism_1  | 2023-06-17T18:45:16.756558490Z time="2023-06-17T18:45:16Z" level=debug msg="search: updated index by photo id [3.420505ms]"
yolo8_1       | 2023-06-17T18:45:23.083171911Z 
yolo8_1       | 2023-06-17T18:45:24.609071468Z 0: 224x224 solar_dish 0.20, groom 0.09, dam 0.04, harp 0.04, greenhouse 0.03, 49.5ms
yolo8_1       | 2023-06-17T18:45:24.609402553Z Speed: 5.7ms preprocess, 49.5ms inference, 14.5ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-06-17T18:45:24.611855724Z 172.19.0.5 - - [17/Jun/2023 18:45:24] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-06-17T18:45:24.966739010Z time="2023-06-17T18:45:24Z" level=debug msg="search: updated index by photo id [3.446169ms]"
photoprism_1  | 2023-06-17T18:45:26.144078064Z time="2023-06-17T18:45:26Z" level=debug msg="search: updated index by photo id [4.05943ms]"
photoprism_1  | 2023-06-17T18:45:26.148971906Z time="2023-06-17T18:45:26Z" level=debug msg="index: updated yaml file 20201118_084533.yml"
photoprism_1  | 2023-06-17T18:45:26.149302485Z time="2023-06-17T18:45:26Z" level=info msg="index: updated main jpg file Pictures/2020_Processed/20201118_084533.jpg"
photoprism_1  | 2023-06-17T18:45:26.653280320Z time="2023-06-17T18:45:26Z" level=debug msg="metadata: successfully decoded Samsung trailer data for 20201118_084612.jpg"

@rickysarraf
Copy link

There also the case, where images generated by extraction of frame from a video, is not well understood by Yolo

yolo8_1       | 2023-06-17T18:47:27.017229329Z 
yolo8_1       | 2023-06-17T18:47:27.247521614Z 0: 224x224 swing 0.11, bonnet 0.08, cradle 0.05, bassinet 0.04, ice_lolly 0.04, 68.6ms
yolo8_1       | 2023-06-17T18:47:27.247921758Z Speed: 4.0ms preprocess, 68.6ms inference, 0.1ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-06-17T18:47:27.250206465Z 172.19.0.5 - - [17/Jun/2023 18:47:27] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-06-17T18:47:27.537785227Z time="2023-06-17T18:47:27Z" level=debug msg="search: updated index by photo id [4.688093ms]"
photoprism_1  | 2023-06-17T18:47:28.344004831Z time="2023-06-17T18:47:28Z" level=debug msg="search: updated index by photo id [4.692984ms]"
photoprism_1  | 2023-06-17T18:47:28.350130192Z time="2023-06-17T18:47:28Z" level=debug msg="index: updated yaml file 20210617_200557.yml"
photoprism_1  | 2023-06-17T18:47:28.350213690Z time="2023-06-17T18:47:28Z" level=info msg="index: updated related jpg file Pictures/2021_Processed/20210617_200557.mp4.jpg"
photoprism_1  | 2023-06-17T18:47:30.493881970Z time="2023-06-17T18:47:30Z" level=debug msg="metadata: 20210617_200805.mp4 uses utc by default (video/mp4)"
photoprism_1  | 2023-06-17T18:47:31.231081437Z time="2023-06-17T18:47:31Z" level=debug msg="search: updated index by photo id [3.418395ms]"
photoprism_1  | 2023-06-17T18:47:31.370386035Z time="2023-06-17T18:47:31Z" level=error msg="plugin yolo8: image: unknown format (importing file frnaivbod1xg65xy)"
photoprism_1  | 2023-06-17T18:47:31.376725346Z time="2023-06-17T18:47:31Z" level=info msg="index: updated main mp4 file Pictures/2021_Processed/20210617_200805.mp4"
photoprism_1  | 2023-06-17T18:47:31.730271049Z time="2023-06-17T18:47:31Z" level=debug msg="media: created no new thumbnails for Pictures/2021_Processed/20210617_200805.mp4.jpg [343.09884ms]"
photoprism_1  | 2023-06-17T18:47:31.736208246Z time="2023-06-17T18:47:31Z" level=debug msg="metadata: no XMP data in 20210617_200805.mp4.jpg (read xmp)"
photoprism_1  | 2023-06-17T18:47:31.829389995Z time="2023-06-17T18:47:31Z" level=debug msg="metadata: 9c97401d796fa1ac62225d7d77733079826e2578_exiftool.json not found (no such file or directory)"
photoprism_1  | 2023-06-17T18:47:31.829482820Z time="2023-06-17T18:47:31Z" level=debug msg="metadata: found no exif header in 20210617_200805.mp4.jpg"
photoprism_1  | 2023-06-17T18:47:32.927574015Z time="2023-06-17T18:47:32Z" level=info msg="index: found 1 face in 20210617_200805.mp4.jpg [1.093077751s]"
photoprism_1  | 2023-06-17T18:47:36.706716036Z time="2023-06-17T18:47:36Z" level=debug msg="search: updated index by photo id [6.560462ms]"
photoprism_1  | 2023-06-17T18:47:36.718559655Z time="2023-06-17T18:47:36Z" level=debug msg="photo: Pictures/2021_Processed/20210617_200805 title based on label Portrait"
photoprism_1  | 2023-06-17T18:47:37.462552115Z time="2023-06-17T18:47:37Z" level=debug msg="search: updated index by photo id [3.25398ms]"
photoprism_1  | 2023-06-17T18:47:37.657373022Z time="2023-06-17T18:47:37Z" level=debug msg="search: updated index by photo id [6.652269ms]"
yolo8_1       | 2023-06-17T18:47:38.213841338Z 
yolo8_1       | 2023-06-17T18:47:38.374913159Z 0: 224x224 bonnet 0.27, bath_towel 0.07, stole 0.05, bassinet 0.04, seat_belt 0.03, 48.6ms
yolo8_1       | 2023-06-17T18:47:38.376000605Z Speed: 3.3ms preprocess, 48.6ms inference, 0.1ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-06-17T18:47:38.378822929Z 172.19.0.5 - - [17/Jun/2023 18:47:38] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-06-17T18:47:38.592148107Z time="2023-06-17T18:47:38Z" level=debug msg="search: updated index by photo id [3.170693ms]"

@rickysarraf
Copy link

About the objects detected by Yolo, how do those detections get fed to PP ? I couldn't find a strong debug statement there about populating the detected objects into PP.

Okay! So it is the threshold the decides.

@rickysarraf
Copy link

There also the case, where images generated by extraction of frame from a video, is not well understood by Yolo

yolo8_1       | 2023-06-17T18:47:27.017229329Z 
yolo8_1       | 2023-06-17T18:47:27.247521614Z 0: 224x224 swing 0.11, bonnet 0.08, cradle 0.05, bassinet 0.04, ice_lolly 0.04, 68.6ms
yolo8_1       | 2023-06-17T18:47:27.247921758Z Speed: 4.0ms preprocess, 68.6ms inference, 0.1ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-06-17T18:47:27.250206465Z 172.19.0.5 - - [17/Jun/2023 18:47:27] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-06-17T18:47:27.537785227Z time="2023-06-17T18:47:27Z" level=debug msg="search: updated index by photo id [4.688093ms]"
photoprism_1  | 2023-06-17T18:47:28.344004831Z time="2023-06-17T18:47:28Z" level=debug msg="search: updated index by photo id [4.692984ms]"
photoprism_1  | 2023-06-17T18:47:28.350130192Z time="2023-06-17T18:47:28Z" level=debug msg="index: updated yaml file 20210617_200557.yml"
photoprism_1  | 2023-06-17T18:47:28.350213690Z time="2023-06-17T18:47:28Z" level=info msg="index: updated related jpg file Pictures/2021_Processed/20210617_200557.mp4.jpg"
photoprism_1  | 2023-06-17T18:47:30.493881970Z time="2023-06-17T18:47:30Z" level=debug msg="metadata: 20210617_200805.mp4 uses utc by default (video/mp4)"
photoprism_1  | 2023-06-17T18:47:31.231081437Z time="2023-06-17T18:47:31Z" level=debug msg="search: updated index by photo id [3.418395ms]"
photoprism_1  | 2023-06-17T18:47:31.370386035Z time="2023-06-17T18:47:31Z" level=error msg="plugin yolo8: image: unknown format (importing file frnaivbod1xg65xy)"
photoprism_1  | 2023-06-17T18:47:31.376725346Z time="2023-06-17T18:47:31Z" level=info msg="index: updated main mp4 file Pictures/2021_Processed/20210617_200805.mp4"
photoprism_1  | 2023-06-17T18:47:31.730271049Z time="2023-06-17T18:47:31Z" level=debug msg="media: created no new thumbnails for Pictures/2021_Processed/20210617_200805.mp4.jpg [343.09884ms]"
photoprism_1  | 2023-06-17T18:47:31.736208246Z time="2023-06-17T18:47:31Z" level=debug msg="metadata: no XMP data in 20210617_200805.mp4.jpg (read xmp)"
photoprism_1  | 2023-06-17T18:47:31.829389995Z time="2023-06-17T18:47:31Z" level=debug msg="metadata: 9c97401d796fa1ac62225d7d77733079826e2578_exiftool.json not found (no such file or directory)"
photoprism_1  | 2023-06-17T18:47:31.829482820Z time="2023-06-17T18:47:31Z" level=debug msg="metadata: found no exif header in 20210617_200805.mp4.jpg"
photoprism_1  | 2023-06-17T18:47:32.927574015Z time="2023-06-17T18:47:32Z" level=info msg="index: found 1 face in 20210617_200805.mp4.jpg [1.093077751s]"
photoprism_1  | 2023-06-17T18:47:36.706716036Z time="2023-06-17T18:47:36Z" level=debug msg="search: updated index by photo id [6.560462ms]"
photoprism_1  | 2023-06-17T18:47:36.718559655Z time="2023-06-17T18:47:36Z" level=debug msg="photo: Pictures/2021_Processed/20210617_200805 title based on label Portrait"
photoprism_1  | 2023-06-17T18:47:37.462552115Z time="2023-06-17T18:47:37Z" level=debug msg="search: updated index by photo id [3.25398ms]"
photoprism_1  | 2023-06-17T18:47:37.657373022Z time="2023-06-17T18:47:37Z" level=debug msg="search: updated index by photo id [6.652269ms]"
yolo8_1       | 2023-06-17T18:47:38.213841338Z 
yolo8_1       | 2023-06-17T18:47:38.374913159Z 0: 224x224 bonnet 0.27, bath_towel 0.07, stole 0.05, bassinet 0.04, seat_belt 0.03, 48.6ms
yolo8_1       | 2023-06-17T18:47:38.376000605Z Speed: 3.3ms preprocess, 48.6ms inference, 0.1ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-06-17T18:47:38.378822929Z 172.19.0.5 - - [17/Jun/2023 18:47:38] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-06-17T18:47:38.592148107Z time="2023-06-17T18:47:38Z" level=debug msg="search: updated index by photo id [3.170693ms]"

Some more logs on this subject. I'm glad that it is able to extract an image and run classification on it.

photoprism_1  | 2023-07-05T08:31:09.091342273Z time="2023-07-05T08:31:09Z" level=error msg="plugin yolo8: image: unknown format (importing file frelh0j3av6armkw)"
photoprism_1  | 2023-07-05T08:31:09.094404774Z time="2023-07-05T08:31:09Z" level=info msg="index: updated main mp4 file 'Pictures/Abroad/DebConf 16 - Capetown - South Afrika/VID_20160708_192123_
HandBrake.mp4'"
yolo8_1       | 2023-07-05T08:31:12.279933662Z 
yolo8_1       | 2023-07-05T08:31:12.993175225Z 0: 224x224 jellyfish 1.00, hammerhead 0.00, spotlight 0.00, nematode 0.00, stove 0.00, 640.6ms
yolo8_1       | 2023-07-05T08:31:12.993463144Z Speed: 2.7ms preprocess, 640.6ms inference, 0.1ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-07-05T08:31:12.995314135Z 192.168.0.4 - - [05/Jul/2023 08:31:12] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-07-05T08:31:13.892393460Z time="2023-07-05T08:31:13Z" level=info msg="index: updated related jpg file 'Pictures/Abroad/DebConf 16 - Capetown - South Afrika/VID_20160708_1921
23_HandBrake.mp4.jpg'"
photoprism_1  | 2023-07-05T08:31:14.880786330Z time="2023-07-05T08:31:14Z" level=error msg="plugin yolo8: image: unknown format (importing file frelh0n2srr1pdms)"
photoprism_1  | 2023-07-05T08:31:14.884510543Z time="2023-07-05T08:31:14Z" level=info msg="index: updated main mp4 file 'Pictures/Abroad/DebConf 16 - Capetown - South Afrika/VID_20160708_192309_
HandBrake.mp4'"
yolo8_1       | 2023-07-05T08:31:18.298963888Z 
yolo8_1       | 2023-07-05T08:31:19.042780592Z 0: 224x224 stingray 0.78, electric_ray 0.19, hammerhead 0.02, sturgeon 0.01, sea_lion 0.00, 654.0ms
yolo8_1       | 2023-07-05T08:31:19.042939494Z Speed: 2.8ms preprocess, 654.0ms inference, 0.1ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-07-05T08:31:19.044820199Z 192.168.0.4 - - [05/Jul/2023 08:31:19] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-07-05T08:31:19.715479184Z time="2023-07-05T08:31:19Z" level=info msg="index: updated related jpg file 'Pictures/Abroad/DebConf 16 - Capetown - South Afrika/VID_20160708_1923
09_HandBrake.mp4.jpg'"
photoprism_1  | 2023-07-05T08:31:20.437510662Z time="2023-07-05T08:31:20Z" level=error msg="plugin yolo8: image: unknown format (importing file frelh0p2a5ppw9da)"
photoprism_1  | 2023-07-05T08:31:20.440944641Z time="2023-07-05T08:31:20Z" level=info msg="index: updated main mp4 file 'Pictures/Abroad/DebConf 16 - Capetown - South Afrika/VID_20160708_192530_
HandBrake.mp4'"
yolo8_1       | 2023-07-05T08:31:24.166636969Z 
yolo8_1       | 2023-07-05T08:31:24.908754558Z 0: 224x224 king_crab 0.21, spiny_lobster 0.20, crayfish 0.16, rock_crab 0.10, wreck 0.04, 650.3ms
yolo8_1       | 2023-07-05T08:31:24.910049135Z Speed: 2.8ms preprocess, 650.3ms inference, 0.1ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-07-05T08:31:24.910788421Z 192.168.0.4 - - [05/Jul/2023 08:31:24] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-07-05T08:31:25.715813558Z time="2023-07-05T08:31:25Z" level=info msg="index: updated related jpg file 'Pictures/Abroad/DebConf 16 - Capetown - South Afrika/VID_20160708_1925
30_HandBrake.mp4.jpg'"
photoprism_1  | 2023-07-05T08:31:26.459499144Z time="2023-07-05T08:31:26Z" level=error msg="plugin yolo8: image: unknown format (importing file frelh0q22hdvhfoj)"
photoprism_1  | 2023-07-05T08:31:26.462547312Z time="2023-07-05T08:31:26Z" level=info msg="index: updated main mp4 file 'Pictures/Abroad/DebConf 16 - Capetown - South Afrika/VID_20160708_192631_
HandBrake.mp4'"
yolo8_1       | 2023-07-05T08:31:30.018689925Z 
yolo8_1       | 2023-07-05T08:31:30.875261240Z 0: 224x224 tiger_shark 0.86, hammerhead 0.06, great_white_shark 0.06, electric_ray 0.01, sturgeon 0.00, 764.4ms
yolo8_1       | 2023-07-05T08:31:30.875496704Z Speed: 2.9ms preprocess, 764.4ms inference, 0.1ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-07-05T08:31:30.877536986Z 192.168.0.4 - - [05/Jul/2023 08:31:30] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-07-05T08:31:31.383011233Z time="2023-07-05T08:31:31Z" level=info msg="index: updated related jpg file 'Pictures/Abroad/DebConf 16 - Capetown - South Afrika/VID_20160708_1926
31_HandBrake.mp4.jpg'"
photoprism_1  | 2023-07-05T08:31:32.127667298Z time="2023-07-05T08:31:32Z" level=error msg="plugin yolo8: image: unknown format (importing file frelh0r2j15txt11)"
photoprism_1  | 2023-07-05T08:31:32.131410014Z time="2023-07-05T08:31:32Z" level=info msg="index: updated main mp4 file 'Pictures/Abroad/DebConf 16 - Capetown - South Afrika/VID_20160708_192747_
HandBrake.mp4'"
yolo8_1       | 2023-07-05T08:31:35.437649124Z 
yolo8_1       | 2023-07-05T08:31:36.175926658Z 0: 224x224 tiger_shark 0.76, sturgeon 0.07, eel 0.06, great_white_shark 0.05, tench 0.02, 647.6ms
yolo8_1       | 2023-07-05T08:31:36.176147247Z Speed: 2.9ms preprocess, 647.6ms inference, 0.1ms postprocess per image at shape (1, 3, 224, 224)
yolo8_1       | 2023-07-05T08:31:36.177951866Z 192.168.0.4 - - [05/Jul/2023 08:31:36] "POST /classify HTTP/1.1" 200 -
photoprism_1  | 2023-07-05T08:31:36.790352972Z time="2023-07-05T08:31:36Z" level=info msg="index: updated related jpg file 'Pictures/Abroad/DebConf 16 - Capetown - South Afrika/VID_20160708_1927
47_HandBrake.mp4.jpg'"
photoprism_1  | 2023-07-05T08:31:37.363199362Z time="2023-07-05T08:31:37Z" level=error msg="plugin yolo8: image: unknown format (importing file frelh0v2k0pizq0v)"
photoprism_1  | 2023-07-05T08:31:37.366236265Z time="2023-07-05T08:31:37Z" level=info msg="index: updated main mp4 file 'Pictures/Abroad/DebConf 16 - Capetown - South Afrika/VID_20160708_192912_
HandBrake.mp4'"

@rickysarraf
Copy link

@kvalev Would be nice to have this merged as well. 🙏🏽

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

plugin crash
2 participants