Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Batch processing doesnt handle case when representations have been deleted. #486

Open
johnhbenetech opened this issue Apr 7, 2022 · 1 comment · Fixed by #497
Open

Comments

@johnhbenetech
Copy link
Member

johnhbenetech commented Apr 7, 2022

Steps to reproduce:

  1. Process the collection using either method.
  2. Delete the representations folder
  3. Rerun the processing job using the GUI

Result:

  • Exif and Hashing job seem to run but extract_features/generate_matches does not run

Desired result:

  • processing script should have a way to ensure all previously processed representations are still present
@johnhbenetech
Copy link
Member Author

This also seems to happen in the case where you add additional videos to the collection after a round of processing.

  1. Process the collection using either method.
  2. Add additional videos to mounted folder (these videos may have a variety of created dates old and new)
  3. Rerun the processing job using the GUI

Result:
Job finishes without additional processing as it believes all videos are processed

Desired result:
processing script should have a way to ensure all videos in drive are processes

stepan-anokhin added a commit to stepan-anokhin/VideoDeduplication that referenced this issue Apr 27, 2022
stepan-anokhin added a commit to stepan-anokhin/VideoDeduplication that referenced this issue Apr 27, 2022
@stepan-anokhin stepan-anokhin linked a pull request Apr 27, 2022 that will close this issue
johnhbenetech added a commit that referenced this issue Apr 27, 2022
…-execution

Fix too lazy pipeline execution (#486)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant