Looking for some help to achieve a specific outcome.

[fraxyl]

I had an idea to create a music video for a song I've written. So far I've recorded the video of me, processed it using TouchDesigner to create a line art style of the video and then taken that video and saved the frames to images to use in ControlNet.

I have my controlnet set to Canny and batch is pointed at the folder where the frames are, named to the effect of frame##### where # is the frame number. When I set the text2image batch, does it step through the controlnet images as it generates from my text2image prompt?

Also the batch only goes to 100 and I have a little under 5000 frames. Should I just run a batch of 100 each time and remove the frames from the controlnet batch folder as I go or what?

I tried following a youtube tutorial to start with, nearly everything I search for is A1111 or ComfyUI, and attempting to install either of those caused more headaches.

[brknsoul]

If you're talking about the Batch Count slider, you can edit that in ui-config.json, by adding a comma to the end of the last line before the }, then adding;
"txt2img/Batch count/maximum": 100
to the next line, changing the 100 to a larger value.

eg:

[fraxyl]

My ui-config.json is just { } is this normal?

[vladmandic]

ui-config.json only saves values which are different than default. so until modifications are made, its empty. but that's besides the point - not needed.

what you want is to process 3k frames using process batch. why would you need to set batch-size or batch-count for that at all???
setting batch-size or count to 100 would result in producing 100 images for EACH of your input frames.

[fraxyl]

It's only one prompt, the controlnet is what changes.

[vladmandic]

then process -> process folder is what you want.
process batch would mean that 4590 images need to be uploaded and that would not work.

[fraxyl]

process does not appear to achieve what I had in mind, I set the batch count to 4590 and it appears to be doing what I asked. I haven’t uploaded 4590 images, that number of images is just sitting in a folder that I pointed to in the batch section of controlnet. from my understanding, the process tab is for processing images after they have been generated, is this not the case?

[vladmandic]

Right.
You can use new control tab for that. It has both functionalities that you need.
It's in dev now, release likely tomorrow.

[fraxyl]

After a few tries, I think I have my workflow worked out, but now I'm not sure that the batch section of control net is working how I understand it to work. When I point it to a folder on my computer, what is controlnet expecting to find? Does it use the subdirectories inside? I've managed to reduce the amount of controlnet images I want to use from 4k to 1100, but I noticed when I changed the folder in the batch section, it started producing the same images that it generated the first time. Another time I had the batch pointed at a folder that no longer existed and it continued to generate images no problem.