Skip to content

Commit

Permalink
removed coming soon
Browse files Browse the repository at this point in the history
Signed-off-by: Zeeshan Patel <[email protected]>
  • Loading branch information
zpx01 committed Nov 6, 2024
1 parent c77fbf5 commit baa303c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion nemo/collections/diffusion/readme.rst
Original file line number Diff line number Diff line change
Expand Up @@ -124,7 +124,7 @@ Parallel Configuration
Energon's architecture allows it to efficiently distribute data across multiple processing units, ensuring that each GPU or node receives a balanced workload. This parallelization not only increases the overall throughput of data processing but also helps in maintaining high utilization of available computational resources.


Mixed Image-Video Training (comming soon)
Mixed Image-Video Training
------------------------------

Our dataloader provides support for mixed image-video training by using the NeMo packed sequence feature to pack together images and videos of varying length into the same microbatch. The sequence packing mechanism uses the THD attention kernel, which allows us to increase the model FLOPs utilization (MFU) and efficiently process data with varying length.
Expand Down

0 comments on commit baa303c

Please sign in to comment.