Add "id" support. Refactor Writers. Add Writer additional format extensibility.

[ibro45]

Description

• The dataset can now return "id" key in a dict for the purpose of identifying each batch sample. Useful for prediction writing to name the written files properly.
• Refactored Writers. No need for interval argument. The batch samples are added as a table record (TableWriter) or written to a file (FileWriter) at each batch end.
• New formats of writing predictions can now be easily added, either by passing them using the additional_writers argument, or by calling .add_writer() method after the instantiation.
• Remove the gather_tensors and use decollate_batch instead to support writing batch size > 1
• Remove multi opt and sched support
• Remove the remaining sys.exit()'s
• Added support for dict of metrics in System, in addition to single or list of metrics. A dict allows multiple metrics of the same class, e.g., Dice, by assigning them different keys (names). That way, you can use two or more same class metrics. E.g., a Dice with micro averaging and a Dice with macro averaging.
• Some LighterSystem refactoring

Related Issue

#47
#23 (partially, all sys.exits() replaced)

Type of Change

• 📚 Examples / docs / tutorials / dependencies update
• 🔧 Bug fix (non-breaking change which fixes an issue)
• 🥂 Improvement (non-breaking change which improves an existing feature)
• 🚀 New feature (non-breaking change which adds functionality)
• 💥 Breaking change (fix or feature that would cause existing functionality to change)
• 🔐 Security fix

Checklist

• I've read the CODE_OF_CONDUCT.md document.
• I've read the CONTRIBUTING.md guide.
• I've updated the code style using make codestyle.
• I've written tests for all new methods and classes that I created.
• I've written the docstring in Google format for all the methods and classes that I used.

[ibro45]

Need to fix some DDP issues first

[ibro45]

Done, ready for merge

[ibro45]

Sorry, this PR escalated 😅📈 happy to sit down/have a call if you want to go through it together

[surajpaib]

Great stuff with the writer! Love the flexibility.

[ibro45]

Do you think the Writers should support predict mode only, or should they also support test mode?

[surajpaib]

I think predict should suffice. I would disassociate testing from the prediction.