Can we convert collate_fn in Dataloader to a custom class(or function) ?

[wlhgtc]

For some task(such as masking ), we want to mask different pos in different epoch for the same record.
Like the code in Transformers, we could pass a class to the collate_fn.
But now we only have a simple allennlp_collate.
The old version of our Dataloader is a subclass of Pytorch Dataloder, seems we write our own one in the latest version ?

[wlhgtc]

@epwalsh

[wlhgtc]

Maybe just like what we have done in optimizer, import Collator class from Transformers and use a custom base class to cover ?

[epwalsh]

This would be a good feature to have, and easy to add without breaking backwards compat.

Would you like to make a PR?

[wlhgtc]

This would be a good feature to have, and easy to add without breaking backwards compat.

Would you like to make a PR?

Well, I'll try it soon.

[dirkgr]

Done! Thank you!