Revert "inference: implement an opt-in interface to cache generated sources"

[vtjnash]

Reverts #54916

[oscardssmith]

Is the GC issue you mentioned post merge unfixable?

[vtjnash]

Yes, it is a missing gc_wb that cannot be added to that design

[aviatesk]

Yes, it is a missing gc_wb that cannot be added to that design

Would adding some sort of GC annotation to jl_code_for_staged solve the issue, or is a larger refactor likely needed? In the package I'm currently trying to implement, using Core.CachedGenerator is expected to significantly improve performance, so I would like to know how to correctly implement Core.CachedGenerator.

[vtjnash]

I am not really sure what that parameter does. It seems already very suspicious and sketchy that a function that is defined to be a pure transform of input arguments to CodeInfo is returning something that is mutable