Add Segformer model

[brianhou0208]

Description

There is already a Segformer encoder mix_transformer in this repo, and the decoder architecture of Segformer is simple and similar to UPerNet.

Question

Is there a need to add a Segformer to this repo?, I can contribute a PR.

Architecture

Reference

• official repo
• paper

[qubvel]

Hi @brianhou0208, there was a demand for this architecture and it can be a great feature, especially in case we will be able to load the original weights too! I would appreciate your contribution!

[brianhou0208]

Check the PR here
#944

[alex-stenger]

Waiting for the PR to be accepted, is there for now a way to make a SegFormer with smp, and to load weights ?