[Feature]: A interface is needed that can output the corresponding token result given a specified text and tokenizer parameters.

[Feature]: A interface is needed that can output the corresponding token result given a specified text and tokenizer parameters. #5290