Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

300M基础模型的断句错误问题 #629

Open
czydfj opened this issue Nov 8, 2024 · 2 comments
Open

300M基础模型的断句错误问题 #629

czydfj opened this issue Nov 8, 2024 · 2 comments

Comments

@czydfj
Copy link

czydfj commented Nov 8, 2024

目前发现300M基础模型有比较严重的断句问题。当遇到断句问题时,添加逗号、句号试图强制断句,但不起作用。

官方是否有对于这个问题进行优化的计划呢?

@aluminumbox
Copy link
Collaborator

暂时没有好办法,大模型就是这样不太可控

@czydfj
Copy link
Author

czydfj commented Nov 13, 2024

暂时没有好办法,大模型就是这样不太可控

有没有传入文本时比较好的强制断句方法?比如我试过添加“!。;”这类的一串代表句子结束的标点符号,它就会强制断句,但是断句时间又比较长,不太自然。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants