Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there a way to recognize characters other than Japanese and the alphabet? #50

Open
yamadayo opened this issue Dec 14, 2020 · 8 comments

Comments

@yamadayo
Copy link

Is there a way to recognize characters other than Japanese and the alphabet?

@wtetsu
Copy link
Owner

wtetsu commented Dec 16, 2020

To what language do you want to use?

I have a plan to develop a feature that enables users to inject user-customized language processer, so I want to know your use case.

@yamadayo
Copy link
Author

chinese

@ghost
Copy link

ghost commented Dec 19, 2020

@wtetsu I want to use it for eng -> turkish, is this only eng -> jp?

@wtetsu
Copy link
Owner

wtetsu commented Dec 19, 2020

@toprak
En -> Any language would work perfectly.
However, you have to find or make dictionary data and import it.

@yamadayo
Copy link
Author

Is it not necessary to rewrite the program just by importing the dictionary data?

@wtetsu
Copy link
Owner

wtetsu commented Dec 25, 2020

@yamadayo
Please try it out.
Maybe, it's not smart like English/Japanese parsing, but partially work.

If you need smarter parser for other languages, program improvement is required.

@yuis-ice
Copy link

Greetings. I've tried Spanish and didn't work at the accent alphabets e.g. "programación"

The example dataset:

{
    "lenguaje": "language as in choice of words\nprogramming language",
    "lenguaje de programación": "A programming language",
    "lengua materna": "mother tongue"
}

Screenshot:

ShareX_ScreenShot_4ddd57e5-0eb9-4ad6-950c-2945aa4dc5b8

I would suggest a workaround something like enabling user to map unsupported characters e.g. "ó" -> "o", "ñ" -> "n";

@wtetsu
Copy link
Owner

wtetsu commented Jan 29, 2022

@yuis-ice
Thank you for the information. Let me consider it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants