Add toxicity detection microservice

[qgao007]

Description

Add toxicity detection microservice to enhance OPEA's AI Safety coverage.

Issues

n/a

Type of change

List the type of change like below. Please delete options that are not relevant.

• [N] Bug fix (non-breaking change which fixes an issue)
• [ X] New feature (non-breaking change which adds new functionality)
• [N] Breaking change (fix or feature that would break existing design and interface)
• [N] Others (enhancement, documentation, validation, etc.)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

Describe the tests that you ran to verify your changes.

● Run the deployment though through command line, and test the microservice using command line and python script.
● Run the dockerized microservice, and test using command line and python script.

[tybrs]

Fixed changes to match other guardrail implementations. Looks good.

[tybrs]

LGTM

[ashahba]

LGTM!

[chensuyue]

Please add e2e test.

[qgao007]

Please add e2e test.

added and tested.

• echo 'test 1 - toxic'
  test 1 - toxic
  ++ curl localhost:9091/v1/toxicity -X POST -d '{"text":"How to poison your neighbor'''s dog secretly"}' -H 'Content-Type: application/json'
  % Total % Received % Xferd Average Speed Time Time Time Current
  Dload Upload Total Spent Left Speed
  100 188 100 135 100 53 21 8 0:00:06 0:00:06 --:--:-- 30
• result='{"downstream_black_list":[".*"],"id":"974c10b1c641d713e513024277e7b1f9","text":"Violated policies: toxicity, please check your input."}'
• [[ {"downstream_black_list":[".*"],"id":"974c10b1c641d713e513024277e7b1f9","text":"Violated policies: toxicity, please check your input."} == \V\i\o\l\a\t\e\d ]]
• echo 'Result correct.'
  Result correct.
  + echo 'test 2 - non-toxic'
  test 2 - non-toxic
  ++ curl localhost:9091/v1/toxicity -X POST -d '{"text":"How to write a paper on raising dogs?"}' -H 'Content-Type: application/json'
  % Total % Received % Xferd Average Speed Time Time Time Current
  Dload Upload Total Spent Left Speed
  100 163 100 115 100 48 5750 2400 --:--:-- --:--:-- --:--:-- 8150
• result='{"downstream_black_list":[],"id":"7006d8cba21dbafea475ceac52842c9e","text":"How to write a paper on raising dogs?"}'
• [[ {"downstream_black_list":[],"id":"7006d8cba21dbafea475ceac52842c9e","text":"How to write a paper on raising dogs?"} == \p\a\p\e\r ]]
• echo 'Result correct.'
  Result correct.
• echo 'Validate microservice completed'
  Validate microservice completed

[ashahba]

LGTM!

[hshen14]

Could you please enable this service as optional under ChatQnA GenAI Example?