foundation-model-grpc-server

This is a python package provides grpc server for foundation model. Currently models below are supported.

• LAVIS.
• LLaMA-Adapter.

Bare python module

Install

pip install -e .

You may have to install extra packages so that python modules can work.

If you want to use LLaMA-Adapter, please install llama_adapter_v2_multimodal package in this LLaMA-Adapter fork.

RUN

To run the server

run_lavis_server

You can check a client demo

sample_lavis_client

Docker image

There is a docker image for server

docker built -t sktometometo/foundation-model-grpc-server .

and run the server.

docker run -p 50051:50051 --gpus all sktometometo/foundation-model-grpc-server

ROS Package

Install

rosdep install --from-paths . --ignore-src -y -r
catkin build foundation_model_grpc_server

How to use demo

After launch a server.

roslaunch foundation_model_grpc_server demo.launch