diff --git a/doc/source/ray-overview/use-cases.rst b/doc/source/ray-overview/use-cases.rst index a6ae09503c98..e66b27267aa5 100644 --- a/doc/source/ray-overview/use-cases.rst +++ b/doc/source/ray-overview/use-cases.rst @@ -5,6 +5,89 @@ Ray Use Cases This page indexes common Ray use cases for scaling ML. It contains highlighted references to blogs, examples, and tutorials also located elsewhere in the Ray documentation. +.. _ref-use-cases-llm: + +Large Language Models and Generative AI +--------------------------------------- + +The following highlights feature projects that use Ray to implement Large Language Models and Generative AI applications. + +.. panels:: + :container: container pb-3 + :column: col-md-3 px-1 py-1 + :img-top-cls: p-2 w-75 d-block mx-auto fixed-height-img + + --- + :img-top: /images/ray_logo.png + + .. link-button:: https://www.anyscale.com/blog/ray-common-production-challenges-for-generative-ai-infrastructure + :type: url + :text: [Blog] How Ray solves common production challenges for generative AI infrastructure + :classes: btn-link btn-block stretched-link webCrawler + + --- + :img-top: /images/ray_logo.png + + .. link-button:: https://www.anyscale.com/blog/training-175b-parameter-language-models-at-1000-gpu-scale-with-alpa-and-ray + :type: url + :text: [Blog] Training 175B Parameter Language Models at 1000 GPU scale with Alpa and Ray + :classes: btn-link btn-block stretched-link webCrawler + + --- + :img-top: /images/ray_logo.png + + .. link-button:: https://www.anyscale.com/blog/faster-stable-diffusion-fine-tuning-with-ray-air + :type: url + :text: [Blog] Faster stable diffusion fine-tuning with Ray AIR + :classes: btn-link btn-block stretched-link webCrawler + + --- + :img-top: /images/ray_logo.png + + .. link-button:: https://www.anyscale.com/blog/how-to-fine-tune-and-serve-llms-simply-quickly-and-cost-effectively-using + :type: url + :text: [Blog] How to fine tune and serve LLMs simply, quickly and cost effectively using Ray + DeepSpeed + HuggingFace + :classes: btn-link btn-block stretched-link webCrawler + + --- + :img-top: /images/ray_logo.png + + .. link-button:: https://www.businessinsider.com/openai-chatgpt-trained-on-anyscale-ray-generative-lifelike-ai-models-2022-12 + :type: url + :text: [Blog] How OpenAI Uses Ray to Train Tools like ChatGPT + :classes: btn-link btn-block stretched-link chatgpt + --- + :img-top: /images/ray_logo.png + + .. link-button:: /ray-air/examples/gptj_deepspeed_fine_tuning + :type: ref + :text: [Example] GPT-J-6B Fine-Tuning with Ray AIR and DeepSpeed + :classes: btn-link btn-block stretched-link antServing + + --- + :img-top: /images/ray_logo.png + + .. link-button:: /ray-air/examples/dreambooth_finetuning + :type: ref + :text: [Example] Fine-tuning DreamBooth with Ray AIR + :classes: btn-link btn-block stretched-link rayForward + + --- + :img-top: /images/ray_logo.png + + .. link-button:: /ray-air/examples/stablediffusion_batch_prediction + :type: ref + :text: [Example] Stable Diffusion Batch Prediction with Ray AIR + :classes: btn-link btn-block stretched-link rayForward + + --- + :img-top: /images/ray_logo.png + + .. link-button:: /ray-air/examples/gptj_serving + :type: ref + :text: [Example] GPT-J-6B Serving with Ray AIR + :classes: btn-link btn-block stretched-link webCrawler + .. _ref-use-cases-batch-infer: Batch Inference @@ -530,13 +613,6 @@ The following highlights feature projects leveraging Ray Core's distributed APIs --- :img-top: /images/ray_logo.png - .. link-button:: https://www.businessinsider.com/openai-chatgpt-trained-on-anyscale-ray-generative-lifelike-ai-models-2022-12 - :type: url - :text: [Blog] How OpenAI Uses Ray to Train Tools like ChatGPT - :classes: btn-link btn-block stretched-link chatgpt - --- - :img-top: /images/ray_logo.png - .. link-button:: https://www.anyscale.com/blog/building-highly-available-and-scalable-online-applications-on-ray-at-ant :type: url :text: [Blog] Highly Available and Scalable Online Applications on Ray at Ant Group @@ -564,4 +640,4 @@ The following highlights feature projects leveraging Ray Core's distributed APIs .. link-button:: /ray-core/examples/web-crawler :type: ref :text: [Example] Speed up your web crawler by parallelizing it with Ray - :classes: btn-link btn-block stretched-link webCrawler + :classes: btn-link btn-block stretched-link webCrawler \ No newline at end of file