Skip to content

Latest commit

 

History

History
23 lines (18 loc) · 436 Bytes

File metadata and controls

23 lines (18 loc) · 436 Bytes

DeepSpeed Huggingface Text2Text Generation Examples

Setup

Python dependencies:

pip install -r requirements.txt

Usage

Examples can be run as follows:

deepspeed --num_gpus [number of GPUs] test-[model].py

Example Output

Command:

deepspeed --num_gpus 1 test-t5.py

Output:

[{'generated_text': 'd review: this is the best cast iron skillet. Great review! Great review! Great'}]