Skip to content

Commit

Permalink
Update infer and execute API
Browse files Browse the repository at this point in the history
Signed-off-by: mamtsing <[email protected]>
  • Loading branch information
quic-mamta authored and mamtsing committed May 17, 2024
1 parent 861e60c commit a9a9ed0
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 1 deletion.
1 change: 1 addition & 0 deletions QEfficient/cloud/execute.py
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,7 @@ def main(
)
parser.add_argument(
"--inputs_file_path",
"--inputs-file-path",
type=str,
help="for batch size>1, pass input prompts in txt file, sample prompts.txt file present in examples folder",
)
Expand Down
2 changes: 1 addition & 1 deletion QEfficient/cloud/infer.py
Original file line number Diff line number Diff line change
Expand Up @@ -189,7 +189,7 @@ def main(

if __name__ == "__main__":
parser = argparse.ArgumentParser(
description="Inference command, the model will be downloaded from HF, optmized, compiled, executed on AIC"
description="Inference command, the model will be downloaded from HF, optmized, compiled, executed on Cloud AI 100"
)
parser.add_argument("--model-name", "--model_name", required=True, help="HF Model card name/id")
parser.add_argument(
Expand Down

0 comments on commit a9a9ed0

Please sign in to comment.