Add Non-persistent deployment type #197

TosinSeg · 2023-05-31T23:42:26Z

Add Non-persistent deployment type

Adding persistent model global variable

Storing persistent model as a dictionary

Adding persistent model global variable

Storing persistent model as a dictionary

…eg/DeepSpeed-MII into Non-persistent-deployment

mii/__init__.py

mii/client.py

mii/deployment.py

mii/server.py

tests/test_non_persistent_deployment.py

…ment

mii/client.py

mii/method_table.py

tests/test_non_persistent_deployment.py

mii/client.py

tohtana · 2023-06-21T23:24:11Z

Shouldn't we add an example in examples/local and some description to README (e.g. following "RESTful API support")?

mii/deployment.py

Co-authored-by: Michael Wyatt <[email protected]>

README.md

TosinSeg and others added 4 commits May 31, 2023 16:41

Update constants.py

a8064ac

Adding persistent model global variable

ef8a774

Adding persistent model global variable

Storing persistent model as a dictionary

b54034e

Storing persistent model as a dictionary

Non-persistent updates

c889580

mrwyattii mentioned this pull request Jun 2, 2023

Refactor task methods #200

Closed

TosinSeg and others added 10 commits June 6, 2023 17:25

Update constants.py

dd65681

Adding persistent model global variable

229095c

Adding persistent model global variable

Storing persistent model as a dictionary

b36c500

Storing persistent model as a dictionary

Non-persistent updates

e85f63b

merged main branch

e4e618d

Reformatting structure of the mii.persistent_model dict

eeba401

Reformatting structure of the mii.persistent_model dict

41eaba5

Merge branch 'Non-persistent-deployment' of https://github.com/TosinS…

a44095e

…eg/DeepSpeed-MII into Non-persistent-deployment

Added tests for Non-persistent-deployment

6f09d57

New test file (Should have been on the last commit)

c00b388

mrwyattii suggested changes Jun 7, 2023

View reviewed changes

Tosin Segun added 12 commits June 7, 2023 18:30

Parsing query for conversational task

efb45b1

Initial non_persistent test refactoring

66d4483

Fixing import statement

08396ef

Fixed kwargs in query

aaa5f61

Fixed fill-mask query error

383da4c

Defining Kwargs

7ad8987

Added termination logic for non_persistent_model

965e112

Fixing args parameter

ceb7da1

Reverting run_inference change

a54cb66

Fixing arguments for run_inference function

49c11dc

Fixing conversational and fill-mask queries for non_persistent_deploy…

4ae1dd8

…ment

Refactored unit tests

289250d

mrwyattii suggested changes Jun 9, 2023

View reviewed changes

mii/client.py Outdated Show resolved Hide resolved

mii/client.py Show resolved Hide resolved

mii/client.py Outdated Show resolved Hide resolved

mii/client.py Outdated Show resolved Hide resolved

mii/method_table.py Outdated Show resolved Hide resolved

Refactoring Conversation task args

56d647d

mrwyattii approved these changes Jun 20, 2023

View reviewed changes

mii/method_table.py Outdated Show resolved Hide resolved

tests/test_non_persistent_deployment.py Outdated Show resolved Hide resolved

mrwyattii added 2 commits June 20, 2023 11:00

Update mii/method_table.py

ee74603

Update tests/test_non_persistent_deployment.py

939002c

mrwyattii marked this pull request as ready for review June 20, 2023 18:00

mrwyattii requested review from jeffra, awan-10 and samyam as code owners June 20, 2023 18:00

tohtana reviewed Jun 21, 2023

View reviewed changes

mii/client.py Show resolved Hide resolved

tohtana reviewed Jun 21, 2023

View reviewed changes

mii/client.py Show resolved Hide resolved

tohtana reviewed Jun 21, 2023

View reviewed changes

mii/client.py Show resolved Hide resolved

Refactored non_persistent deployment call

f7b8e49

mrwyattii reviewed Jun 22, 2023

View reviewed changes

mii/deployment.py Outdated Show resolved Hide resolved

mrwyattii reviewed Jun 22, 2023

View reviewed changes

mii/deployment.py Outdated Show resolved Hide resolved

mrwyattii reviewed Jun 22, 2023

View reviewed changes

mii/deployment.py Outdated Show resolved Hide resolved

TosinSeg and others added 8 commits June 22, 2023 16:45

refactoring query_handle()

811c57c

Adding more descriptive error message

eca4c73

Co-authored-by: Michael Wyatt <[email protected]>

Reformatting deploy parameters

c1b8ada

Co-authored-by: Michael Wyatt <[email protected]>

Updating deploy_non_persistent parameters

df2a6ed

Co-authored-by: Michael Wyatt <[email protected]>

Fixing formatting

228e9f2

Added example to the readme

1b534bc

Removing deploy_non_persistent() function

7f293c2

removing import statement from init

e65eaf0

mrwyattii reviewed Jun 22, 2023

View reviewed changes

README.md Outdated Show resolved Hide resolved

mrwyattii reviewed Jun 22, 2023

View reviewed changes

README.md Outdated Show resolved Hide resolved

mrwyattii approved these changes Jun 22, 2023

View reviewed changes

mrwyattii added 2 commits June 22, 2023 13:21

Update README.md

a881f4c

Update README.md

3ecdfc5

mrwyattii merged commit dac178e into microsoft:main Jun 22, 2023
4 checks passed

anandsriraman mentioned this pull request Jul 19, 2023

NON_PERSISTENT deployment type giving AttributeError #210

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add Non-persistent deployment type #197

Add Non-persistent deployment type #197

TosinSeg commented May 31, 2023

tohtana commented Jun 21, 2023