Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(sagemaker): add model hosting L2 constructs #20113

Closed
wants to merge 65 commits into from
Closed

feat(sagemaker): add model hosting L2 constructs #20113

wants to merge 65 commits into from

Commits on Feb 4, 2020

  1. feat(sagemaker): add model hosting L2 constructs 

    Based closely on PR aws#2888, this commit introduces the Endpoint L2
construct and the L2 constructs on which it depends, including Model and
EndpointConfig. Departures from PR aws#2888 include:
- EndpointConfig definition moved into its own L2 construct as one
  EndpointConfig resource may be shared by multiple Endpoints.
- An Endpoint-specific IEndpointProductionVariant interface was added to
  support "metric*" and "autoScale*" APIs per endpoint-variant
  combination.
- The Notebook construct was excluded from this new commit to limit
  changes to model hosting use-cases only.
- Feedback on the earlier PR has been incorporated into this new commit.

fixes aws#2809

Co-authored-by: Matt McClean <[email protected]>
Co-authored-by: Yao <[email protected]>
Co-authored-by: Drew Jetter <[email protected]>
Co-authored-by: Murali Ganesh <[email protected]>
Co-authored-by: Abilash Rangoju <[email protected]>
    @petermeansrock @mmcclean-aws
    @jetterdj @foxpro24 @rangoju
    6 people committed Feb 4, 2020
    Configuration menu
    Copy the full SHA
    c2b8d37 View commit details
    Browse the repository at this point in the history

  2. add README changes missing from earlier commit

    @petermeansrock
    petermeansrock committed Feb 4, 2020
    Configuration menu
    Copy the full SHA
    a68ba16 View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2020

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Feb 24, 2020
    Configuration menu
    Copy the full SHA
    8a9494e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Feb 24, 2020
    Configuration menu
    Copy the full SHA
    9edc79d View commit details
    Browse the repository at this point in the history

Commits on Feb 25, 2020

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Feb 25, 2020
    Configuration menu
    Copy the full SHA
    9c94dc9 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2020

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Feb 28, 2020
    Configuration menu
    Copy the full SHA
    95b4d5a View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2020

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Mar 3, 2020
    Configuration menu
    Copy the full SHA
    70a0b73 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Mar 3, 2020
    Configuration menu
    Copy the full SHA
    d52be3c View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2020

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Mar 4, 2020
    Configuration menu
    Copy the full SHA
    9afb024 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Mar 4, 2020
    Configuration menu
    Copy the full SHA
    344894f View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2020

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Mar 7, 2020
    Configuration menu
    Copy the full SHA
    a5236c0 View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2020

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Mar 9, 2020
    Configuration menu
    Copy the full SHA
    4aa4fab View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2020

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Mar 11, 2020
    Configuration menu
    Copy the full SHA
    b3678d2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Mar 11, 2020
    Configuration menu
    Copy the full SHA
    d16127e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Mar 11, 2020
    Configuration menu
    Copy the full SHA
    83a3ac2 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Mar 11, 2020
    Configuration menu
    Copy the full SHA
    fc25fdb View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2020

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock authored Mar 12, 2020
    Configuration menu
    Copy the full SHA
    f30c975 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2022

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    9e5575d View commit details
    Browse the repository at this point in the history

  2. Adopt Jest naming convention

    @petermeansrock
    petermeansrock committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    8351909 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2022

  1. Migrate from Nodeunit/assert to Jest/assertions

    @petermeansrock
    petermeansrock committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    50fc173 View commit details
    Browse the repository at this point in the history

  2. Support integ test run on non-linux/amd64 machines

    @petermeansrock
    petermeansrock committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    143aec5 View commit details
    Browse the repository at this point in the history

  3. Migrate off deprecated APIs

    @petermeansrock
    petermeansrock committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    519415c View commit details
    Browse the repository at this point in the history

  4. Update code to meet linting requirements

    @petermeansrock
    petermeansrock committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    531d06a View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2022

  1. Replace cdk-integ snapshots with integ-runner ones

    @petermeansrock
    petermeansrock committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    bdb3be0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    8fdb2fd View commit details
    Browse the repository at this point in the history

  3. Add Rosetta fixtures to fix README build issues

    @petermeansrock
    petermeansrock committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    43afc42 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2022

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock committed May 11, 2022
    Configuration menu
    Copy the full SHA
    abfdc66 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2022

  1. Remove extra newline from README

    @petermeansrock
    petermeansrock committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    ad51f1b View commit details
    Browse the repository at this point in the history

  2. Incorporate README file changes from RFC review

    @petermeansrock
    petermeansrock committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    18ef532 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2022

  1. Fix specification of defaults per RFC feedback

    @petermeansrock
    petermeansrock committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    b979d23 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2022

  1. Simplify autoscaling documentation per RFC feedback

    @petermeansrock
    petermeansrock committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    fe232e7 View commit details
    Browse the repository at this point in the history

  2. Remove mention of endpoint from model VPC docs

    @petermeansrock
    petermeansrock committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    1dc57f8 View commit details
    Browse the repository at this point in the history

  3. Eliminate uppercase abbreviations per RFC feedback

    @petermeansrock
    petermeansrock committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    bd77937 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2022

  1. Simplify container/variant props per RFC feedback

    @petermeansrock
    petermeansrock committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    6c2b696 View commit details
    Browse the repository at this point in the history

  2. Bring container limit up-to-date with reality

    @petermeansrock
    petermeansrock committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    c4dad9f View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2022

  1. Support lazy specification of model containers

    @petermeansrock
    petermeansrock committed Aug 25, 2022
    Configuration menu
    Copy the full SHA
    2145924 View commit details
    Browse the repository at this point in the history

  2. Remove non-default Rosetta fixtures

    @petermeansrock
    petermeansrock committed Aug 25, 2022
    Configuration menu
    Copy the full SHA
    e549cbf View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2022

  1. Document EndpointConfig reuse across Endpoints

    @petermeansrock
    petermeansrock committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    93a8c85 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2022

  1. Drop scope/id specification in ContainerImage API

    @petermeansrock
    petermeansrock committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    1df7d85 View commit details
    Browse the repository at this point in the history

  2. Drop scope/id specification in ModelData API

    @petermeansrock
    petermeansrock committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    8612092 View commit details
    Browse the repository at this point in the history

  3. Distinguish instance-based variants

    @petermeansrock
    petermeansrock committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    ed87db4 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2022

  1. List supported instance types with InstanceType

    @petermeansrock
    petermeansrock committed Sep 14, 2022
    Configuration menu
    Copy the full SHA
    5e903fa View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2022

  1. Distinguish instance-based variants for Endpoints

    @petermeansrock
    petermeansrock committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    1d681da View commit details
    Browse the repository at this point in the history

  2. Drop README mention of IEndpointProductionVariant

    @petermeansrock
    petermeansrock committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    88a8708 View commit details
    Browse the repository at this point in the history

  3. Use enum-like class for AcceleratorType

    @petermeansrock
    petermeansrock committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    0ade09b View commit details
    Browse the repository at this point in the history

  4. Add return type to accelerator/instance type APIs

    @petermeansrock
    petermeansrock committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    c7d27c9 View commit details
    Browse the repository at this point in the history

  5. Fix missing mention of "instance" in docs

    @petermeansrock
    petermeansrock committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    1f21d15 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2022

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    f670653 View commit details
    Browse the repository at this point in the history

  2. Replace validate() hooks with node.addValidation()

    @petermeansrock
    petermeansrock committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    3c36b11 View commit details
    Browse the repository at this point in the history

  3. Fix burstable check after EC2 module refactor

    @petermeansrock
    petermeansrock committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    049eec4 View commit details
    Browse the repository at this point in the history

  4. Flip zip check as behavior changed on gzipped tars

    @petermeansrock
    petermeansrock committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    867e9f5 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2022

  1. Specify ECR image tag as CDK no longer uses latest

    @petermeansrock
    petermeansrock committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    28f0409 View commit details
    Browse the repository at this point in the history

  2. Adopt IntegTest & rengerate snapshots

    @petermeansrock
    petermeansrock committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    371f756 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    f8cd7db View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2022

  1. Verify endpoint behavior in integ test w/ API call

    @petermeansrock
    petermeansrock committed Sep 22, 2022
    Configuration menu
    Copy the full SHA
    a7faff8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock committed Sep 22, 2022
    Configuration menu
    Copy the full SHA
    ebd2b0f View commit details
    Browse the repository at this point in the history

  3. Validate presence of at least one variant

    @petermeansrock
    petermeansrock committed Sep 22, 2022
    Configuration menu
    Copy the full SHA
    588100a View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock committed Sep 22, 2022
    Configuration menu
    Copy the full SHA
    9b1766d View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2022

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock committed Oct 3, 2022
    Configuration menu
    Copy the full SHA
    8640604 View commit details
    Browse the repository at this point in the history

  2. Create assets behind ContainerImage.fromAsset API

    @petermeansrock
    petermeansrock committed Oct 3, 2022
    Configuration menu
    Copy the full SHA
    4573d5b View commit details
    Browse the repository at this point in the history

  3. Create assets behind ModelData.fromAsset API

    @petermeansrock
    petermeansrock committed Oct 3, 2022
    Configuration menu
    Copy the full SHA
    381cb6f View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2022

  1. Trim README content in favor of links to AWS docs

    @petermeansrock
    petermeansrock committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    74a8f3c View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2022

  1. Merge branch 'master' into sagemaker-l2

    @petermeansrock
    petermeansrock committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    406875f View commit details
    Browse the repository at this point in the history

  2. Adjust EndpointConfig tests to emphasize synthesis

    @petermeansrock
    petermeansrock committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    0f22439 View commit details
    Browse the repository at this point in the history

  3. Adjust EndpointProps to take IEndpointConfig

    @petermeansrock
    petermeansrock committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    e0741ff View commit details
    Browse the repository at this point in the history