DynamoDB Connector

[SteveDMurphy]

Closes #2938

Code Changes

• Add aws connector commands for DynamoDB
• Include a CLI command to generate a dataset
• Update the API to generate a DynamoDB dataset
• Store the primary key and secondary sort (optional) as dataset meta inferred from get_item
• Add tests for the request_runner_service (access & erasure)
• Add tests for the CLI command
• Add tests for the query param generation
• Create and add an SVG template for the frontend for DynamoDB

Steps to Confirm

• Set credentials as stored in 1Password
• Create a connector for Dynamo (the config options are sneakily flipped, not sure how here)
• Test the connection

Pre-Merge Checklist

• All CI Pipelines Succeeded
• Documentation:
  • documentation complete, PR opened in fidesdocs
  • documentation issue created in fidesdocs fidesdocs#91
• Issue Requirements are Met
• Relevant Follow-Up Issues Created
• Update CHANGELOG.md
• For API changes, the Postman collection has been updated

Description Of Changes

This is the connector for DynamoDB, the consent component will be worked separately in both documentation and fidesplus.

It appears that some of the other unsafe checks that are not currently passing are being ignored for now, although I have validated the ones added here for DynamoDB appear to be in the clear :)

There have been more than a few migration conflicts so there may be some further need to keep up with more of those changes until this merges

[cypress]

Passing run #1886 ↗︎

0	4	0	0	0
⚠️ You've recorded test results over your free plan limit. Upgrade your plan to view test results.

Details:

Merge 649f723 into 8dd6881...
Project: fides	Commit: 4c5664d8e0 ℹ️
Status: Passed	Duration: 00:58 💡
Started: May 10, 2023 4:55 PM	Ended: May 10, 2023 4:56 PM

_{This comment has been generated by cypress-bot as a result of this project's GitHub integration settings.}

[codecov]

Codecov Report

Patch coverage: 46.96% and project coverage change: -0.45 ⚠️

Comparison is base (c063274) 87.39% compared to head (649f723) 86.94%.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #2998      +/-   ##
==========================================
- Coverage   87.39%   86.94%   -0.45%     
==========================================
  Files         305      307       +2     
  Lines       18265    18460     +195     
  Branches     2384     2407      +23     
==========================================
+ Hits        15962    16050      +88     
- Misses       1866     1971     +105     
- Partials      437      439       +2     

Impacted Files	Coverage Δ
src/fides/api/ops/task/task_resources.py	83.14% <0.00%> (-1.92%)	⬇️
src/fides/api/ctl/routes/generate.py	42.72% <21.42%> (-3.67%)	⬇️
...s/api/ops/service/connectors/dynamodb_connector.py	27.65% <27.65%> (ø)
src/fides/core/dataset.py	78.81% <37.50%> (-3.17%)	⬇️
src/fides/connectors/aws.py	40.44% <38.88%> (-1.22%)	⬇️
src/fides/cli/commands/generate.py	84.33% <76.47%> (-2.03%)	⬇️
...c/fides/api/ops/service/connectors/query_config.py	85.18% <87.50%> (+0.25%)	⬆️
src/fides/api/ops/models/connectionconfig.py	96.03% <100.00%> (+0.03%)	⬆️
...i/ops/schemas/connection_configuration/__init__.py	90.90% <100.00%> (+0.43%)	⬆️
...ction_configuration/connection_secrets_dynamodb.py	100.00% <100.00%> (ø)
... and 1 more

... and 2 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

[SteveDMurphy]

I'm still resolving a couple of spooky issues that I think were related to migration conflicts but mostly just planning to add some DynamoDB request specific unit tests and would love any early feedback @galvana !

[SteveDMurphy]

@seanpreston expected checks are good and opened up #3278 for the two that are currently failing

[seanpreston]

Thanks for those extra changes @SteveDMurphy