Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CON-206: Responsys access and erasure #4618

Merged
merged 29 commits into from
Mar 1, 2024

Conversation

RobertKeyser
Copy link
Contributor

@RobertKeyser RobertKeyser commented Feb 15, 2024

Closes CON-206

Description Of Changes

This PR adds access and erasure support for Oracle Responsys. The identities supported are email and phone number.

Code Changes

  • Access/Erasure support for Oracle Responsys
  • Associated tests
  • Testing function to generate phone numbers

Steps to Confirm

  • Run access/erasure test
  • Run access/erasure through ui

Pre-Merge Checklist

Copy link

vercel bot commented Feb 15, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
fides-plus-nightly ⬜️ Ignored (Inspect) Visit Preview Mar 1, 2024 4:49pm

Copy link

cypress bot commented Feb 15, 2024

Passing run #6423 ↗︎

0 4 0 0 Flakiness 0
⚠️ You've recorded test results over your free plan limit.
Upgrade your plan to view test results.

Details:

Merge 0f93bbf into c00494c...
Project: fides Commit: 37cbffcfd4 ℹ️
Status: Passed Duration: 00:35 💡
Started: Feb 29, 2024 9:15 PM Ended: Feb 29, 2024 9:15 PM

Review all test suite changes for PR #4618 ↗︎

Copy link

codecov bot commented Feb 23, 2024

Codecov Report

Attention: Patch coverage is 40.25974% with 46 lines in your changes are missing coverage. Please review.

Project coverage is 86.67%. Comparing base (c00494c) to head (0f93bbf).
Report is 1 commits behind head on main.

Files Patch % Lines
...lementations/oracle_responsys_request_overrides.py 32.65% 33 Missing ⚠️
...ations/authentication_strategy_oracle_responsys.py 53.57% 13 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #4618      +/-   ##
==========================================
- Coverage   86.85%   86.67%   -0.18%     
==========================================
  Files         334      336       +2     
  Lines       20013    20090      +77     
  Branches     2569     2581      +12     
==========================================
+ Hits        17383    17414      +31     
- Misses       2157     2203      +46     
  Partials      473      473              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@RobertKeyser RobertKeyser self-assigned this Feb 26, 2024
@RobertKeyser RobertKeyser marked this pull request as ready for review February 27, 2024 18:09
Copy link
Contributor

@galvana galvana left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good so far! You're following all the connector conventions, I didn't have to call anything major out in the config, dataset, or tests. I only left one comment about testing the response transformation in the oracle_responsys_profile_list_recipients_read request override.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This connector doesn't specify an icon so it falls back to the default ethyca.svg. This is how I noticed that the default icon has an unwanted fill. Just updating this so the entry looks good in the connector dropdown.
image
With that said, do you want to add an icon for Oracle Responsys?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added an SVG, but I couldn't change the viewbox to 0 0 32 32 without clipping some of the SVG. @galvana, you have a way to do this, right?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't know about 'right' but typically we work with the icon in the figma page until we get it the way we like, then we can save it out to submit in the PR. We can walk through this pretty easy, but I can't lead just yet as I have requested access but don't have it yet =/

I found this icon that has both Oracle and Responsys in it but since I can't get into figma to verify if it will be easy to use or not =(
responsys_logo_cropped

Comment on lines +75 to +91
response_data = pydash.get(members_response.json(), "recordData")
if response_data:
normalized_field_names = [
field.lower().rstrip("_") for field in response_data["fieldNames"]
]
serialized_data = [
dict(zip(normalized_field_names, records))
for records in response_data["records"]
]

for record in serialized_data:
# Filter out the keys with falsy values and append it
filtered_records = {
key: value for key, value in record.items() if value
}
filtered_records["profile_list_id"] = list_id
results.append(filtered_records)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might be a good idea to break out the response processing into its own function so that we can test out some different scenarios. It's also a good way for someone to understand what's happening here if some sample test cases are provided.

data/saas/config/oracle_responsys_config.yml Show resolved Hide resolved
@MarcGEthyca
Copy link
Contributor

I ran through the checklist and it looked like we may need docs for this, I took a stab at it and updated the description with the PR link and Issue link. Hope that's okay!

RobertKeyser and others added 3 commits February 29, 2024 14:51
currently the viewbox is 0 0 48 48, but I see the rest are 0 0 32 32, so we might need to adjust it.
@galvana galvana self-requested a review March 1, 2024 16:47
@galvana galvana merged commit bff5df7 into main Mar 1, 2024
14 checks passed
@galvana galvana deleted the CON-206-responsys-access-and-erasure branch March 1, 2024 16:49
galvana added a commit that referenced this pull request Mar 1, 2024
@cypress cypress bot mentioned this pull request Mar 1, 2024
31 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants