Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add post content updated topic #1946

Merged
merged 19 commits into from
Jun 5, 2024
Merged

Conversation

capJavert
Copy link
Contributor

@capJavert capJavert commented May 28, 2024

  • add new content updated topic for API being source of truth for post data
  • utilized typed workers since they already accept types which we can load from schema package 👌
  • have an issue with JSON encoding, opened an issue

@capJavert capJavert self-assigned this May 28, 2024
src/workers/cdc/common.ts Outdated Show resolved Hide resolved
@capJavert capJavert requested review from a team, rebelchris, omBratteng, sshanzel and nensidosari and removed request for a team May 29, 2024 09:02
@capJavert capJavert marked this pull request as ready for review May 29, 2024 09:02
@capJavert capJavert requested a review from a team as a code owner May 29, 2024 09:02
@capJavert
Copy link
Contributor Author

Opening up for review, but as said I might have to fallback some values due to JSON encode issues.

@capJavert capJavert force-pushed the AS-254-content-updated-topic branch from 88763bf to 5d68b1a Compare May 31, 2024 10:06
src/workers/cdc/common.ts Outdated Show resolved Hide resolved
@capJavert capJavert requested review from rebelchris and removed request for rebelchris May 31, 2024 10:08
Copy link
Contributor

@rebelchris rebelchris left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nothing blocking just one question.

const articlePost = post as ChangeObject<ArticlePost>;
const freeformPost = post as ChangeObject<FreeformPost>;

const contentUpdatedMessage = new ContentUpdatedMessage({
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't we also need the steps here?
(not sure what we called them)

Copy link
Contributor Author

@capJavert capJavert Jun 3, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what steps, for scraping and content processing?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah the steps taking in processing that we discussed.
So what steps where already done for a article.

Copy link
Contributor Author

@capJavert capJavert Jun 3, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It should be in content_meta, @vpol do you know if one of the fields in schema represent it? Denis did add additional fields that yggdrasil sends.

@capJavert
Copy link
Contributor Author

Merging to see how it works in production. No subscribers yet so it won't really be used instantly.

@capJavert capJavert merged commit 6a33742 into main Jun 5, 2024
8 checks passed
@capJavert capJavert deleted the AS-254-content-updated-topic branch June 5, 2024 08:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants