Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fewer porter jobs/callbacks #564

Open
cavis opened this issue Jun 22, 2020 · 2 comments
Open

Fewer porter jobs/callbacks #564

cavis opened this issue Jun 22, 2020 · 2 comments
Labels
high
Milestone
Sprint White Sands

Comments

@cavis
Copy link
Member

cavis commented Jun 22, 2020 •
edited
Loading

CMS worker gets real bogged down during feed imports. Attempt to minimize redundant jobs/callbacks. Crazy ideas:

  • Make sure we only send each audio_file / image to Porter once. We appear to be sending duplicates for segments > 1 right now.
  • Make sure Porter callbacks don't change audio_file timestamps when they don't need to. Since those will generate announcements to feeder and more CMS-search-index jobs.
  • Look into upgrading shoryuken for better parallelization
@cavis
Copy link
Member Author

cavis commented Jun 22, 2020

Also per @kookster ... the audio_file acts_as_list code may be causing the specific issue where we reprocess segments > 1.

@cavis cavis added the high label Jun 22, 2020
@cavis cavis added this to the Sprint Joshua Tree milestone Jun 22, 2020
@cavis
Copy link
Member Author

cavis commented Aug 4, 2020

There may also be a problem with the podcast importer unlocking the Feeder podcast too early. Seeing a ton of publish feed jobs over there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
high
Projects
None yet
Milestone
Sprint White Sands
Development

No branches or pull requests
2 participants
@cavis @IcusFMagni