You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'd like to combine the current behavior of PinterestBoardExtractor (with sections set to False) and the PinterestSectionExtractor. In short, I want to download all pins from a board that are not in a section into the board's directory locally, and all pins from each section into each board section's directory.
I'd also like to set up this functionality at the PinterestUserExtractor level.
I think I'd actually be willing to try implementing myself but want to get some guidance on the best way to do this. Mostly, "what should I call the configuration option(s) related to this"? I said "hybrid" in the title because both the existing extractors for sections and boards already do what I want, just not together and at the same time.
If I'm reading the code correctly, I'd probably need to override items inside PinterestBoardExtractor to somehow return (yield?) individual PinterestSectionExtractor instances for each board that has sections if my configuration option is set in addition to manually setting sections to False for this specific instance of the PinterestBoardExtractor (in case for some reason someone sets sections to True or leaves the default, which I believe defaults to True).
This is where I'm not 100% sure how best to move forward. :) Hoping someone can help give me a bit of advice or possibly reference some existing extractor (I'm only familiar with pinterest at this point) that is already doing something similar.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I'd like to combine the current behavior of
PinterestBoardExtractor
(withsections
set toFalse
) and thePinterestSectionExtractor
. In short, I want to download all pins from a board that are not in a section into the board's directory locally, and all pins from each section into each board section's directory.I'd also like to set up this functionality at the
PinterestUserExtractor
level.I think I'd actually be willing to try implementing myself but want to get some guidance on the best way to do this. Mostly, "what should I call the configuration option(s) related to this"? I said "hybrid" in the title because both the existing extractors for sections and boards already do what I want, just not together and at the same time.
If I'm reading the code correctly, I'd probably need to override
items
insidePinterestBoardExtractor
to somehow return (yield
?) individualPinterestSectionExtractor
instances for each board that has sections if my configuration option is set in addition to manually settingsections
toFalse
for this specific instance of thePinterestBoardExtractor
(in case for some reason someone setssections
toTrue
or leaves the default, which I believe defaults toTrue
).This is where I'm not 100% sure how best to move forward. :) Hoping someone can help give me a bit of advice or possibly reference some existing extractor (I'm only familiar with pinterest at this point) that is already doing something similar.
Beta Was this translation helpful? Give feedback.
All reactions