[DeviantArt] Is it possible to retrieve ALL comments?

[Throun]

I know that gallery-dl uses the public DeviantArt api, and the api only fetches comments up to 5 deep. Is there a way to get every comment on a deviation?

I tried to solve this by running curl after each download:
"postprocessors": [ { "name": "exec", "command": [ "curl", "https://www.deviantart.com/_napi/shared_api/comments/thread?typeid=1&itemid={index}&maxdepth=10000&order=newest&limit=50&csrf_token={csrf_token}" ] }]
However, gallery-dl doesn't expose CSRF tokens as a value like I thought and I can't see a way to manually get it, so this is a dead end so far.

[mikf]

Just a CSRF token alone isn't enough. You would also need the accompanying cookie(s).
You would also need to call this endpoint several times when there are more than limit=50 comments.

I'll look into improving the current comment code.

[Throun]

Thank you! Just tried it on my end and it looks like it's working, though a couple comments are out of place.

As to the arraignment, it's nothing I feel needs to be implemented. It'd be nice to have for readability, personally, but I see it as something low priority. Maybe ask others to get their thoughts?

[Twi-Hard]

I wouldn't want the comments nested like that because it would break compatibility with all of the ones I have already.

[Throun]

I wouldn't want the comments nested like that because it would break compatibility with all of the ones I have already.

Yeah, that's something I was thinking of. Maybe do it as an option you have to configure? However, at that point, I foresee it requiring more effort than is worth it for something so minor, no matter how much I would personally like to have this.

[Ihateyoudotorg]

You guys have an answer for this?

[Ihateyoudotorg]

It should now grab all comment replies with the changes in bfdc076. I couldn't find any nested replies in the wild, so I created some myself at https://www.deviantart.com/justatest235723/art/Blue-811519058 and it does indeed fetch all 20.

Another thing that came to mind while working on this: Comments are currently returned as a flat list. Should they instead be arranged in a tree-like structure so you'd get something like this?

[
    {
        "body": "comment1",
        "replies": [
            {
                "body": "reply1",
                "replies": [
                    {
                        "body": "reply1-1"
                        "replies": []
                    }
                ]
            },
            {
                "body": "reply2",
                "replies": []
            }
        ]
    }
]

Does this answer how to get comments from this page? https://www.deviantart.com/kabutopsthebadd/art/Fell-on-lincoln-732489842

[CharlieKuoGo]

Could you kindly assist me in retrieving all the comments for this deviant -- https://www.deviantart.com/lukeclark4/art/Tsuyu-and-Dabi-swap-901819947? Although there are thousands of comments, I have only been able to retrieve a few of them.