ledger table data is not cleared properly

[LaurenWags]

Description

Ledger table data is not cleared properly when clearing Browser History with Payments Disabled.

Steps to Reproduce

1. Have a ledger with some entries (some included, some not included).
2. Note views/amt of time spent for a couple of sites.
3. Disable payments.
4. Go to about:preferences#security, click on Clear Browsing Data Now, enable toggle for
5. Browser History, click Clear
6. Enable payments.
7. Table is blank as expected.
8. Visit one of the sites you noted that was marked as include.
9. Note as soon as the page loads (prior to default value of 8s) your URL heart icon is yellow indicating it is in the table.
10. Go back to Payments (you might have to refresh due to another issue)
11. Your site is listed in the table with similar visit#/time spent as prior to clearing data. I was expecting the counters to start over.
12. Repeat with another site that had been in the table prior to clearing Browser History. You will see a similar result.

Actual result:

Expected result:
Since table data had been cleared, I was expecting the number of visits and time spent counters to reset. The amount of time of the gif above is less than 1.5 minutes, so it's not possible that I spent 4+ minutes on brianbondy.com and 2+ minutes on thepioneerwoman.com.

Reproduces how often: [What percentage of the time does it reproduce?] 100% for me

Brave Version

about:brave info:
Brave | 0.19.28
rev | 08781a5
Muon | 4.4.25

Reproducible on current live release:
no

Additional Information

Reproduced by @srirambv on Windows
cc @kjozwiak

Ledger table data prior to clearing browsing history:

Ledger table data after clearing browsing history and visiting two of the above sites. They're readded and retain some of the previous data:

[srirambv]

Should ledger table be removed when browser data is cleared with payments disabled? @NejcZdovc

[NejcZdovc]

@srirambv yes this is the current workflow