-
Notifications
You must be signed in to change notification settings - Fork 53
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Docs for daemons #346
base: main
Are you sure you want to change the base?
Docs for daemons #346
Conversation
300d24b
to
910beb0
Compare
827df06
to
2810abd
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Changes applied
|
||
## How is a replica declared bad? | ||
- An operator can declare a replica as bad issuing rucio cli commands. These bad replicas are taken by the necromancer daemon and then deleted if they cannot be recovered from other RSEs. | ||
- the suspicios-replica-recoverer is a daemon that will analyze different counters (transfer errors, download errors, etc ...) to mark replicas as being suspicious to have an issue. After hitting |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- the suspicios-replica-recoverer is a daemon that will analyze different counters (transfer errors, download errors, etc ...) to mark replicas as being suspicious to have an issue. After hitting | |
- The suspicious-replica-recoverer is a daemon that will analyze different counters (transfer errors, download errors, etc ...) to mark replicas as being suspicious to have an issue. After hitting |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Still misspelled
|
||
## Daemons | ||
|
||
Name | Domain| Purpose | Details |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this will be the last nit-pick. Is it is possible to set the links in Details
up with the a relative path? Using this method will redirect the user to a different site to look at the executable page if they are looking at the gh docs mirror.
a certain limit (configurable), the replica is marked as bad and eventually consumed by the necromancer. | ||
|
||
## What is the purpose of undertaker? | ||
A dataset is "never" deleted, however, when the dataset is known to be bad, there is no point having it in the catalog. The undertaker daemon takes care to remove these datasets. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A dataset is "never" deleted, however, when the dataset is known to be bad, there is no point having it in the catalog. The undertaker daemon takes care to remove these datasets. | |
A dataset is never "deleted", however, when the dataset is known to be bad, there is no point having it in the catalog. The undertaker daemon takes care to remove these datasets. |
"deleted" is the specific term that isn't actually done
Sometimes, replicas can become unhealthy. A dump is created by the dumper daemon. The auditor checks these dumps and declares replicas. | ||
|
||
## How is a replica declared bad? | ||
- An operator can declare a replica as bad issuing rucio cli commands. These bad replicas are taken by the necromancer daemon and then deleted if they cannot be recovered from other RSEs. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you add an example code block? It's useful for operators so they don't have to go diving into document.
|
||
### How is data deleted? | ||
When replicas are healthy, the judge-cleaner will set a tombstone on replicas where the lifetime has expired. These replicas are taken by the reaper and they are deleted. | ||
Sometimes, replicas can become unhealthy. A dump is created by the dumper daemon. The auditor checks these dumps and declares replicas. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you define "unhealthy"? It's a vague term here. I took a stab at it
Sometimes, replicas can become unhealthy. A dump is created by the dumper daemon. The auditor checks these dumps and declares replicas. | |
Sometimes, replicas can become unhealthy (either through corrupted data or incomplete transfers). A dump is created by the dumper daemon. The auditor checks these dumps and declares replicas. |
@@ -27,6 +27,7 @@ and more can be found by browsing through the sub-sections of this topic. | |||
- [What is Rucio](started/what_is_rucio.md) | |||
- [Main Components](started/main_components.md) | |||
- [Additional Layers and Resources](started/additional_layers_and_resources.md) | |||
- [Rucio daemons/processes](started/daemons.md) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- [Rucio daemons/processes](started/daemons.md) | |
- [About Rucio Daemons](started/daemons.md) |
Thank you so much for dealing with this long review and making so many changes 🙏 |
Fixes #296