Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bifrost] Watch tail updates #1743

Merged
merged 2 commits into from
Jul 26, 2024
Merged

[Bifrost] Watch tail updates #1743

merged 2 commits into from
Jul 26, 2024

Conversation

Copy link

github-actions bot commented Jul 24, 2024

Test Results

102 files  ±0  102 suites  ±0   22m 57s ⏱️ -25s
 84 tests ±0   84 ✅ ±0  0 💤 ±0  0 ❌ ±0 
217 runs  ±0  217 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 032f7a5. ± Comparison against base commit 357c317.

♻️ This comment has been updated with latest results.

Copy link
Contributor

@tillrohrmann tillrohrmann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work @AhmedSoliman :-) LGTM. +1 for merging. My comment about pin-project is unrelated.

crates/bifrost/src/loglet/util.rs Outdated Show resolved Hide resolved
}

/// Blocks until the offset is greater or equal to the given offset.
/// Blocks until the tail is beyong the given offset.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

beyond

crates/bifrost/src/providers/local_loglet/mod.rs Outdated Show resolved Hide resolved
Comment on lines 43 to 48
#[pin]
iterator: DBRawIteratorWithThreadMode<'static, DB>,
#[pin]
release_watch: WatchStream<LogletOffset>,
tail_watch: BoxStream<'static, TailState<LogletOffset>>,
#[pin]
terminated: bool,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that these fields no longer need to be pinned. That way we could get completely rid of pin_project for this type.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll do that in a follow up PR.

@@ -179,9 +183,9 @@ struct MemoryReadStream {
/// The next offset to read from
read_pointer: LogletOffset,
#[pin]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think there is no need for the pin projections here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will do that in a follow up PR on top of the stack

Loglet wrapper now limits reads if the loglet sealed tail is known
@AhmedSoliman AhmedSoliman merged commit 032f7a5 into main Jul 26, 2024
13 checks passed
@AhmedSoliman AhmedSoliman deleted the pr1743 branch July 26, 2024 11:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants