Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Persisting Introspection Dataflows Part 1 #13340

Merged
merged 32 commits into from
Jul 21, 2022
Merged
Show file tree
Hide file tree
Changes from 27 commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
08418e6
Add and respect sink_logs to CreateInstance
lluki Jul 7, 2022
e551941
Make coordinator use sink_logs
lluki Jul 7, 2022
5e95b40
Update src/adapter/src/catalog.rs
lluki Jul 7, 2022
2755146
Addressing small PR comments
lluki Jul 7, 2022
14ef097
Make specialize_command a method of Replica
lluki Jul 11, 2022
7da3f29
Merge remote-tracking branch 'upstream/main' into internal-sinks-poc
lluki Jul 11, 2022
90303f4
fixup log source registration
lluki Jul 11, 2022
bf3f568
add basic test for sinked logs
lluki Jul 11, 2022
4125a38
Inline reachability closures
lluki Jul 12, 2022
5dce461
Store the introspection shards for replicas
lluki Jul 14, 2022
faecc7d
Merge remote-tracking branch 'upstream/main' into internal-sinks-poc
lluki Jul 18, 2022
3187564
use .into for creating CollectionDescription
lluki Jul 18, 2022
d510399
Flush persist shard before inserting new logging data
lluki Jul 19, 2022
06b28bd
Update test to account for default cluster sinks
lluki Jul 19, 2022
6f70799
Correctly initialize read_policies
lluki Jul 19, 2022
acc1232
Correctly initialize storage policies on bootstrap
lluki Jul 19, 2022
dacdf31
add new catalog entries to testsuite
lluki Jul 19, 2022
b38d7d6
small fixes
lluki Jul 19, 2022
864aa25
use `install_desired_into_persist` for persisting logging
lluki Jul 20, 2022
127d15d
remove future-executor
lluki Jul 20, 2022
b0daeec
clippy fixes
lluki Jul 20, 2022
004f610
small fixes
lluki Jul 20, 2022
802b19d
force writer to be node 0
lluki Jul 21, 2022
9e8a9fc
persisted_logs: HashMap -> BTreeMap
lluki Jul 21, 2022
fda8c7b
merge in frank's latest update
lluki Jul 21, 2022
d42a09b
reachability: only create one common dataflow
lluki Jul 21, 2022
4783ac5
clippy fix
lluki Jul 21, 2022
3bd1452
add test that diffs to active introspection
lluki Jul 21, 2022
ca6e199
adressing nits and clippy
lluki Jul 21, 2022
29452b3
more nits
lluki Jul 21, 2022
83ad8f7
Merge remote-tracking branch 'upstream/main' into internal-sinks-poc
lluki Jul 21, 2022
5f7584d
add datum to version
lluki Jul 21, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 2 additions & 0 deletions src/adapter/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,8 @@ mz-controller = { path = "../controller" }
mz-expr = { path = "../expr" }
mz-kafka-util = { path = "../kafka-util" }
mz-ore = { path = "../ore", features = ["task", "tracing_"] }
mz-persist = { path = "../persist" }
mz-persist-client = { path = "../persist-client" }
lluki marked this conversation as resolved.
Show resolved Hide resolved
mz-persist-types = { path = "../persist-types" }
mz-pgcopy = { path = "../pgcopy" }
mz-pgrepr = { path = "../pgrepr" }
Expand Down
Loading