Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: use storev3 instead of v2 for history queries #5123

Merged
merged 1 commit into from
Jul 30, 2024
Merged

Conversation

richard-ramos
Copy link
Member

@richard-ramos richard-ramos commented May 7, 2024

NOTE: we can't merge this until the code's been dogfooded with the fleet. The fleet does not support storev3 in its current installed version.
Also notice that even though the code is using the topic health status channel, it's usage does not follow the recommendations from #4628 . The behavior on the code is similar to the Conn Status Notification channel it had before.

Copy link

vendor/github.com/pion/webrtc/v3/yarn.lock changed. Pinging @corpetty

@status-im-auto
Copy link
Member

status-im-auto commented May 7, 2024

Jenkins Builds

Click to see older builds (75)
Commit #️⃣ Finished (UTC) Duration Platform Result
✖️ 654dd1c #1 2024-05-07 12:32:55 ~1 min tests 📄log
654dd1c #1 2024-05-07 12:33:04 ~1 min ios 📄log
654dd1c #1 2024-05-07 12:33:13 ~1 min linux 📄log
654dd1c #1 2024-05-07 12:33:14 ~1 min android 📄log
✖️ bdd1585 #2 2024-05-07 13:12:38 ~1 min tests 📄log
✔️ bdd1585 #2 2024-05-07 13:15:18 ~4 min linux 📦zip
✔️ bdd1585 #2 2024-05-07 13:15:42 ~4 min ios 📦zip
✔️ bdd1585 #2 2024-05-07 13:15:58 ~4 min android 📦aar
✖️ 208bf86 #3 2024-05-07 18:07:47 ~2 min tests 📄log
✔️ 208bf86 #3 2024-05-07 18:08:08 ~3 min ios 📦zip
✔️ 208bf86 #3 2024-05-07 18:09:03 ~4 min linux 📦zip
✔️ 208bf86 #3 2024-05-07 18:10:47 ~5 min android 📦aar
✔️ 16dee9c #4 2024-05-07 18:40:52 ~2 min android 📦aar
✔️ 16dee9c #4 2024-05-07 18:41:14 ~2 min linux 📦zip
✔️ 16dee9c #4 2024-05-07 18:42:09 ~3 min ios 📦zip
✖️ 16dee9c #4 2024-05-07 19:14:50 ~35 min tests 📄log
✖️ 68333cd #5 2024-05-13 13:10:46 ~1 min tests 📄log
✖️ 68333cd #6 2024-05-13 13:11:54 ~56 sec tests 📄log
✖️ 68333cd #7 2024-05-15 23:16:36 ~1 min tests 📄log
✔️ 68333cd #5 2024-05-13 13:13:30 ~3 min linux 📦zip
✔️ 68333cd #5 2024-05-13 13:14:04 ~4 min ios 📦zip
✔️ 68333cd #5 2024-05-13 13:14:46 ~5 min android 📦aar
✔️ 68333cd #6 2024-05-13 13:15:55 ~2 min linux 📦zip
✔️ 68333cd #6 2024-05-13 13:16:52 ~1 min android 📦aar
✔️ 68333cd #6 2024-05-13 13:17:51 ~3 min ios 📦zip
✔️ 68333cd #7 2024-05-15 23:18:31 ~3 min ios 📦zip
✔️ 68333cd #7 2024-05-15 23:19:13 ~3 min linux 📦zip
✔️ 68333cd #7 2024-05-15 23:20:03 ~4 min android 📦aar
✔️ 72ac2dc #8 2024-05-28 17:57:46 ~3 min linux 📦zip
✔️ 72ac2dc #8 2024-05-28 17:58:01 ~4 min ios 📦zip
✔️ 72ac2dc #8 2024-05-28 17:58:34 ~4 min android 📦aar
✖️ 72ac2dc #8 2024-05-28 18:31:46 ~37 min tests 📄log
✖️ 72ac2dc #9 2024-05-29 16:51:46 ~37 min tests 📄log
✖️ 4a47230 #10 2024-05-29 19:32:49 ~1 min tests 📄log
✔️ 4a47230 #9 2024-05-29 19:33:44 ~2 min android 📦aar
✔️ 4a47230 #9 2024-05-29 19:35:14 ~3 min ios 📦zip
✔️ 4a47230 #9 2024-05-29 19:35:39 ~3 min linux 📦zip
✖️ 38c06bd #11 2024-05-29 19:52:24 ~1 min tests 📄log
✔️ 38c06bd #10 2024-05-29 19:52:54 ~2 min linux 📦zip
✔️ 38c06bd #10 2024-05-29 19:55:38 ~4 min ios 📦zip
✔️ 38c06bd #10 2024-05-29 19:55:48 ~5 min android 📦aar
✔️ bf08447 #11 2024-05-29 20:05:40 ~1 min android 📦aar
✔️ bf08447 #11 2024-05-29 20:06:03 ~2 min linux 📦zip
✔️ bf08447 #11 2024-05-29 20:06:59 ~3 min ios 📦zip
✖️ 3b5443f #13 2024-05-29 20:20:26 ~1 min tests 📄log
✔️ 3b5443f #12 2024-05-29 20:21:03 ~1 min android 📦aar
✔️ 3b5443f #12 2024-05-29 20:21:28 ~2 min linux 📦zip
✔️ 3b5443f #12 2024-05-29 20:22:46 ~3 min ios 📦zip
✔️ d836289 #13 2024-05-29 20:27:59 ~1 min android 📦aar
✔️ d836289 #13 2024-05-29 20:28:30 ~2 min linux 📦zip
✔️ d836289 #13 2024-05-29 20:29:17 ~3 min ios 📦zip
✖️ d836289 #14 2024-05-29 21:02:33 ~36 min tests 📄log
✔️ b6e7ccd #14 2024-05-29 21:07:50 ~1 min android 📦aar
✔️ b6e7ccd #14 2024-05-29 21:08:13 ~2 min linux 📦zip
✔️ b6e7ccd #14 2024-05-29 21:09:38 ~3 min ios 📦zip
✔️ b6e7ccd #15 2024-05-29 21:48:52 ~42 min tests 📄log
✔️ 4146179 #15 2024-06-12 22:44:28 ~4 min linux 📦zip
✔️ 4146179 #15 2024-06-12 22:46:23 ~6 min android 📦aar
✔️ 4146179 #16 2024-06-13 00:08:44 ~3 min ios 📦zip
✔️ 4146179 #16 2024-06-12 23:21:34 ~41 min tests 📄log
✖️ ee73a19 #17 2024-07-16 17:56:15 ~2 min tests 📄log
✔️ ee73a19 #1 2024-07-16 17:56:22 ~2 min tests-rpc 📄log
✔️ ee73a19 #16 2024-07-16 17:57:49 ~3 min linux 📦zip
✔️ ee73a19 #17 2024-07-16 17:58:00 ~4 min ios 📦zip
✔️ ee73a19 #16 2024-07-16 17:59:09 ~5 min android 📦aar
✔️ 56666ec #17 2024-07-16 18:05:07 ~1 min android 📦aar
✖️ 56666ec #2 2024-07-16 18:05:16 ~1 min tests-rpc 📄log
✔️ 56666ec #17 2024-07-16 18:07:29 ~3 min linux 📦zip
✔️ 56666ec #18 2024-07-16 18:07:31 ~3 min ios 📦zip
✖️ 56666ec #18 2024-07-16 18:08:41 ~5 min tests 📄log
✔️ 22c426e #3 2024-07-22 00:49:29 ~2 min tests-rpc 📄log
✔️ 22c426e #19 2024-07-22 00:49:48 ~2 min ios 📦zip
✔️ 22c426e #18 2024-07-22 00:50:21 ~3 min linux 📦zip
✔️ 22c426e #18 2024-07-22 00:52:23 ~5 min android 📦aar
✔️ 22c426e #19 2024-07-22 01:31:38 ~44 min tests 📄log
Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ 132e537 #4 2024-07-30 14:45:34 ~2 min tests-rpc 📄log
✖️ 132e537 #20 2024-07-30 14:45:44 ~2 min tests 📄log
✔️ 132e537 #20 2024-07-30 14:46:48 ~3 min ios 📦zip
✔️ 132e537 #19 2024-07-30 14:47:04 ~3 min linux 📦zip
✔️ 132e537 #19 2024-07-30 14:48:25 ~5 min android 📦aar
✔️ 684e4e9 #20 2024-07-30 15:18:23 ~1 min android 📦aar
✔️ 684e4e9 #5 2024-07-30 15:19:03 ~2 min tests-rpc 📄log
✔️ 684e4e9 #20 2024-07-30 15:20:46 ~3 min linux 📦zip
✔️ 684e4e9 #21 2024-07-30 15:20:57 ~4 min ios 📦zip
✔️ 684e4e9 #21 2024-07-30 16:00:46 ~43 min tests 📄log

Copy link

vendor/github.com/pion/webrtc/v3/yarn.lock changed. Pinging @corpetty

2 similar comments
Copy link

vendor/github.com/pion/webrtc/v3/yarn.lock changed. Pinging @corpetty

Copy link

vendor/github.com/pion/webrtc/v3/yarn.lock changed. Pinging @corpetty

Copy link

vendor/github.com/pion/webrtc/v3/yarn.lock changed. Pinging @corpetty

@richard-ramos richard-ramos marked this pull request as ready for review May 7, 2024 13:27
Copy link

vendor/github.com/pion/webrtc/v3/yarn.lock changed. Pinging @corpetty

Copy link

vendor/github.com/pion/webrtc/v3/yarn.lock changed. Pinging @corpetty

protocol/messenger_storenode_request_test.go Outdated Show resolved Hide resolved
wakuv2/waku.go Outdated Show resolved Hide resolved
wakuv2/waku.go Show resolved Hide resolved
wakuv2/waku.go Show resolved Hide resolved
wakuv2/waku.go Outdated
@@ -126,7 +127,7 @@ type Waku struct {
storeMsgIDs map[gethcommon.Hash]bool // Map of the currently processing ids
storeMsgIDsMu sync.RWMutex

connStatusChan chan node.ConnStatus
topicHealthStatusChan chan peermanager.TopicHealthStatus
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is confusing, is this topic only relates to pubsub topic? if yes, we better make it explicit in peermanager and here.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For sure the usage of the topicHealtStatus channel needs to be improved. I only added the minimum needed code so the existing functionality is maintained since the connection status feature was removed from go-waku as it did not make sense in the context of having multiple pubsub topics.

Proper usage of this channel must be implemented, following recommendations specified in #4628

Copy link
Contributor

@kaichaosun kaichaosun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Copy link
Contributor

@chaitanyaprem chaitanyaprem left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@richard-ramos
Copy link
Member Author

TODO: must be rebased against #5150

@richard-ramos richard-ramos changed the title chore: bump go-waku and use storev3 instead of v2 for history queries chore: use storev3 instead of v2 for history queries May 13, 2024
Copy link

vendor/github.com/pion/webrtc/v3/yarn.lock changed. Pinging @corpetty

1 similar comment
Copy link

vendor/github.com/pion/webrtc/v3/yarn.lock changed. Pinging @corpetty

Copy link

vendor/github.com/pion/webrtc/v3/yarn.lock changed. Pinging @corpetty

@richard-ramos richard-ramos changed the base branch from develop to bumpgo_waku- May 13, 2024 13:10
@richard-ramos richard-ramos force-pushed the bumpgo_waku- branch 2 times, most recently from 602efe2 to 0df2111 Compare May 13, 2024 17:56
Base automatically changed from bumpgo_waku- to develop May 15, 2024 23:15
Copy link

vendor/github.com/pion/webrtc/v3/yarn.lock changed. Pinging @corpetty

@richard-ramos
Copy link
Member Author

Requires nwaku v0.29

@richard-ramos
Copy link
Member Author

Requires waku-org/nwaku#2745

@richard-ramos richard-ramos merged commit 5d309e2 into develop Jul 30, 2024
9 of 10 checks passed
@richard-ramos richard-ramos deleted the storev3 branch July 30, 2024 18:28
@igor-sirotin igor-sirotin added this to the 2.31.0 Beta milestone Aug 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants