routing: inbound fees send support #6934

joostjager · 2022-09-21T09:54:43Z

Implements send support for inbound routing fees. The receiver side is implemented in #6703 and this PR is based off of that.

Implementation details

The channel_update extra opaque data isn't validated before it was stored in the database. This means that everywhere we read this data, a tlv error might be encountered. In this PR, this case is handled in a mostly defensive way, skipping over the channel policy.

Based on #6703. Review first commits there.

Support for inbound fees in BuildRoute is explored in #7060.

joostjager · 2022-10-19T21:09:10Z

Removed exit hop inbound fees. Previous code saved in master...bottlepay:lnd:inbound-fees-send-support-exit-hop

joostjager · 2022-11-22T08:08:39Z

routing/pathfind.go

+		signedFee := inboundFee + outboundFee
+		fee := lnwire.MilliSatoshi(0)
+		if signedFee > 0 {
+			fee = lnwire.MilliSatoshi(signedFee)


@halseth you expressed concerns about negative fees being able to cancel out probability penalties for unreliable nodes. I've addressed the issue here by always rounding the fee that is used for the edge weight up to zero.

Perhaps this check must be removed now that the node total fee is guarded against negative. Otherwise pathfinding may return suboptimal routes?

I am actually quite sure of this. Suppose a node has an in fee of -100000 and an out fee of 100000. Those cancel out perfectly and shouldn't lead to pathfinding that is any different from a zero fee?

But... we still need to do this because dijkstra can't handle negative weights 🤷

It is a possibility though to floor at zero the actual edge weight calculated below rather than the fee.

I am actually quite sure of this. Suppose a node has an in fee of -100000 and an out fee of 100000. Those cancel out perfectly and shouldn't lead to pathfinding that is any different from a zero fee?

Do you mean that those fees are on a single channel or on a node with incoming and outgoing channels?

I mean on a node with incoming and outgoing channels. The fee paid to that particular node would be 0, so you'd expect it to be treated no different from a node that actually charges zero fee.

This could still be a problem, looking into that. edit: left a main comment #6934 (review)

joostjager · 2024-01-24T09:56:08Z

I am in favour of the non-optimal cutoff solution for now. I think it is sufficiently good to gather feedback on the inbound fees concept, and - as you say - we can revisit node pair search at a later stage. I've archived the relevant commit on a different branch https://github.com/joostjager/lnd/tree/inbound-fees-node-pair-search.

coderabbitai · 2024-01-24T09:58:16Z

Important

Auto Review Skipped

Auto reviews are limited to the following labels: llm-review. Please add one of these labels to enable auto reviews.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository.

To trigger a single review, invoke the @coderabbitai review command.

Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

Share

Tips

Chat

There are 3 ways to chat with CodeRabbit:

Review comments: Directly reply to a review comment made by CodeRabbit. Example:
- I pushed a fix in commit <commit_id>.
- Generate unit testing code for this file.
- Open a follow-up GitHub issue for this discussion.
Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
- @coderabbitai generate unit testing code for this file.
- @coderabbitai modularize this function.
PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
- @coderabbitai generate interesting stats about this repository and render them as a table.
- @coderabbitai show all the console.log statements in this repository.
- @coderabbitai read src/utils.ts and generate unit testing code.
- @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (invoked as PR comments)

@coderabbitai pause to pause the reviews on a PR.
@coderabbitai resume to resume the paused reviews.
@coderabbitai review to trigger a review. This is useful when automatic reviews are disabled for the repository.
@coderabbitai resolve resolve all the CodeRabbit review comments.
@coderabbitai help to get help.

Additionally, you can add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.

CodeRabbit Configration File (`.coderabbit.yaml`)

You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
The JSON schema for the configuration file is available here.
If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/coderabbit-overrides.v2.json

CodeRabbit Discord Community

Join our Discord Community to get help, request features, and share feedback.

bitromortac

LGTM 🎉 (tested pathfinding in a small network as well).

joostjager · 2024-01-30T15:17:08Z

Rebased

lightninglabs-deploy · 2024-03-26T20:05:07Z

@joostjager, remember to re-request review from reviewers when ready

Roasbeef

LGTM 🪞

Considering if we should actually also have a hard reject on the RPC level if users try to set a positive inbound fee. In the future we could lift it given sufficient uptake within the core routing network. We can also add more telemetry using the HTLC interceptor (I think we're missing the field there actually?), which'll allow node operators to log the % of incoming payments that are able to observe their negative inbound fees.

Roasbeef · 2024-03-29T23:55:03Z

routing/pathfind.go

+
+			fee = int64(outboundFee) + inboundFee
+			if fee < 0 {
+				fee = 0


Perhaps we should log these occurrences on the Tracef log level?

I am not sure. The zero-floor has now become a feature of inbound fees both on the receiver and sender side. Nodes might use that and it doesn't necessary indicate a configuration mistake - if that was the reason you had in mind for logging?

Roasbeef · 2024-03-30T00:05:51Z

Needs rebase + conflicts addressed.

Preparation so that we can have the inbound fee available in addition to the outgoing policy.

Add sender-side support for inbound fees in pathfinding and route building.

twofaktor · 2024-03-31T21:14:19Z

Will be possible to set the default inbound fees on lnd.conf the same as the existing outbound fees? I can't see any modifications related to this new feature and merged PR in the sample-lnd.conf available on the repo, and any related with this: https://github.com/lightningnetwork/lnd/blob/master/sample-lnd.conf#L626-L633

Roasbeef · 2024-04-01T23:05:57Z

@twofaktor that makes a lot of sense, I've made a tracking issue for your request here: #8610. Thanks!

joostjager mentioned this pull request Sep 21, 2022

htlcswitch: add inbound routing fees receive support #6703

Merged

joostjager force-pushed the inbound-fees-send-support branch 3 times, most recently from f121e4b to 7beb44a Compare September 29, 2022 07:25

joostjager added the routing label Oct 3, 2022

joostjager force-pushed the inbound-fees-send-support branch 7 times, most recently from 859464c to f940c83 Compare October 17, 2022 07:46

joostjager force-pushed the inbound-fees-send-support branch from f940c83 to 73e5422 Compare October 19, 2022 16:51

joostjager mentioned this pull request Oct 19, 2022

router: inbound fees support for BuildRoute #7060

Closed

joostjager force-pushed the inbound-fees-send-support branch from 73e5422 to 99ed58f Compare October 19, 2022 16:56

joostjager added the path finding label Oct 19, 2022

joostjager force-pushed the inbound-fees-send-support branch 3 times, most recently from cbcde71 to cdac2e4 Compare October 19, 2022 20:08

joostjager force-pushed the inbound-fees-send-support branch from cdac2e4 to 5c4d210 Compare October 20, 2022 06:01

joostjager mentioned this pull request Oct 20, 2022

Ability to set inbound and outbound fees lightning/bolts#835

Open

joostjager force-pushed the inbound-fees-send-support branch 3 times, most recently from fc549fa to f9894dc Compare October 25, 2022 10:58

saubyk added the inbound fee Changes related to inbound routing fee label Nov 9, 2022

saubyk added this to the v0.17.0 milestone Nov 9, 2022

joostjager force-pushed the inbound-fees-send-support branch from f9894dc to 3fc276e Compare November 22, 2022 08:07

joostjager commented Nov 22, 2022

View reviewed changes

joostjager force-pushed the inbound-fees-send-support branch from 3fc276e to e662c77 Compare January 25, 2023 13:45

joostjager force-pushed the inbound-fees-send-support branch from 54c4988 to 2fb0965 Compare January 24, 2024 09:57

joostjager force-pushed the inbound-fees-send-support branch 3 times, most recently from 96903da to ca5dd90 Compare January 24, 2024 11:27

joostjager requested a review from bitromortac January 24, 2024 11:29

bitromortac approved these changes Jan 30, 2024

View reviewed changes

joostjager force-pushed the inbound-fees-send-support branch from ca5dd90 to 6370bc1 Compare January 30, 2024 15:16

Roasbeef approved these changes Mar 29, 2024

View reviewed changes

Roasbeef enabled auto-merge March 30, 2024 00:05

ziggie1984 mentioned this pull request Mar 31, 2024

Support Inbound Fees when LND 18 is released. rkfg/regolancer#63

Open

joostjager force-pushed the inbound-fees-send-support branch 2 times, most recently from dbdd97c to 49478a6 Compare March 31, 2024 15:17

feelancer21 mentioned this pull request Mar 31, 2024

Support for negative inbound fees after release of lnd 0.18 feelancer21/feelancer#5

Closed

joostjager added 4 commits March 31, 2024 18:12

routing: track unifiedPolicyEdge

e0a0804

Preparation so that we can have the inbound fee available in addition to the outgoing policy.

routing/test: test local unified edge

9d4251c

channeldb/test: refactor TestGraphCacheForEachNodeChannel

d97e7d3

routing: add inbound fee support to pathfinding

0bae781

Add sender-side support for inbound fees in pathfinding and route building.

joostjager force-pushed the inbound-fees-send-support branch from 49478a6 to 0bae781 Compare March 31, 2024 16:12

Roasbeef merged commit 5599b3c into lightningnetwork:master Mar 31, 2024
26 of 27 checks passed

Roasbeef mentioned this pull request Apr 1, 2024

lnd+config: add config options for inbound fee discount #8610

Open

feelancer21 mentioned this pull request Apr 2, 2024

Support for negative inbound fees after release of lnd 0.18 accumulator/charge-lnd#107

Closed

feelancer21 mentioned this pull request Jul 28, 2024

[feature]: Proposal for a different cutoff between InboundFee and OutboundFee in pathfinding #8945

Open

bitromortac mentioned this pull request Jul 29, 2024

[bug]: SendPaymentV2 does not respect fee limit setting in relation to inbound discounts #8940

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

routing: inbound fees send support #6934

routing: inbound fees send support #6934

joostjager commented Sep 21, 2022 •

edited

Loading

joostjager commented Oct 19, 2022

joostjager Nov 22, 2022

halseth Nov 23, 2022

joostjager Nov 21, 2023

joostjager Nov 22, 2023

joostjager Nov 22, 2023 •

edited

Loading

bitromortac Nov 22, 2023 •

edited

Loading

joostjager Nov 22, 2023

bitromortac Dec 6, 2023 •

edited

Loading

joostjager commented Jan 24, 2024

coderabbitai bot commented Jan 24, 2024 •

edited

Loading

Auto Review Skipped

Chat

CodeRabbit Commands (invoked as PR comments)

CodeRabbit Configration File (`.coderabbit.yaml`)

CodeRabbit Discord Community

bitromortac left a comment

joostjager commented Jan 30, 2024

lightninglabs-deploy commented Mar 26, 2024

Roasbeef left a comment

Roasbeef Mar 29, 2024

joostjager Mar 31, 2024

Roasbeef commented Mar 30, 2024

twofaktor commented Mar 31, 2024 •

edited

Loading

Roasbeef commented Apr 1, 2024

routing: inbound fees send support #6934

routing: inbound fees send support #6934

Conversation

joostjager commented Sep 21, 2022 • edited Loading

Implementation details

joostjager commented Oct 19, 2022

joostjager Nov 22, 2022

Choose a reason for hiding this comment

halseth Nov 23, 2022

Choose a reason for hiding this comment

joostjager Nov 21, 2023

Choose a reason for hiding this comment

joostjager Nov 22, 2023

Choose a reason for hiding this comment

joostjager Nov 22, 2023 • edited Loading

Choose a reason for hiding this comment

bitromortac Nov 22, 2023 • edited Loading

Choose a reason for hiding this comment

joostjager Nov 22, 2023

Choose a reason for hiding this comment

bitromortac Dec 6, 2023 • edited Loading

Choose a reason for hiding this comment

joostjager commented Jan 24, 2024

coderabbitai bot commented Jan 24, 2024 • edited Loading

Auto Review Skipped

Chat

CodeRabbit Commands (invoked as PR comments)

CodeRabbit Configration File (.coderabbit.yaml)

CodeRabbit Discord Community

bitromortac left a comment

Choose a reason for hiding this comment

joostjager commented Jan 30, 2024

lightninglabs-deploy commented Mar 26, 2024

Roasbeef left a comment

Choose a reason for hiding this comment

Roasbeef Mar 29, 2024

Choose a reason for hiding this comment

joostjager Mar 31, 2024

Choose a reason for hiding this comment

Roasbeef commented Mar 30, 2024

twofaktor commented Mar 31, 2024 • edited Loading

Roasbeef commented Apr 1, 2024

joostjager commented Sep 21, 2022 •

edited

Loading

joostjager Nov 22, 2023 •

edited

Loading

bitromortac Nov 22, 2023 •

edited

Loading

bitromortac Dec 6, 2023 •

edited

Loading

coderabbitai bot commented Jan 24, 2024 •

edited

Loading

CodeRabbit Configration File (`.coderabbit.yaml`)

twofaktor commented Mar 31, 2024 •

edited

Loading