Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The useful information on the Multisong Leaderboard #87

Open
hunterhogan opened this issue Oct 28, 2024 · 3 comments
Open

The useful information on the Multisong Leaderboard #87

hunterhogan opened this issue Oct 28, 2024 · 3 comments

Comments

@hunterhogan
Copy link
Contributor

Mail delivery failed: returning message to sender

This message was created automatically by mail delivery software.

A message that you sent could not be delivered to one or more of its
recipients. This is a permanent error. The following address(es) failed:

  [[email protected]](mailto:[email protected])
    (ultimately generated from [[email protected]](mailto:[email protected]))
    host [mxs.mail.ru](http://mxs.mail.ru/) [94.100.180.31]
    SMTP error from remote mail server after end of data:
    550 Message rejected. Protonmail is blocked

----------------------------------------------
message/delivery-status
----------------------------------------------
Reporting-MTA: dns; [mvsep.com](http://mvsep.com/)

Action: failed
Final-Recipient: [rfc822;[email protected]](mailto:rfc822;[email protected])
Status: 5.0.0
Remote-MTA: dns; [mxs.mail.ru](http://mxs.mail.ru/)
Diagnostic-Code: smtp; 550 Message rejected. Protonmail is blocked

----------------------------------------------
text/rfc822-headers
----------------------------------------------
Return-path: <[[email protected]](mailto:[email protected])>
Received: from [mail-4316.protonmail.ch](http://mail-4316.protonmail.ch/) ([185.70.43.16])
	by [mvsep.com](http://mvsep.com/) with esmtps  (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
	(Exim 4.95)
	(envelope-from <[[email protected]](mailto:[email protected])>)
	id 1t5Yyv-002xcy-6x
	for [[email protected]](mailto:[email protected]);
	Mon, 28 Oct 2024 23:17:05 +0000

Dear Bas Curtiz and MVSep,

Multisong leaderboard

Rating ID Team and Algo name Info Ensemble SDR Bass SDR Drums SDR Other SDR Vocals SDR Instrumental
1 360 Multisong dataset | Original stems | bass/drums/other joined ? - 73.4643 72.8625 70.7884 71.7201 69.3067
2 4902 Multisong dataset | Original stems | bass/drums/other joined - MP3 320kbps CBR ? - 62.6150 34.9642 42.0354 37.7338 37.8225
3 4901 Multisong dataset | Original stems | bass/drums/other joined - MP3 128kbps CBR ? - 25.7775 19.7684 21.4349 20.0551 21.3164

I propose that you move this useful information from the Multisong Leaderboard to the Quality Checker page or to another place appropriate for reference information.

Some thoughts to consider:

  • The information is on a leaderboard of algorithm performance, but the information is not about algorithm performance.
  • It can be interpreted to mean that one, two, or three algorithms are very ahead of every other algorithm.
  • Alternatively, it can be interpreted to mean that one or more people have an unfair advantage.
  • Furthermore, it can be interpreted to mean that one or more people with an unfair advantage are willing to use their unfair advantage to guarantee they possess the highest ranks on the leaderboard.
  • Additionally, it can be interpreted to mean that the administrators of the leaderboard will allow people to abuse the system just so they can have the highest ranks on the leaderboard.
  • The information is extremely useful, but because it is presented as algorithm entries on the leaderboard, it is difficult to interpret the information and to learn from the information.
@bascurtiz
Copy link

You are aware you can hover over the question-mark icon to see more details, what this entry is right?
image

@hunterhogan
Copy link
Contributor Author

hunterhogan commented Oct 29, 2024 via email

@bascurtiz
Copy link

Yeah, maybe @ZFTurbo can put them in a static table outside the lists itself on the https://mvsep.com/en/quality_checker page ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants