90 average calibration

[pasq-cat]

This pull request add the following things:

• Add a method to compute the average level of calibration for both classification and regression tasks, using the method proposed by kuleshov in his paper https://arxiv.org/pdf/1807.00263
• add unit tests and docstrings for the functions implemented.
• update and expand the documentation on the website.

[pat-alt]

Just a few minor things (see individual comments)

[pat-alt]

Is this change necessary? I think the existing approach should use the latest release?

[pasq-cat]

uhm i thought i removed julia version 1.0 and left 1.10. how do i fix this? replace 1.9 with 1.10?

[pat-alt]

Actually, nvm, let's keep as is now

[pat-alt]

I think this qmd needs to be re-rendered one more time?

[pasq-cat]

yes they are not rendered yet because i am still working on them. anyway, now that we are at it, i have a question. whenever i type quarto render tutorials/etc i end up with a lot of files that they are not used. in particular i get 2 types of markdown files and other stuff that i have to delete manually. is there a way to avoid this issue?

[pat-alt]

As discussed, add this to _quarto.yml

render:
    - "!docs/src/*.md"

[pat-alt]

Are these docstrings rendering correctly in the REPL when you use help mode?

[pasq-cat]

i will check one by one later. at the moment i am working on the multi.qmd file. i am failing to make to join the plots in a 2,2 grid. I will upload as it is now , so that you can see.

[pasq-cat]

btw i was considering deleting the original functions for sampled distributions and leaving only those for normal distributions since laplaceredux only works for this kind of distr. i will submit the general ones to the guys at calibration.jl @pat-alt

[pat-alt]

Actually, nvm, let's keep as is now

[pat-alt]

As discussed, add this to _quarto.yml

render:
    - "!docs/src/*.md"

[pasq-cat]

@pat-alt i tried placing this like piece of code both here and in /docs/_metadata.yml but it doesn't work. if i run quarto render . from inside the /tutorials folder i get 44 new files.

[pat-alt]

I think this needs to be indented to fall under the project settings:

project:
  title: "{{{PKG}}}.jl"
  execute-dir: project
  render:
    - "!docs/src/*.md"

[pat-alt]

Just markdown syntax https://docs.github.com/en/get-started/writing-on-github/working-with-advanced-formatting/creating-and-highlighting-code-blocks

[pat-alt]

What do you mean by "it stops working completely"?

[pasq-cat]

nvm found the solution

[pasq-cat]

@pat-alt the documentation says that when you use the prefix ! "you need to start by specifying everything you do want to render. For example: project:
render:
- "*.qmd"
- "!ignored.qmd"
- "!ignored-dir/"

[pat-alt]

You're right, thanks!

[pasq-cat]

@pat-alt is there a way to preview the website? i would like to check if everything is okay but there doesn't seem to be a command. Seems like i am missing a step... once i render the .qmd files, how do i rerender the html part?

[pat-alt]

This is handled by Documenter.jl, simply run julia --project=docs docs/make.jl in the command line. This will render to the docs/build directory. In there, simply click on the index.html file, which will open the (local version of the) website in your browser

[pat-alt]

Let me know when you're happy for this to be merged, then I'll review one more time @pasq-cat

[pasq-cat]

Let me know when you're happy for this to be merged, then I'll review one more time @pasq-cat

try this version pls. i had to add seed to the arguments of the functions in data.jl. see if it's ok for you. before merging tag me because the guidelines says that the pull request must have a good description of the work done, so i have to edit title and description

[pat-alt]

Nice work!

Small comments mostly about typos/grammar.

One thing I noticed is the Calibration_plot function name. Can we just make this calibration_plot please? I guess that's in TaijaPlotting though