Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Attempt to fix replication issue #436

Closed
wants to merge 1 commit into from
Closed

Attempt to fix replication issue #436

wants to merge 1 commit into from

Conversation

SamuelBrand1
Copy link
Collaborator

This PR tries to fix the issue #435 by reverting pathfinder bump (which also reverts Turing). I find this very sub-optimal and would prefer to merge a different solution.

@github-actions GitHub Actions
Copy link
Contributor

Try this Pull Request!

Open Julia and type:

import Pkg
Pkg.activate(temp=true)
Pkg.add(url="https://github.com/CDCgov/Rt-without-renewal", rev="fix-replication-note", subdir="EpiAware")
using EpiAware

@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 88.67%. Comparing base (5a72eb5) to head (500bda1).
Report is 1 commits behind head on main.

Additional details and impacted files 
@@           Coverage Diff           @@
##             main     #436   +/-   ##
=======================================
  Coverage   88.67%   88.67%           
=======================================
  Files          56       56           
  Lines         715      715           
=======================================
  Hits          634      634           
  Misses         81       81

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@seabbs
Copy link
Collaborator

seabbs commented Aug 20, 2024

Do we know what the cause of this was now? is it the Turing update (as we saw it both with and without pathfinder)? If so do we have any ideas for what to do about this?

@github-actions GitHub Actions
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewal

Job Properties

  • Time of benchmarks:
    • Target: 20 Aug 2024 - 17:16
    • Baseline: 20 Aug 2024 - 17:40
  • Package commits:
    • Target: 29ecc1
    • Baseline: 9b271d
  • Julia commits:
    • Target: 48d4fd
    • Baseline: 48d4fd
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 0.92 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "DiffLatentModel", "evaluation", "linked"] 0.86 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.38 (5%) ❌ 1.00 (1%)
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 0.73 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "linked"] 0.88 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 0.92 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 0.91 (5%) ✅ 1.00 (1%)
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 0.95 (5%) ✅ 1.00 (1%)
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 0.79 (5%) ✅ 1.00 (1%)
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 0.95 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["EpiAwareUtils"]
  • ["EpiInfModels", "DirectInfections", "evaluation"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiInfModels", "ExpGrowthRate", "evaluation"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "AR", "evaluation"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "evaluation"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "CombineLatentModels", "evaluation"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "ConcatLatentModels", "evaluation"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "DiffLatentModel", "evaluation"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "HierarchicalNormal", "evaluation"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "Intercept", "evaluation"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "PrefixLatentModel", "evaluation"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RandomWalk", "evaluation"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "evaluation"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "TransformLatentModel", "evaluation"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "evaluation"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_weekly", "evaluation"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "Ascertainment", "evaluation"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "LatentDelay", "evaluation"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "NegativeBinomialError", "evaluation"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PoissonError", "evaluation"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PrefixObservationModel", "evaluation"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "StackObservationModels", "evaluation"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "evaluation"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]

Julia versioninfo

Target

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3242 MHz       6690 s          0 s        604 s      11771 s          0 s
       #2  3240 MHz       6275 s          0 s        670 s      12125 s          0 s
       #3  2592 MHz       5392 s          0 s        566 s      13094 s          0 s
       #4  3087 MHz       5207 s          0 s        482 s      13378 s          0 s
  Memory: 15.606491088867188 GB (13215.0546875 MB free)
  Uptime: 1911.86 sec
  Load Avg:  1.0  1.01  1.05
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz      10787 s          0 s       1030 s      21496 s          0 s
       #2  3311 MHz       8907 s          0 s       1021 s      23388 s          0 s
       #3  2445 MHz       8834 s          0 s        930 s      23536 s          0 s
       #4  2445 MHz       8343 s          0 s        834 s      24138 s          0 s
  Memory: 15.606491088867188 GB (13178.53125 MB free)
  Uptime: 3339.21 sec
  Load Avg:  1.08  1.04  1.01
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewal

Job Properties

  • Time of benchmark: 20 Aug 2024 - 17:16
  • Package commit: 29ecc1
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["EpiAwareUtils", "censored_pmf"] 1.089 μs (5%) 352 bytes (1%) 4
["EpiInfModels", "DirectInfections", "evaluation", "linked"] 303.584 ns (5%) 432 bytes (1%) 7
["EpiInfModels", "DirectInfections", "evaluation", "standard"] 307.476 ns (5%) 432 bytes (1%) 7
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 441.682 ns (5%) 784 bytes (1%) 13
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 441.271 ns (5%) 784 bytes (1%) 13
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 9.317 μs (5%) 5.62 KiB (1%) 115
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 9.357 μs (5%) 5.62 KiB (1%) 115
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 553.492 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 547.920 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "ExpGrowthRate", "evaluation", "linked"] 211.834 ns (5%) 256 bytes (1%) 4
["EpiInfModels", "ExpGrowthRate", "evaluation", "standard"] 212.046 ns (5%) 256 bytes (1%) 4
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 304.829 ns (5%) 512 bytes (1%) 9
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 304.569 ns (5%) 512 bytes (1%) 9
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 9.127 μs (5%) 5.64 KiB (1%) 114
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 9.277 μs (5%) 5.64 KiB (1%) 114
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 554.187 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 561.366 ns (5%) 272 bytes (1%) 6
["EpiLatentModels", "AR", "evaluation", "linked"] 1.971 μs (5%) 3.84 KiB (1%) 45
["EpiLatentModels", "AR", "evaluation", "standard"] 1.615 μs (5%) 2.80 KiB (1%) 38
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.360 μs (5%) 11.69 KiB (1%) 55
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.942 μs (5%) 10.12 KiB (1%) 46
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 108.682 μs (5%) 55.31 KiB (1%) 1113
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 69.439 μs (5%) 40.64 KiB (1%) 818
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 17.593 μs (5%) 8.44 KiB (1%) 225
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 15.930 μs (5%) 7.31 KiB (1%) 207
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "linked"] 1.562 μs (5%) 3.05 KiB (1%) 34
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "standard"] 1.300 μs (5%) 2.17 KiB (1%) 30
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.099 μs (5%) 5.16 KiB (1%) 41
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.729 μs (5%) 4.28 KiB (1%) 37
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 46.277 μs (5%) 24.41 KiB (1%) 447
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 29.064 μs (5%) 16.86 KiB (1%) 333
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 3.011 μs (5%) 1.00 KiB (1%) 27
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.728 μs (5%) 1.00 KiB (1%) 27
["EpiLatentModels", "CombineLatentModels", "evaluation", "linked"] 61.815 μs (5%) 52.27 KiB (1%) 580
["EpiLatentModels", "CombineLatentModels", "evaluation", "standard"] 57.958 μs (5%) 37.69 KiB (1%) 536
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 127.056 μs (5%) 119.19 KiB (1%) 1184
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 120.575 μs (5%) 89.31 KiB (1%) 1092
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 196.486 μs (5%) 107.81 KiB (1%) 1710
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 150.421 μs (5%) 79.61 KiB (1%) 1378
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 18.094 μs (5%) 8.58 KiB (1%) 226
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 16.471 μs (5%) 7.45 KiB (1%) 208
["EpiLatentModels", "ConcatLatentModels", "evaluation", "linked"] 11.392 μs (5%) 30.39 KiB (1%) 214
["EpiLatentModels", "ConcatLatentModels", "evaluation", "standard"] 9.087 μs (5%) 21.95 KiB (1%) 184
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 12.373 μs (5%) 34.09 KiB (1%) 224
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 10.340 μs (5%) 25.66 KiB (1%) 194
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 75.120 μs (5%) 56.38 KiB (1%) 719
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 53.810 μs (5%) 42.72 KiB (1%) 580
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.233 μs (5%) 2.19 KiB (1%) 52
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.962 μs (5%) 2.19 KiB (1%) 52
["EpiLatentModels", "DiffLatentModel", "evaluation", "linked"] 1.674 μs (5%) 4.17 KiB (1%) 37
["EpiLatentModels", "DiffLatentModel", "evaluation", "standard"] 1.360 μs (5%) 2.48 KiB (1%) 31
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.077 μs (5%) 12.62 KiB (1%) 45
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.713 μs (5%) 10.94 KiB (1%) 39
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 60.573 μs (5%) 38.81 KiB (1%) 748
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 44.072 μs (5%) 31.91 KiB (1%) 633
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 7.008 μs (5%) 2.22 KiB (1%) 51
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.542 μs (5%) 2.22 KiB (1%) 51
["EpiLatentModels", "HierarchicalNormal", "evaluation", "linked"] 428.739 ns (5%) 1.00 KiB (1%) 8
["EpiLatentModels", "HierarchicalNormal", "evaluation", "standard"] 368.340 ns (5%) 864 bytes (1%) 7
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.385 μs (5%) 5.28 KiB (1%) 14
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 849.083 ns (5%) 5.12 KiB (1%) 13
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 41.777 μs (5%) 19.83 KiB (1%) 376
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 26.529 μs (5%) 14.45 KiB (1%) 266
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.238 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.062 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "Intercept", "evaluation", "linked"] 245.959 ns (5%) 336 bytes (1%) 5
["EpiLatentModels", "Intercept", "evaluation", "standard"] 247.127 ns (5%) 336 bytes (1%) 5
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 349.171 ns (5%) 640 bytes (1%) 10
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 348.770 ns (5%) 640 bytes (1%) 10
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 4.332 μs (5%) 3.53 KiB (1%) 76
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 4.318 μs (5%) 3.53 KiB (1%) 76
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 466.503 ns (5%) 240 bytes (1%) 3
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 460.147 ns (5%) 240 bytes (1%) 3
["EpiLatentModels", "PrefixLatentModel", "evaluation", "linked"] 1.873 μs (5%) 3.47 KiB (1%) 30
["EpiLatentModels", "PrefixLatentModel", "evaluation", "standard"] 1.693 μs (5%) 3.00 KiB (1%) 27
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.528 μs (5%) 7.75 KiB (1%) 36
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.292 μs (5%) 7.28 KiB (1%) 33
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 45.474 μs (5%) 22.16 KiB (1%) 397
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 29.405 μs (5%) 16.47 KiB (1%) 285
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.235 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.055 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "RandomWalk", "evaluation", "linked"] 908.452 ns (5%) 1.86 KiB (1%) 18
["EpiLatentModels", "RandomWalk", "evaluation", "standard"] 762.418 ns (5%) 1.42 KiB (1%) 16
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.867 μs (5%) 8.73 KiB (1%) 25
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.720 μs (5%) 8.30 KiB (1%) 23
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 48.090 μs (5%) 26.19 KiB (1%) 487
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 30.747 μs (5%) 20.53 KiB (1%) 376
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 3.606 μs (5%) 1.31 KiB (1%) 27
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 3.380 μs (5%) 1.31 KiB (1%) 27
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "linked"] 590.311 ns (5%) 1.19 KiB (1%) 12
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "standard"] 490.448 ns (5%) 896 bytes (1%) 10
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 809.527 ns (5%) 1.72 KiB (1%) 18
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 678.122 ns (5%) 1.41 KiB (1%) 16
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 41.968 μs (5%) 19.08 KiB (1%) 380
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 26.269 μs (5%) 13.55 KiB (1%) 269
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.152 μs (5%) 400 bytes (1%) 11
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 983.286 ns (5%) 400 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "evaluation", "linked"] 311.494 ns (5%) 384 bytes (1%) 6
["EpiLatentModels", "TransformLatentModel", "evaluation", "standard"] 312.869 ns (5%) 384 bytes (1%) 6
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 404.955 ns (5%) 704 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 409.360 ns (5%) 704 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 4.663 μs (5%) 3.84 KiB (1%) 81
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 4.606 μs (5%) 3.84 KiB (1%) 81
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 534.804 ns (5%) 192 bytes (1%) 3
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 536.873 ns (5%) 192 bytes (1%) 3
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "linked"] 1.981 μs (5%) 4.16 KiB (1%) 44
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "standard"] 1.671 μs (5%) 2.84 KiB (1%) 38
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.694 μs (5%) 10.00 KiB (1%) 51
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.458 μs (5%) 8.69 KiB (1%) 45
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 60.442 μs (5%) 35.58 KiB (1%) 689
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 41.097 μs (5%) 29.05 KiB (1%) 574
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.044 μs (5%) 1.22 KiB (1%) 27
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.905 μs (5%) 1.22 KiB (1%) 27
["EpiLatentModels", "broadcast_weekly", "evaluation", "linked"] 2.201 μs (5%) 4.52 KiB (1%) 47
["EpiLatentModels", "broadcast_weekly", "evaluation", "standard"] 1.698 μs (5%) 2.62 KiB (1%) 37
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.899 μs (5%) 7.69 KiB (1%) 57
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.279 μs (5%) 5.53 KiB (1%) 45
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 86.491 μs (5%) 41.95 KiB (1%) 771
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 47.068 μs (5%) 28.44 KiB (1%) 513
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.368 μs (5%) 1.81 KiB (1%) 49
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.683 μs (5%) 1.69 KiB (1%) 47
["EpiObsModels", "Ascertainment", "evaluation", "linked"] 3.325 μs (5%) 3.42 KiB (1%) 49
["EpiObsModels", "Ascertainment", "evaluation", "standard"] 3.277 μs (5%) 3.42 KiB (1%) 49
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 4.229 μs (5%) 3.77 KiB (1%) 56
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 4.151 μs (5%) 3.77 KiB (1%) 56
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 50.915 μs (5%) 39.05 KiB (1%) 905
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 35.215 μs (5%) 33.83 KiB (1%) 796
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.787 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.629 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "LatentDelay", "evaluation", "linked"] 16.671 μs (5%) 22.14 KiB (1%) 206
["EpiObsModels", "LatentDelay", "evaluation", "standard"] 16.660 μs (5%) 22.14 KiB (1%) 206
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 21.791 μs (5%) 22.36 KiB (1%) 211
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 21.560 μs (5%) 22.36 KiB (1%) 211
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 304.066 μs (5%) 293.61 KiB (1%) 6804
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 280.542 μs (5%) 288.39 KiB (1%) 6695
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 50.955 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 50.965 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "NegativeBinomialError", "evaluation", "linked"] 1.145 μs (5%) 336 bytes (1%) 5
["EpiObsModels", "NegativeBinomialError", "evaluation", "standard"] 1.124 μs (5%) 336 bytes (1%) 5
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.861 μs (5%) 560 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.710 μs (5%) 560 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 46.947 μs (5%) 36.33 KiB (1%) 899
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 32.230 μs (5%) 31.11 KiB (1%) 790
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.906 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.522 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "PoissonError", "evaluation", "linked"] 1.538 μs (5%) 1.80 KiB (1%) 22
["EpiObsModels", "PoissonError", "evaluation", "standard"] 1.216 μs (5%) 1.38 KiB (1%) 18
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.187 μs (5%) 7.75 KiB (1%) 31
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.718 μs (5%) 4.52 KiB (1%) 25
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 140.331 μs (5%) 91.00 KiB (1%) 1913
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 24.546 μs (5%) 29.25 KiB (1%) 712
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 7.271 μs (5%) 176 bytes (1%) 2
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.242 μs (5%) 176 bytes (1%) 2
["EpiObsModels", "PrefixObservationModel", "evaluation", "linked"] 1.680 μs (5%) 1.44 KiB (1%) 26
["EpiObsModels", "PrefixObservationModel", "evaluation", "standard"] 1.646 μs (5%) 1.44 KiB (1%) 26
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.867 μs (5%) 1.66 KiB (1%) 31
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.817 μs (5%) 1.66 KiB (1%) 31
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 22.722 μs (5%) 12.91 KiB (1%) 283
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 8.646 μs (5%) 7.69 KiB (1%) 174
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.335 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.029 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "StackObservationModels", "evaluation", "linked"] 7.013 μs (5%) 5.48 KiB (1%) 93
["EpiObsModels", "StackObservationModels", "evaluation", "standard"] 7.021 μs (5%) 5.48 KiB (1%) 93
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 8.005 μs (5%) 5.83 KiB (1%) 100
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 7.915 μs (5%) 5.83 KiB (1%) 100
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 61.004 μs (5%) 49.23 KiB (1%) 1020
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 42.279 μs (5%) 44.02 KiB (1%) 911
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.326 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.101 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "linked"] 4.427 μs (5%) 8.88 KiB (1%) 75
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "standard"] 4.059 μs (5%) 7.62 KiB (1%) 67
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 5.594 μs (5%) 15.88 KiB (1%) 83
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 5.260 μs (5%) 14.62 KiB (1%) 75
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 81.992 μs (5%) 60.41 KiB (1%) 1139
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 64.961 μs (5%) 53.94 KiB (1%) 1022
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.731 μs (5%) 544 bytes (1%) 11
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.492 μs (5%) 544 bytes (1%) 11
["EpiObsModels", "observation_error", "missing obs", "evaluation", "linked"] 1.582 μs (5%) 2.97 KiB (1%) 31
["EpiObsModels", "observation_error", "missing obs", "evaluation", "standard"] 1.052 μs (5%) 1.41 KiB (1%) 21
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.319 μs (5%) 4.03 KiB (1%) 38
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.599 μs (5%) 2.47 KiB (1%) 28
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 29.855 μs (5%) 24.73 KiB (1%) 490
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 13.856 μs (5%) 17.28 KiB (1%) 352
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.422 μs (5%) 144 bytes (1%) 2
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.053 μs (5%) 144 bytes (1%) 2
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "linked"] 446.793 ns (5%) 288 bytes (1%) 5
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "standard"] 413.320 ns (5%) 288 bytes (1%) 5
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 578.672 ns (5%) 512 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 527.372 ns (5%) 512 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 24.024 μs (5%) 18.72 KiB (1%) 414
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 10.430 μs (5%) 12.83 KiB (1%) 286
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.979 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.677 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "linked"] 1.825 μs (5%) 2.05 KiB (1%) 27
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "standard"] 1.683 μs (5%) 1.73 KiB (1%) 25
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.695 μs (5%) 2.22 KiB (1%) 26
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.528 μs (5%) 1.91 KiB (1%) 24
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 39.444 μs (5%) 23.89 KiB (1%) 499
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 22.833 μs (5%) 17.69 KiB (1%) 369
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.310 μs (5%) 112 bytes (1%) 2
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.059 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["EpiAwareUtils"]
  • ["EpiInfModels", "DirectInfections", "evaluation"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiInfModels", "ExpGrowthRate", "evaluation"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "AR", "evaluation"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "evaluation"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "CombineLatentModels", "evaluation"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "ConcatLatentModels", "evaluation"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "DiffLatentModel", "evaluation"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "HierarchicalNormal", "evaluation"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "Intercept", "evaluation"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "PrefixLatentModel", "evaluation"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RandomWalk", "evaluation"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "evaluation"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "TransformLatentModel", "evaluation"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "evaluation"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_weekly", "evaluation"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "Ascertainment", "evaluation"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "LatentDelay", "evaluation"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "NegativeBinomialError", "evaluation"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PoissonError", "evaluation"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PrefixObservationModel", "evaluation"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "StackObservationModels", "evaluation"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "evaluation"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3242 MHz       6690 s          0 s        604 s      11771 s          0 s
       #2  3240 MHz       6275 s          0 s        670 s      12125 s          0 s
       #3  2592 MHz       5392 s          0 s        566 s      13094 s          0 s
       #4  3087 MHz       5207 s          0 s        482 s      13378 s          0 s
  Memory: 15.606491088867188 GB (13215.0546875 MB free)
  Uptime: 1911.86 sec
  Load Avg:  1.0  1.01  1.05
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewal

Job Properties

  • Time of benchmark: 20 Aug 2024 - 17:40
  • Package commit: 9b271d
  • Julia commit: 48d4fd
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["EpiAwareUtils", "censored_pmf"] 1.091 μs (5%) 352 bytes (1%) 4
["EpiInfModels", "DirectInfections", "evaluation", "linked"] 302.428 ns (5%) 432 bytes (1%) 7
["EpiInfModels", "DirectInfections", "evaluation", "standard"] 307.000 ns (5%) 432 bytes (1%) 7
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 440.618 ns (5%) 784 bytes (1%) 13
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 447.668 ns (5%) 784 bytes (1%) 13
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 9.477 μs (5%) 5.62 KiB (1%) 115
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 9.508 μs (5%) 5.62 KiB (1%) 115
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 547.670 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 562.995 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "ExpGrowthRate", "evaluation", "linked"] 214.325 ns (5%) 256 bytes (1%) 4
["EpiInfModels", "ExpGrowthRate", "evaluation", "standard"] 213.639 ns (5%) 256 bytes (1%) 4
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 307.951 ns (5%) 512 bytes (1%) 9
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 308.297 ns (5%) 512 bytes (1%) 9
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 9.307 μs (5%) 5.64 KiB (1%) 114
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 9.448 μs (5%) 5.64 KiB (1%) 114
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 557.668 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 562.562 ns (5%) 272 bytes (1%) 6
["EpiLatentModels", "AR", "evaluation", "linked"] 2.030 μs (5%) 3.84 KiB (1%) 45
["EpiLatentModels", "AR", "evaluation", "standard"] 1.635 μs (5%) 2.80 KiB (1%) 38
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.466 μs (5%) 11.69 KiB (1%) 55
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 3.003 μs (5%) 10.12 KiB (1%) 46
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 106.328 μs (5%) 55.31 KiB (1%) 1113
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 69.278 μs (5%) 40.64 KiB (1%) 818
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 17.402 μs (5%) 8.44 KiB (1%) 225
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 15.789 μs (5%) 7.31 KiB (1%) 207
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "linked"] 1.548 μs (5%) 3.05 KiB (1%) 34
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "standard"] 1.292 μs (5%) 2.17 KiB (1%) 30
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.037 μs (5%) 5.16 KiB (1%) 41
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.699 μs (5%) 4.28 KiB (1%) 37
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 46.927 μs (5%) 24.41 KiB (1%) 447
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 28.624 μs (5%) 16.86 KiB (1%) 333
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.939 μs (5%) 1.00 KiB (1%) 27
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.723 μs (5%) 1.00 KiB (1%) 27
["EpiLatentModels", "CombineLatentModels", "evaluation", "linked"] 64.751 μs (5%) 52.27 KiB (1%) 580
["EpiLatentModels", "CombineLatentModels", "evaluation", "standard"] 58.158 μs (5%) 37.69 KiB (1%) 536
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 129.351 μs (5%) 119.19 KiB (1%) 1184
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 121.507 μs (5%) 89.31 KiB (1%) 1092
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 193.300 μs (5%) 107.81 KiB (1%) 1710
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 147.755 μs (5%) 79.61 KiB (1%) 1378
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 17.643 μs (5%) 8.58 KiB (1%) 226
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 16.280 μs (5%) 7.45 KiB (1%) 208
["EpiLatentModels", "ConcatLatentModels", "evaluation", "linked"] 11.691 μs (5%) 30.39 KiB (1%) 214
["EpiLatentModels", "ConcatLatentModels", "evaluation", "standard"] 8.967 μs (5%) 21.95 KiB (1%) 184
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 13.445 μs (5%) 34.09 KiB (1%) 224
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 10.289 μs (5%) 25.66 KiB (1%) 194
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 77.394 μs (5%) 56.38 KiB (1%) 719
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 54.381 μs (5%) 42.72 KiB (1%) 580
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.135 μs (5%) 2.19 KiB (1%) 52
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.898 μs (5%) 2.19 KiB (1%) 52
["EpiLatentModels", "DiffLatentModel", "evaluation", "linked"] 1.954 μs (5%) 4.17 KiB (1%) 37
["EpiLatentModels", "DiffLatentModel", "evaluation", "standard"] 1.414 μs (5%) 2.48 KiB (1%) 31
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.063 μs (5%) 12.62 KiB (1%) 45
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.688 μs (5%) 10.94 KiB (1%) 39
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 60.502 μs (5%) 38.81 KiB (1%) 748
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 43.180 μs (5%) 31.91 KiB (1%) 633
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 7.047 μs (5%) 2.22 KiB (1%) 51
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.694 μs (5%) 2.22 KiB (1%) 51
["EpiLatentModels", "HierarchicalNormal", "evaluation", "linked"] 424.663 ns (5%) 1.00 KiB (1%) 8
["EpiLatentModels", "HierarchicalNormal", "evaluation", "standard"] 359.498 ns (5%) 864 bytes (1%) 7
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.006 μs (5%) 5.28 KiB (1%) 14
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 874.692 ns (5%) 5.12 KiB (1%) 13
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 41.849 μs (5%) 19.83 KiB (1%) 376
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 27.301 μs (5%) 14.45 KiB (1%) 266
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.255 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.088 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "Intercept", "evaluation", "linked"] 254.512 ns (5%) 336 bytes (1%) 5
["EpiLatentModels", "Intercept", "evaluation", "standard"] 252.444 ns (5%) 336 bytes (1%) 5
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 354.653 ns (5%) 640 bytes (1%) 10
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 356.514 ns (5%) 640 bytes (1%) 10
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 4.295 μs (5%) 3.53 KiB (1%) 76
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 4.302 μs (5%) 3.53 KiB (1%) 76
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 468.628 ns (5%) 240 bytes (1%) 3
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 453.330 ns (5%) 240 bytes (1%) 3
["EpiLatentModels", "PrefixLatentModel", "evaluation", "linked"] 1.877 μs (5%) 3.47 KiB (1%) 30
["EpiLatentModels", "PrefixLatentModel", "evaluation", "standard"] 1.700 μs (5%) 3.00 KiB (1%) 27
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.455 μs (5%) 7.75 KiB (1%) 36
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.320 μs (5%) 7.28 KiB (1%) 33
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 45.965 μs (5%) 22.16 KiB (1%) 397
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 30.887 μs (5%) 16.47 KiB (1%) 285
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.230 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.054 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "RandomWalk", "evaluation", "linked"] 906.516 ns (5%) 1.86 KiB (1%) 18
["EpiLatentModels", "RandomWalk", "evaluation", "standard"] 786.034 ns (5%) 1.42 KiB (1%) 16
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.825 μs (5%) 8.73 KiB (1%) 25
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.704 μs (5%) 8.30 KiB (1%) 23
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 47.388 μs (5%) 26.19 KiB (1%) 487
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 30.417 μs (5%) 20.53 KiB (1%) 376
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 3.623 μs (5%) 1.31 KiB (1%) 27
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 3.371 μs (5%) 1.31 KiB (1%) 27
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "linked"] 579.940 ns (5%) 1.19 KiB (1%) 12
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "standard"] 472.558 ns (5%) 896 bytes (1%) 10
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 801.073 ns (5%) 1.72 KiB (1%) 18
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 668.301 ns (5%) 1.41 KiB (1%) 16
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 43.020 μs (5%) 19.08 KiB (1%) 380
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 27.331 μs (5%) 13.55 KiB (1%) 269
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.152 μs (5%) 400 bytes (1%) 11
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 969.684 ns (5%) 400 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "evaluation", "linked"] 303.598 ns (5%) 384 bytes (1%) 6
["EpiLatentModels", "TransformLatentModel", "evaluation", "standard"] 307.213 ns (5%) 384 bytes (1%) 6
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 402.050 ns (5%) 704 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 413.270 ns (5%) 704 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 4.616 μs (5%) 3.84 KiB (1%) 81
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 4.633 μs (5%) 3.84 KiB (1%) 81
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 529.089 ns (5%) 192 bytes (1%) 3
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 531.674 ns (5%) 192 bytes (1%) 3
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "linked"] 2.250 μs (5%) 4.16 KiB (1%) 44
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "standard"] 1.670 μs (5%) 2.84 KiB (1%) 38
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.914 μs (5%) 10.00 KiB (1%) 51
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.435 μs (5%) 8.69 KiB (1%) 45
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 59.401 μs (5%) 35.58 KiB (1%) 689
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 40.787 μs (5%) 29.05 KiB (1%) 574
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.033 μs (5%) 1.22 KiB (1%) 27
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.812 μs (5%) 1.22 KiB (1%) 27
["EpiLatentModels", "broadcast_weekly", "evaluation", "linked"] 2.206 μs (5%) 4.52 KiB (1%) 47
["EpiLatentModels", "broadcast_weekly", "evaluation", "standard"] 1.676 μs (5%) 2.62 KiB (1%) 37
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.909 μs (5%) 7.69 KiB (1%) 57
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.506 μs (5%) 5.53 KiB (1%) 45
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 84.608 μs (5%) 41.95 KiB (1%) 771
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 48.190 μs (5%) 28.44 KiB (1%) 513
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.357 μs (5%) 1.81 KiB (1%) 49
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.679 μs (5%) 1.69 KiB (1%) 47
["EpiObsModels", "Ascertainment", "evaluation", "linked"] 3.375 μs (5%) 3.42 KiB (1%) 49
["EpiObsModels", "Ascertainment", "evaluation", "standard"] 3.340 μs (5%) 3.42 KiB (1%) 49
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 4.205 μs (5%) 3.77 KiB (1%) 56
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 4.194 μs (5%) 3.77 KiB (1%) 56
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 51.646 μs (5%) 39.05 KiB (1%) 905
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 35.346 μs (5%) 33.83 KiB (1%) 796
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.841 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.702 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "LatentDelay", "evaluation", "linked"] 16.802 μs (5%) 22.14 KiB (1%) 206
["EpiObsModels", "LatentDelay", "evaluation", "standard"] 16.701 μs (5%) 22.14 KiB (1%) 206
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 22.411 μs (5%) 22.36 KiB (1%) 211
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 21.510 μs (5%) 22.36 KiB (1%) 211
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 308.565 μs (5%) 293.61 KiB (1%) 6804
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 278.639 μs (5%) 288.39 KiB (1%) 6695
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 53.059 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 53.750 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "NegativeBinomialError", "evaluation", "linked"] 1.148 μs (5%) 336 bytes (1%) 5
["EpiObsModels", "NegativeBinomialError", "evaluation", "standard"] 1.130 μs (5%) 336 bytes (1%) 5
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.828 μs (5%) 560 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.704 μs (5%) 560 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 47.459 μs (5%) 36.33 KiB (1%) 899
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 32.962 μs (5%) 31.11 KiB (1%) 790
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.924 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.639 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "PoissonError", "evaluation", "linked"] 1.564 μs (5%) 1.80 KiB (1%) 22
["EpiObsModels", "PoissonError", "evaluation", "standard"] 1.231 μs (5%) 1.38 KiB (1%) 18
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.287 μs (5%) 7.75 KiB (1%) 31
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.757 μs (5%) 4.52 KiB (1%) 25
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 140.682 μs (5%) 91.00 KiB (1%) 1913
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 24.907 μs (5%) 29.25 KiB (1%) 712
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 7.429 μs (5%) 176 bytes (1%) 2
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.285 μs (5%) 176 bytes (1%) 2
["EpiObsModels", "PrefixObservationModel", "evaluation", "linked"] 1.702 μs (5%) 1.44 KiB (1%) 26
["EpiObsModels", "PrefixObservationModel", "evaluation", "standard"] 1.665 μs (5%) 1.44 KiB (1%) 26
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.901 μs (5%) 1.66 KiB (1%) 31
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.854 μs (5%) 1.66 KiB (1%) 31
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 23.203 μs (5%) 12.91 KiB (1%) 283
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 8.736 μs (5%) 7.69 KiB (1%) 174
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.337 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.061 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "StackObservationModels", "evaluation", "linked"] 7.148 μs (5%) 5.48 KiB (1%) 93
["EpiObsModels", "StackObservationModels", "evaluation", "standard"] 7.123 μs (5%) 5.48 KiB (1%) 93
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 7.985 μs (5%) 5.83 KiB (1%) 100
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 7.915 μs (5%) 5.83 KiB (1%) 100
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 60.723 μs (5%) 49.23 KiB (1%) 1020
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 42.278 μs (5%) 44.02 KiB (1%) 911
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.426 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.316 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "linked"] 4.520 μs (5%) 8.88 KiB (1%) 75
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "standard"] 4.125 μs (5%) 7.62 KiB (1%) 67
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 7.117 μs (5%) 15.88 KiB (1%) 83
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 5.547 μs (5%) 14.62 KiB (1%) 75
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 82.353 μs (5%) 60.41 KiB (1%) 1139
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 65.692 μs (5%) 53.94 KiB (1%) 1022
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.751 μs (5%) 544 bytes (1%) 11
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.679 μs (5%) 544 bytes (1%) 11
["EpiObsModels", "observation_error", "missing obs", "evaluation", "linked"] 1.559 μs (5%) 2.97 KiB (1%) 31
["EpiObsModels", "observation_error", "missing obs", "evaluation", "standard"] 1.040 μs (5%) 1.41 KiB (1%) 21
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.245 μs (5%) 4.03 KiB (1%) 38
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.592 μs (5%) 2.47 KiB (1%) 28
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 29.425 μs (5%) 24.73 KiB (1%) 490
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 13.576 μs (5%) 17.28 KiB (1%) 352
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.348 μs (5%) 144 bytes (1%) 2
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.032 μs (5%) 144 bytes (1%) 2
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "linked"] 443.399 ns (5%) 288 bytes (1%) 5
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "standard"] 412.070 ns (5%) 288 bytes (1%) 5
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 574.984 ns (5%) 512 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 524.696 ns (5%) 512 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 24.155 μs (5%) 18.72 KiB (1%) 414
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 10.530 μs (5%) 12.83 KiB (1%) 286
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.954 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.658 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "linked"] 1.837 μs (5%) 2.05 KiB (1%) 27
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "standard"] 1.686 μs (5%) 1.73 KiB (1%) 25
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.697 μs (5%) 2.22 KiB (1%) 26
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.513 μs (5%) 1.91 KiB (1%) 24
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 39.955 μs (5%) 23.89 KiB (1%) 499
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 22.913 μs (5%) 17.69 KiB (1%) 369
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.282 μs (5%) 112 bytes (1%) 2
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.161 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["EpiAwareUtils"]
  • ["EpiInfModels", "DirectInfections", "evaluation"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiInfModels", "ExpGrowthRate", "evaluation"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "AR", "evaluation"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "evaluation"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "CombineLatentModels", "evaluation"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "ConcatLatentModels", "evaluation"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "DiffLatentModel", "evaluation"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "HierarchicalNormal", "evaluation"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "Intercept", "evaluation"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "PrefixLatentModel", "evaluation"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RandomWalk", "evaluation"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "evaluation"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "TransformLatentModel", "evaluation"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "evaluation"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_weekly", "evaluation"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "Ascertainment", "evaluation"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "LatentDelay", "evaluation"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "NegativeBinomialError", "evaluation"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PoissonError", "evaluation"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PrefixObservationModel", "evaluation"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "StackObservationModels", "evaluation"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "evaluation"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]

Julia versioninfo

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3243 MHz      10787 s          0 s       1030 s      21496 s          0 s
       #2  3311 MHz       8907 s          0 s       1021 s      23388 s          0 s
       #3  2445 MHz       8834 s          0 s        930 s      23536 s          0 s
       #4  2445 MHz       8343 s          0 s        834 s      24138 s          0 s
  Memory: 15.606491088867188 GB (13178.53125 MB free)
  Uptime: 3339.21 sec
  Load Avg:  1.08  1.04  1.01
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.86
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@SamuelBrand1
Copy link
Collaborator Author

Do we know what the cause of this was now? is it the Turing update (as we saw it both with and without pathfinder)? If so do we have any ideas for what to do about this?

I'm afraid not... reversing the Pathfinder update 0.8 -> 0.9 seems to have fixed the wild error we saw. However, I don't really see what the problem was. I'd prefer to use the more update version and isolate the error.

@SamuelBrand1 SamuelBrand1 mentioned this pull request Aug 28, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@seabbs seabbs Awaiting requested review from seabbs

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@SamuelBrand1 @codecov-commenter @seabbs