Skip to content

Allow newer benchmark dependencies - #1518

Merged
shravanngoswamii merged 1 commit into
mainfrom
sg/benchmark-dependency-compat
Oct 15, 2026
Merged

shravanngoswamii merged 1 commit into
mainfrom
sg/benchmark-dependency-compat

Conversation

@shravanngoswamii

Copy link
Copy Markdown
Member

Dependabot-triggered tests fail in Julia Pkg before the suite starts.

@github-actions

Copy link
Copy Markdown
Contributor

DynamicPPL.jl documentation for PR #1518 is available at:
https://TuringLang.github.io/DynamicPPL.jl/previews/PR1518/

@codecov

codecov Bot commented Oct 15, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 84.70%. Comparing base (94e4e4a) to head (21823c1).

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1518   +/-   ##
=======================================
  Coverage   84.70%   84.70%           
=======================================
  Files          52       52           
  Lines        4590     4590           
=======================================
  Hits         3888     3888           
  Misses        702      702           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks

Performance Ratio: gradient time divided by log-density time.

For very small models these ratios are noisy across runs and machines; raw primal and gradient timings are more reliable. The benchmarks are aimed at DynamicPPL developers and mainly catch obvious allocation or type-stability regressions. See benchmark notes for details.

Primal times: main 94e4e4a, PR 21823c1

===============================================================================================================
                                                    primal                            gradient                 
                                            ----------------------  -------------------------------------------
Model                        dim    linked        main          PR     FwdDiff    RvsDiff    Mooncake    Enzyme
---------------------------------------------------------------------------------------------------------------
Simple assume observe*         1     false     4.17 ns     5.26 ns        9.39    1408.00       10.18      6.11
Simple assume observe*         1      true     4.17 ns     5.25 ns        9.55    1428.45        9.62      6.49
Smorgasbord                  201     false     4.21 μs     5.38 μs       75.94     144.19        5.68      1.40
Smorgasbord                  201      true     4.98 μs     6.48 μs       72.07     171.67        5.87      1.45
Loop univariate 1k          1000     false     11.9 μs     16.8 μs      853.60     332.54        3.12      0.80
Loop univariate 1k          1000      true     14.2 μs     18.1 μs     1324.92     302.19        2.82      0.73
Multivariate 1k             1000     false    924.0 ns    968.0 ns     1612.14    1006.28        1.83      3.28
Multivariate 1k             1000      true    894.0 ns    963.0 ns     1619.78    1010.71        2.01      2.83
Loop univariate 10k        10000     false    117.0 μs    164.0 μs    24371.47     379.90        3.00      0.72
Loop univariate 10k        10000      true    136.0 μs    176.0 μs    25148.40     351.22        2.86      0.66
Multivariate 10k           10000     false     8.83 μs     9.23 μs    27050.18    1091.06        1.67      3.15
Multivariate 10k           10000      true      8.0 μs     8.88 μs    24981.78    1087.73        1.69      3.08
Dynamic                      err     false     1.05 μs     1.33 μs         err      57.53       15.62      6.15
Dynamic                       10      true     1.41 μs     1.88 μs        1.72      73.71       23.74      5.66
Submodel*                      1     false     4.18 ns     5.26 ns        9.88    1853.74       10.00      6.45
Submodel*                      1      true     4.19 ns     5.27 ns        9.30    1693.21        9.53      6.45
LDA                            6      true     3.05 μs     3.72 μs        1.45      12.76       29.97     32.31
===============================================================================================================
Environment
Julia Version 1.13.2
Commit 45b6d15e34b (2026-10-14 20:33 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
  CPU: 4 × AMD EPYC 7763 64-Core Processor
  WORD_SIZE: 64
  LLVM: libLLVM-20.1.8 (ORCJIT, znver3)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 4 virtual cores)

@shravanngoswamii
shravanngoswamii added this pull request to the merge queue Oct 15, 2026
Merged via the queue into main with commit 46b6162 Oct 15, 2026
24 checks passed
@shravanngoswamii
shravanngoswamii deleted the sg/benchmark-dependency-compat branch October 15, 2026 19:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant