Skip to content

Add codspeed benchmarks - #10

Draft
AntoinePrv wants to merge 7 commits into
xtensor-stack:mainfrom
AntoinePrv:benchmark
Draft

AntoinePrv wants to merge 7 commits into
xtensor-stack:mainfrom
AntoinePrv:benchmark

Conversation

@AntoinePrv

Copy link
Copy Markdown
Contributor

No description provided.

@AntoinePrv
AntoinePrv force-pushed the benchmark branch 2 times, most recently from 1389741 to f7c89dc Compare September 29, 2026 15:40
@AntoinePrv AntoinePrv changed the title Add codspeed benchmar run Add codspeed benchmarks Sep 29, 2026
@codspeed

codspeed Bot commented Sep 30, 2026 •

Copy link
Copy Markdown

Congrats! CodSpeed is installed 🎉

🆕 732 new benchmarks were detected.

You will start to see performance impacts in the reports once the benchmarks are run from your default branch.

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Detected benchmarks


ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Open in CodSpeed

@AntoinePrv

Copy link
Copy Markdown
Contributor Author

I don't know if codespeed is the right tool for the job at this point.

  • I'm afraid the simulation mode may be too limited to model throughput, intruction-level-parallelism, dependency chains, branch predictions, and lack of support for advanced instructions (AVX512). These are all things we are trying to get right here.
  • With the walltime setting, I am not sure we gain much since we are not using their runners
  • We do not need the profiling since we focus on a single flat, fully inlined functions.
  • The benchmarks plotting is what I would be interested but is lacking: compare multiple runs (e.g. map-scalar vs map-naive), and plot as a function of input size.

@AntoinePrv
AntoinePrv marked this pull request as draft October 1, 2026 08:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant