Repository navigation

dataset loader improvements - #737

Closed

jshook wants to merge 9 commits into

mainfrom

jshook_ashwin/ds-loader-improvements

Closed

dataset loader improvements#737
jshook wants to merge 9 commits into
mainfrom
jshook_ashwin/ds-loader-improvements

Commits on Sep 24, 2026
- Add ranged reads to RandomAccessVectorValues
  jshook
  committed
  a5edb5f
- Add a slabbed memory-mapped reader for fvecs files
  jshook
  committed
  a28c9ca
- Serve base vectors only through RandomAccessVectorValues via dataset wrappers
  jshook
  committed
  aa80f50
- Add a grain-resolution LRU cache wrapper for larger-than-memory datasets
  jshook
  committed
  f18fdcc
- Add dataset specs with profiles and symbolic wrappers
  jshook
  committed
  d2694b2
- Resolve name:profile catalog keys in the multi-file loader
  jshook
  committed
  56abc96
- Read value-shared base vectors through thread-local copies in writer suppliers
  jshook
  committed
  35d9038
- Report the active vector provider in the load harnesses
  jshook
  committed
  83c9d8d
- Never rewrite a mapped spill file in the mmap wrapper
  jshook
  committed
  01de4e5