Skip to content

Lazy-mode for loading Sortinganalyzer#4623

Open
alejoe91 wants to merge 8 commits into
SpikeInterface:mainfrom
alejoe91:lazy-extensions
Open

Lazy-mode for loading Sortinganalyzer#4623
alejoe91 wants to merge 8 commits into
SpikeInterface:mainfrom
alejoe91:lazy-extensions

Conversation

@alejoe91

@alejoe91 alejoe91 commented Jun 22, 2026

Copy link
Copy Markdown
Member

The SortingAnalyzer, especially for chronic data, can be very memory hungry. This PR adds a lazy mode at load that:

  • Reads the spike vector in lazy mode (memmaps memory folder, virtual memmap for zarr - TODO)
  • Reads vector-extensions as memmaps or keeps them as zarr array
  • Implements a memmap-like ZarrSpikeVector

NOTE: in lazy mode, save/select/merge/split operations are not permitted!

@alejoe91 alejoe91 added core Changes to core module performance Performance issues/improvements labels Jun 22, 2026
Comment thread src/spikeinterface/core/sortingfolder.py
@alejoe91 alejoe91 marked this pull request as ready for review June 24, 2026 15:19
@alejoe91 alejoe91 requested a review from samuelgarcia June 24, 2026 15:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Changes to core module performance Performance issues/improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants