Add How-to / Best practice around large datasets

[ClementCaporal]

Hello ! I hope you are doing well!

📚 New content request

This request stems from discussion on Zulip with @psobolewskiPhD regarding the usage of napari with large images. It is aimed at providing guidance on handling large images efficiently within napari. The scope should be defined but could cover various aspects such as file formats metadata, visualization, annotation, and known crashs.

Outline

The outline should be driven by the scope and the kind of documentation. It could be offering best practices and addressing common use cases to live in the "How-to" section of the documentation. I am not sure how to avoid to much redundancy with existing documentation.

I see it as a extension from this section https://napari.org/stable/howtos/layers/image.html#multiscale-images but for all types of layers.

I propose the following questions because it is the recent use cases I had where I was unsure about the best practices.

• Links to how to create ome.zarr file / other file format natively supported by napari without plugins. (maybe not specific to large images)
• How to optimize file format to match napari multiscale. (similar use case here: Custom multiscale level napari#6418)
• How to visualize?
  • Any difference between pure large 2D vs large 2D+slicing + large 3D for asynchronous loading.
  • Monitoring data loading (ex to check the format optimization?)
• How to annotate?
  • Select the pyramidal level wanted to add the annotation
  • Tips with shapes
  • Tips with labels (ex: change the default data-type)
  • Tips with points ? (ex: Interactively rendering ~10 million points using datashader napari#6148)
• miscellaneous operations that might crash 💥 napari and why?

Related ressources

• https://napari.org/stable/tutorials/processing/dask.html
• https://napari.org/stable/guides/rendering-explanation.html#asynchronous-rendering
• [WIP] Progressive loading for 2D and 3D data napari#5561
• Multiscale Image Rendering napari#3556
• Performant 3D rendering of larger-than-memory data for all layer types napari#5942
• Add page describing data types of labels layers and their implications #361

I hope the discussion here will help to trim/expend the outline!
Sorry for this unclear draft.