Dask

Last updated Jun 22, 2022 Edit Source

See:

• AI/DS and DataEng/Xarray
• AI4ES/Pangeo

• Parallel computing with Dask
• http://jcrist.github.io/introducing-dask-searchcv.html

• #TALK Dask for ad hoc distributed computing (Pydata)
• #TALK Using Dask for Parallel Computing in Python
• #TALK Parallelizing Scientific Python with Dask | SciPy 2017 Tutorial | James Crist

• #CODE Dask
  • flexible parallel computing library for analytics
  • http://docs.dask.org/en/latest/cheatsheet.html
• #CODE Dask-Jobqueue
  • https://jobqueue.dask.org/en/latest/
  • Easily deploy Dask on job queuing systems like PBS, Slurm, MOAB, SGE, LSF, and HTCondor
  • Scalable interactive analysis workflows using dask on HPC Systems
• #code Dask-ml - Machine Learning with Dask
• #CODE Dask-geopandas
  • Parallel GeoPandas with Dask
  • Tutorial: https://github.com/martinfleis/dask-geopandas-tutorial