Solution Cookbook

This solution cookbook is intended to provide the programmer with recipes, hints, and most importantly examples of programming using the Dragon distributed run-time services.

Multiprocessing with Dragon

• Running Jupyter Notebook inside of the Dragon
• Parallel Merge Sort
• Parallel Producer - Consumer Communication with Queue
• SciPy Image Convolution Benchmark
• Multi-node process orchestration and node telemetry
• Distributed inference with a Large Language Model (LLM) and node telemetry
• Creating and Using a Pipeline with Multiprocessing

Workflows with Dragon

• AI-in-the-loop Workflow
• An example Parsl @mpi_app using Dragon based executor

Dragon Native

• Calculating π using parallel Monte Carlo
• How To Use The C Channels API
• Creating and Using a Queue in Dragon Native
• An example MPI workflow using Dragon ProcessGroup
• Using Dragon policies to control placement and resources for processes

Dragon Data

• Distributed Dragon Dictionary

Dragon Telemetry (Preview)

• An example using Dragon Telemetry

Dragon AI

• PyTorch Dataset Usage with Dragon Distributed Dictionary