HyperQueue dev

Breaking change

• In --crash-limit value 0 is no longer allowed, use --crash-limit=unlimited.

New features

• The server scheduler now slightly prioritizes tasks from older jobs and finishing partially-computed task graphs
• New values for --crash-limit:
  • never-restart - task is never restarted, even if it "crashes" on a worker that was explicitly terminated.
  • unlimited - unlimited crash limit
• hq worker info contains more information
• hq job forget tries to free more memory
• You can now configure Job name in the Python API.
• hq job progress now displays all jobs and tasks that you wait for, rather than those that were unfinished at the
  time when the command was executed.

Fixes

• Fixed a problem with journal loading when task dependencies are used
• Fixed restoring crash counters and instance ids from journal
• Fixed some corner cases of load balancing in server scheduler

Experimental

• Added direct data transfers between tasks. User API not stabilized

Artifact summary:

• hq-vdev-*: Main HyperQueue build containing the hq binary. Download this archive to
  use HyperQueue from the command line.
• hyperqueue-dev-*: Wheel containing the hyperqueue package with HyperQueue Python
  bindings.