4.3. Ngenea Worker Plugins

Warning

This feature is currently in alpha

When constructing workflows to run on Ngenea Hub, there may not be a task that covers the behaviour required for a given workflow. To alleviate this, there is now support for custom plugin tasks to be added to any instance of Ngenea Worker that can cover that missing behaviour.

These are defined as custom tasks for the celery https://docs.celeryq.dev/en/stable/ task distribution framework.

• 4.3.1. Creating your plugin
  • 4.3.1.1. Example plugin creation
  • 4.3.1.2. External Dependencies
  • 4.3.1.3. Installing custom plugins
• 4.3.2. Managing plugins
  • 4.3.2.1. Enabling your plugin
  • 4.3.2.2. Installing your plugin
  • 4.3.2.3. Uninstalling your plugin
• 4.3.3. Custom Tasks
  • 4.3.3.1. The Structure of a Task
    • 4.3.3.1.1. Arguments
    • 4.3.3.1.2. Return Payload
  • 4.3.3.2. Support for Streaming Paths from API
  • 4.3.3.3. Queues
• 4.3.4. Example Plugins
  • 4.3.4.1. Email notification task
  • 4.3.4.2. Running additional script
• 4.3.5. SubDAG Helpers