7.3. Discovery Steps

This section documents all the currently supported discovery steps in Ngenea Hub. See Custom Workflows for guidance on how to use these in your own workflows.

7.3.1. dynamo.tasks.recursive_navigate - recursive - Function: discovery

Navigates down any folder tree provided using the initial paths as the base of this navigation. It will process every discovered item and can have its behaviour defined using type rules using file|link|folder or action on all items with all as its type and state.

Upon discovering non-empty directories, it will create another instance of this task to navigate down that directory while still processing the current directory. Once a batch of items has been found it will action the appropriate rule on them.

Argument	Type	Default	Description
skip_missing	bool	False	Allows the processing of any files directly provided to the discovery step regardless of it being on the filesystem.

7.3.2. dynamo.tasks.recursive_action - recursive(deprecated) - Function: discovery

Navigates down any folder tree provided to it and actions any rule defined with all as its type and state on all found files.

Argument	Type	Default	Description
skip_missing	bool	False	Allows the processing of any files directly provided to the discovery step regardless of it being on the filesystem.

7.3.3. dynamo.tasks.snapdiff - snapdiff - Function: discovery

For use only with a GPFS Independent Fileset, it will create a GPFS snapshot and it will then process the list of differences between the time of the initial run and subsequent runs. On the first run of this, it will ingest all the files within that Fileset.

Argument	Type	Default	Description
skip_old_ctimes	bool	False	Skips any files within the snapdiff difference list if the ctime of the file is older than the oldest snapshot.
condense_moves	bool	True	If a directory is moved, this will condense all the move operations into a single operation for move based tasks, otherwise it will action against every effected file.