This topic includes some examples of using file watchers.
Suppose you want to create a set of datasets based on Excel and TSV files, and load data into those datasets. To set this up, do the following:
Consider a set of data with original filenames matching a format like this: "sample_<timestamp>_<study_id>.xml", for example:
sample_2017-09-06_study20.xml
An example filePattern regular expression that would capture such filenames would be:
sample_(.+)_(?<study>.+).xml
If the specified pattern matches a file placed in the watched location, then the specified move and/or execute steps will be performed on that file. Nothing will happen to files in the watched location which do not match the pattern.
If the regular expression contains named capturing groups, such as the "(?<study>.+)" portion in the example above, then the corresponding value (in this example "study20" can be substituted into other property expressions. For instance, a move setting of:
/studies/${study}/@pipeline/import/${now:date}
/studies/study20/@pipeline/import/2017-11-07 (or similar)
The Parameter Function is a JavaScript function which is executed during the move. In the example below, the username is selected programmatically:
var userName = sourcePath.getNameCount() > 0 ? sourcePath.getName(0) : null;
var ret = {'pipeline, username': userName }; ret;
previousnext |
expand allcollapse all |