Associated institutions:
Resource URLs:
Description:
The LONI Pipeline is a visual language programming environment for study designs and data provenance based on complex graphical workflows. The construction, validation and dissemination of study designs via the LONI Pipeline uses advanced neuroimaging protocols analyzing multi-subject and milti-dimentional data.
To provide an extensible framework for interoperability of distributed resources, the LONI Pipeline employs a decentralized infrastructure, where data, tools and services are linked via an external inter-resource mediating layer. No modifications of the existing resources are necessary for their integration with other computational counterparts. The Pipeline eXtensible Markup Language (XML) schema forms the backbone for the inter-resource mediating layer. Each XML resource description includes important information about the resource location, the proper invocation protocol (i.e., input/output types, parameter specifications, etc.), run-time controls and data-types. This XML schema also includes auxiliary metadata about the resource state, specifications, history, authorship, licensing, and bibliography. The LONI Pipeline infrastructure (http://pipeline.loni.ucla.edu) facilitates the integration of disparate resources and provides a natural and comprehensive data provenance. It also enables the broad dissemination of resource metadata descriptions via web-services and the constructive utilization of multidisciplinary expertise by experts, novice users and trainees.
Application domains:
Other resource type:
Software subtype:
Included components:
Data model subtype:
Knowledge base subtype:
Intended user type:
Citations:
Available documentation:
Screenshots:
Licensing notes:
Development milestones:
Array Job Submission
The Pipeline server now supports array job submission via JGDI plugin. Array job improves the total processing time of a workflow by combining repeated jobs into one job. Everything is transparent to the users, with individual job’s output and error logs displayed as before. The total processing time on workflows with large number of instances will be improved dramatically.
User Management
User management is supported for Pipeline server. Once enabled, user’s job slot allocation will be based on the number of free slots on submission time and percentage allowed per user. This value is dynamically calculated and updated. User will also be able to monitor their own usage by clicking the server status label on the lower right corner.
XNAT Database
Pipeline now supports XNAT database. Collections on any XNAT server can be integrated as a module with output, by providing an XNAT catalog file and your XNAT credential. The module can be connected to any input processing modules. When executing, the compute nodes will download the data, convert to desired file type and proceed into the subsequent module. For more information, please refer to user guide – XNAT.
Server Configuration Tool
Server configuration tool lets Pipeline server administrators easily configure Pipeline server’s preferences. The tool includes all the preferences required and provides brief description for each field. It has five categories, General, Grid, Access, Packages and Advanced.
MPI and Special Queue Support
Pipeline server supports MPI for SGE and a special queue with external network access enabled. With server support, user can right click on module and under Execution tab’s Advanced Options, provide MPI parameters or check the checkbox to enable external network access queue.
