Datasets

Adding Data to a Pipeline

The file tree system in a pipeline is similar to a capsule’s file tree. You can add data to your pipeline by uploading it or attaching a data asset.

It is best practice to use data assets to ensure that the data doesn’t contribute to the size of the pipeline. This also allows the same data asset to be easily attached to multiple pipelines and capsules. For more information see creating data assets.

Once your data is in the file tree system, you can drag and drop it into the pipeline building area and connect it to a capsule.

Connecting a dataset to a capsule allows the capsule to read the dataset from its data folder. The capsule won’t read the data without dropping the dataset into the pipeline building area and connecting it to a capsule.

Removing Data from a Pipeline

To remove a dataset from the pipeline building area you can hover over it and click the garbage can.