Transformation blocks
Last updated
Last updated
Transformation blocks are a flexible way to pre-process, i.e. transform, your organizational data through transformation jobs before using it within a project or to create another dataset. They can also be used standalone (not operating on organizational data) as a way to run cloud processing jobs for specific actions.
You can use transformation blocks to fetch external datasets, augment and create variants of your data samples, extract metadata from config files, create helper graphs, align and interpolate measurements across sensors, remove duplicate entries, and more.
Transformation blocks can be run individually through transformation jobs, stacked together to run in series in data pipelines, or run as a data source (standalone mode only) importing data into a project. Please refer to the respective documentation for details.
Transformation blocks operate in one of three modes: file, directory, or standalone.
Transformation blocks that have been configured with the file operating mode will only appear in the block dropdown for transformation jobs.
As the name implies, file transformation blocks operate on files. The directory specified in the input data path field for the transformation job is automatically scanned for files. Any files that are found are shown on the right hand side as the selected items.
Transformation blocks that have been configured with the directory operating mode will only appear in the block dropdown for transformation jobs.
As the name implies, directory transformation blocks operate on directories. The directory specified in the input data path field for the transformation job is automatically scanned for directories. Any directories that are found are shown on the right hand side as the selected items.
Transformation blocks that have been configured with the standalone operating mode can appear in the block dropdown for transformation jobs, for project data sources, or both depending on how the block has been set up.
As the name implies, standalone transformation blocks do not operate on any files or directories. No dataset selection fields will be shown for standalone blocks when creating a transformation job. There will be no files or directories shown on the right hand side as the selected items.
Edge Impulse has the ability to incorporate pre-built transformation blocks into the platform and make these available for all organizations to use. Pre-built transformation blocks may be added over time as recurring needs or interests emerge.
As thees blocks are added to the platform, they will be found within your organization by going to the Transformation left sidebar menu item under Custom blocks. The pre-built blocks will be listed under the Public blocks section at the bottom of the transformation blocks overview page.
Please refer to the custom transformation blocks documentation for details.
No common issues have been identified thus far. If you encounter an issue, please reach out on the forum or, if you are on the Enterprise plan, through your support channels.
