extern "C" EI_IMPULSE_ERROR run_classifier_continuous(
signal_t *signal,
ei_impulse_result_t *result,
bool debug = false,
bool enable_maf = true);
Brief: Run preprocessing (DSP) on new slice of raw features. Add output features to rolling matrix and run inference on full sample.
Location: edge-impulse-sdk/classifier/ei_run_classifier.h
Blocking: yes
Description:
run_classifier_continuous() accepts a new slice of features give by the callback defined in the signal parameter. It performs preprocessing (DSP) on this new slice of features and appends the output to a sliding window of pre-processed features (stored in a static features matrix). The matrix stores the new slice and as many old slices as necessary to make up one full sample for performing inference.
run_classifier_init() should be called before making any calls to run_classifier_continuous().
For example, if you are doing keyword spotting on 1-second slices of audio and you want to perform inference 4 times per second (given by EI_CLASSIFIER_SLICES_PER_MODEL_WINDOW), you would collect 0.25 seconds of audio and call run_classifier_continuous(). The function would compute the Mel-Frequency Cepstral Coefficients (MFCCs) for that 0.25 second slice of audio, drop the oldest 0.25 seconds' worth of MFCCs from its internal matrix, and append the newest slice of MFCCs. This process allows the library to keep track of the pre-processed features (e.g. MFCCs) in the window instead of the entire set of raw features (e.g. raw audio data), which can potentially save a lot of space in RAM. After updating the static matrix, inference is performed using the whole matrix, which acts as a sliding window of pre-processed features.
Additionally, a moving average filter (MAF) can be enabled for run_classifier_continuous(), which averages (arithmetic mean) the last n inference results for each class. n is EI_CLASSIFIER_SLICES_PER_MODEL_WINDOW / 2. In our example above, if we enabled the MAF, the values in result would contain predictions averaged from the previous 2 inferences.
To learn more about run_classifier_continuous(), see this guide on continuous audio sampling. While the guide is written for audio signals, the concepts of continuous sampling and inference can be extrapolated to any time-series data.
Parameters:
signal- [input] Pointer to asignal_tstruct that contains the number of elements in the slice of raw features (e.g.EI_CLASSIFIER_SLICE_SIZE) and a pointer to a callback that reads in the slice of raw features.result- [output] Pointer to anei_impulse_result_tstruct that will contain the various output results from inference afterrun_classifier()returns.debug- [input] Print internal preprocessing and inference debugging information viaei_printf().enable_maf- [input] Settrueto enable moving average filter. If MAF is enabled,result.classification[ix].valuewill contain the moving average value from the previousEI_CLASSIFIER_SLICES_PER_MODEL_WINDOW / 2windows.
Returns:
Error code as defined by EI_IMPULSE_ERROR enum. Will be EI_IMPULSE_OK if inference completed successfully.