Error: “ncGraphAllocate: 2127 Not Enough Memory to Allocate Intermediate Tensors on Remote Device” When Running Inference on Intel® Neural Compute Stick 2 (Intel® NCS2)

Receiving the following error when trying to run inference on a custom model with the Intel® NCS2:

E: [nCAPI] [388407] [object_detectio] ncGraphAllocate:2127 Not enough memory to allocate intermediate tensors on remote device

• If possible, run one of OpenVINO's pretrained models to ensure that there are no memory issues.
• Try to set NUM_STREAMS option to 1 as this reduces the required memory size.

The model may be too large for the Intel® NCS2. While the internal memory of the Intel® NCS2 is about 500 MB, 100 MB of memory is set aside for intermediate processing, which is memory that is allocated for processing the current layer. For example, a model that is 181 MB exceeds the memory capacity for intermediate processing.