Utility for creating GPU network caches

Starting from DetectorPack 3.9, a utility was added to the Neuro Pack add-ons (see Installing DetectorPack addons), which allows you to create GPU network caches without using Axxon Next.

To create GPU network caches using the utility, do the following:

1. Stop the Server (see Shutting down a Server).
2. Create the GPU_CACHE_DIR system variable (see Configuring the acceleration of GPU-based neuroanalytics).

3. To call the utility, open in the command line: C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe and press Enter.

4. Specify the required NVIDIA GPU and press Enter.

Creation of GPU network caches using the utility is complete. The utility will create the caches of four networks included in the Neuro Pack add-ons:

• GeneralNMHuman_v1.0GPU_onnx.ann—human;
• smokeScanned_v1_onnx.ann—smoke detection;
• fireScanned_v1_onnx.ann—fire detection;
• reid_15_0_256__osnetfpn_segmentation_noise_20_common_29_onnx.ann—search for the similar in the Neural Tracker (see Image Search).
  
  

All created GPU network caches are stored in the folder specified in the GPU_CACHE_DIR system variable.

Creating GPU network caches using registry keys:

1. -p is a key to create a cache for a particular network.
   Command example:
   

   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -p "<System disk>\<Network location directory>\Network_name.ann"

   To create a cache for multiple networks, list the paths to the selected networks, separated by a space.
   Command example:

   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -p "<System disk>\<Network location directory>\Network_name.ann" "C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroSDK\WaterLevelRuleNet_origin_onnx.ann"

   
   

2. -v is a key to output the procedure log to the console during cache generation.
   Command example to automatically create caches of four networks included in the Neuro Pack add-ons with log output:
   

   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -v

   Command example:
   

   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -p "<System disk>\<Network location directory>\Network_name.ann" -v

   
   

3. --int8=1 is a key to create a quantized version of the cache for those networks for which quantization is available. By default, the --int8=0 key is disabled.
   Command example:
   

   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe --int8=1

   Attention!

   The networks for which the quantization mode is available are included in the Neuro Pack add-ons together with the *.info file.

   The networks for which the quantization mode is available:
   

   1. GeneralNMCar_v1.0GPU_onnx.ann—vehicles.
   2. GeneralNMHuman_v1.0GPU_onnx.ann—human.
   3. GeneralNMHumanTopView_v0.8GPU_onnx.ann—human, top view.