Page History

...

Starting with DetectorPack 3.9, a utility was added to the Neuro Pack add-ons (see Installing DetectorPack add-ons애드온 설치), which allows you to create GPU neural network caches without using Axxon One. The presence of the cache speeds up the initialization and optimizes video memory consumption.

To optimize the operation of the neural analytics on GPU, do the following:

1. Stop the Server (see Shutting down a Server 서버 종료).
   

   Note
   title Attention!
   If the system has the software running on GPU, it is necessary to stop its operation.

   
   

2. Create the GPU_CACHE_DIR system variable (see Appendix 10. Creating system variable부록 9. 시스템 변수 생성) by specifying in the Variable value field the path to the cache location with an arbitrary folder name. For example, D:\GPU_cache. The specified directory will store the cache for all used detection tools and neural networks.
   The cache size depends on the number of neural networks used and their type, the minimum size is 70 MB.
   

   Note
   title Attention!
   This function works in beta mode for all detection tools which use neuroanalytics (see General information on Neural Analytics), except Face detection. To optimize Face detection operation using the GPU_CACHE_DIR system variable, you need to perform additional actions (see Optimizing the operation of Face detection on GPU).

   
   

3. To call the utility, open in the command line: C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe and press Enter.

4. Specify the ID of the required GPU (see General Information on Configuring Detection) and press Enter.

...

• GeneralNMHuman_v1.0GPU_onnx.ann—human;
• smokeScanned_v1_onnx.ann—smoke detection;
• fireScanned_v1_onnx.ann—fire detection;
• reid_15_0_256__osnetfpn_segmentation_noise_20_common_29_onnx.ann—search for the similar in the Neural Tracker (see Image Search 이미지 검색).
  
  

...

1. -p is a parameter to create a cache for a particular neural network.
   Command example:
   

   Code Block
   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -p "<System disk>\<Neural network location directory>\Neural_network_name.ann"

   To create a cache for multiple neural networks, list the paths to the selected neural networks, separated by a space.
   Command example:

   Code Block
   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -p "<System disk>\<Neural network location directory>\Neural_network_name.ann" "C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroSDK\WaterLevelRuleNet_origin_onnx.ann"

   
   

2. -v is a parameter to output the procedure log to the console during cache generation.
   Command example to automatically create caches of four neural networks included in the Neuro Pack add-ons with log output:
   

   Code Block
   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -v

   Command example:
   

   Code Block
   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -p "<System disk>\<Neural network location directory>\Neural_network_name.ann" -v

   
   

3. --int8=1 is a parameter to create a quantized version of the cache for those neural networks for which quantization is available. By default, the --int8=0 parameter is disabled.
   Command example:
   

   Code Block
   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe --int8=1

   
   

   Note
   title Attention!
   The neural networks for which the quantization mode is available are included in the Neuro Pack add-ons together with the *.info file.

   The neural networks for which the quantization mode is available (see Setting up Scene Analytics detection tools based on Neurotracker Neurotracker 기반 장면 분석 검출 도구 설정):
   

   • GeneralNMCar_v1.0GPU_onnx.ann—vehicles.
   • GeneralNMHuman_v1.0GPU_onnx.ann—human.
   • GeneralNMHumanTopView_v0.8GPU_onnx.ann—human, top view.

...