Page History

General information

It can take several minutes to launch neural analytics algorithms on NVIDIA GPU after Server restart. At this time, the neural models are optimized for the current GPU type.

...

Starting with DetectorPack 3.9, a utility was added to the Neuro Pack add-ons (see Installing DetectorPack add-ons), which allows you to create GPU neural network caches without using Axxon One. The presence of the cache speeds up the initialization and optimizes video memory consumption.

Optimizing the operation of neural analytics on GPU

...

Creating GPU neural network caches using parameters

1. -p is a parameter to create a cache for a particular neural network.
   Command example:
   

   Code Block
   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -p "<System disk>\<Neural network location directory>\Neural_network_name.ann"

   To create a cache for multiple neural networks, list the paths to the selected neural networks, separated by a space.
   Command example:

   Code Block
   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -p "<System disk>\<Neural network location directory>\Neural_network_name.ann" "C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroSDK\WaterLevelRuleNet_origin_onnx.ann"

   
   

2. -v is a parameter to output the procedure log to the console during cache generation.
   Command example to automatically create caches of four neural networks included in the Neuro Pack add-ons with log output:
   

   Code Block
   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -v

   Command example:
   

   Code Block
   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe -p "<System disk>\<Neural network location directory>\Neural_network_name.ann" -v

   
   

3. --int8=1 is a parameter to create a quantized version of the cache for those neural networks for which quantization is available. Neural networks for which the quantization mode is available are included in the Neuro Pack add-ons together with the *.info file. By default, the the --int8=0 parameter is disabled.
   Command example:
   

   Code Block
   C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe --int8=1

   
   

The neural networks for which the quantization mode is available (

...

see Neurotracker, Stopped object detector, Neurocounter):

• GeneralNMCar_v1.0GPU_onnx.ann

...

• —Vehicles.
• GeneralNMHuman_v1.0GPU_onnx.ann

...

• —Human.
• GeneralNMHumanTopView_v0.8GPU_onnx.

...

• ann—Human (top-down view).

Starting with DetectorPack 3.11, the following neural networks were added:

• GeneralNMHumanAndVehicle_Nano_v1.0_GPU_onnx.ann

...

• —Human and vehicle (Nano).
• GeneralNMHumanAndVehicle_Medium_v1.0_GPU_onnx.ann

...

• —Human and vehicle (Medium).
• GeneralNMHumanAndVehicle_Large_v1.0_GPU_onnx.ann

...

• —Human and vehicle (Large).

Starting with DetectorPack 3.12, the following neural networks were added:

• GeneralNMHumanAndVehicle_Nano_v1.0_GPU_onnx.ann—Person (top-down view Nano).
• GeneralNMHumanAndVehicle_Medium_v1.0_GPU_onnx.ann—Person (top-down view Medium).
• GeneralNMHumanAndVehicle_Large_v1.0_GPU_onnx.ann—Person (top-down view Large).