Page History

...

It can take several minutes to launch neural analytics algorithms on NVIDIA GPU after Server server restart. At this time, the neural models are optimized for the current GPU type.

...

Starting with DetectorPack 3.9, a utility was added to the Neuro Pack add-ons (see see Installing DetectorPack add-ons), which allows you to create GPU neural network caches without using Axxon One. The presence of the cache speeds up the initialization and optimizes video memory consumption.

...

To optimize the operation of the neural analytics on GPU, do the following:

1. Stop the Server server (see Shutting down a Server Stopping the server).
   

   Note
   title Attention!
   If the system has the software running on GPU, it is necessary to stop its operation.

2. Create the GPU_CACHE_DIR system variable (see Appendix 9. Creating system variable) by specifying in the Variable value field field the path to the cache location with an arbitrary folder name. For example, D:\GPU_cache. The specified directory will store the cache for all used detection tools detectors and neural networks.
   The cache size depends on the number of neural networks used and their type. The minimum size is 70 MB.
   

3. Run the command prompt as administrator.

4. To call the utility, in the command prompt, enter C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroPackGpuCacheGenerator.exe.

5. Press Enter.

6. Specify the ID of the required GPU Nvidia GPU (see Selecting Nvidia GPU when configuring detection toolsdetectors).
7. Press Enter.

Optimizing the operation of the neural analytics on GPU is complete. The utility will create the caches of four neural networks included in the Neuro Pack add-ons:

• GeneralNMHuman_v1.0GPU_onnx.ann—human;
• smokeScanned_v1_onnx.ann (or bestSmoke_v1.ann starting with Detector Pack 3.14)—smoke detection;
• fireScanned_v1_onnx.ann (or bestFire_v1.ann starting with Detector Pack 3.14) —fire detection;
• reid_15_0_256__osnetfpn_segmentation_noise_20_common_29_onnx.ann—search for the similar in the neurotracker Neural tracker (see Image Similitude search).
  

...

The neural networks for which the quantization mode is available (see Neurotrackersee Neural tracker, Stopped object detector,  Neurocounter Neural counter):

• GeneralNMCar_v1.0GPU_onnx.ann—Vehicle.
• GeneralNMHuman_v1.0GPU_onnx.ann—Person.
• GeneralNMHumanTopView_v0.8GPU_onnx.ann—Person (top-down view).

...

Starting with DetectorPack 3.12, the following neural networks were added:

• GeneralNMHumanTopView_Nano_v1.0_GPU_onnx.ann—Person (top-down view Nano).
• GeneralNMHumanTopView_Medium_v1.0_GPU_onnx.ann—Person (top-down view Medium).
• GeneralNMHumanTopView_Large_v1.0_GPU_onnx.ann—Person (top-down view Large).