Documentation for DetectorPack PSIM 1.0.1.

Previous page Configuring the speedup of neural analytics launch on GPU  Selecting a camera video stream for the detection modules Next page

A utility was added to neural analytics, which allows you to create GPU neural network caches without using Axxon PSIM. The presence of cache speeds up the initialization and optimizes video memory consumption.

Attention!

  • To optimize the operation of neural analytics on GPU, you must start and shut down Axxon PSIM (see Starting and shutting down the Axxon PSIM software).
  • If the system has the software running on GPU, you must stop its operation.
  • If you update neural analytics or change the model of NVIDIA GPU, you must recreate cache.

Creating GPU neural network caches:

  1. Command example:
    C:\Program Files (x86)\Axxon PSIM\Modules64\caffewrapper\NeuroAnalyticsGpuCacheGenerator.exe -g 0 -p "<System disk>\<Directory of neural network location>\Neural_network_name.ann"
    where the -g parameter determines the sequence number of a graphics card according to nvidia-smi, and the -p parameter allows you to select the required neural network to create a cache. 
    To create a cache for multiple neural networks, list the paths to the selected neural networks, separated by a space.
    Command example:
    C:\Program Files (x86)\Axxon PSIM\Modules64\caffewrapper\NeuroAnalyticsGpuCacheGenerator.exe -g 0 -p "<System disk>\<Directory of neural network location>\Neural_network_name.ann" "C:\Program Files (x86)\Axxon PSIM\Modules64\caffewrapper\Models\poseEstimator_original.ann"
  2. -v is a parameter to output the procedure log to the console during cache generation.
    Command example to automatically create caches of four neural networks included in neural analytics with log output:
    C:\Program Files (x86)\Axxon PSIM\Modules64\caffewrapper\NeuroAnalyticsGpuCacheGenerator.exe -g 0 -v
    Command example:
    C:\Program Files (x86)\Axxon PSIM\Modules64\caffewrapper\NeuroAnalyticsGpuCacheGenerator.exe -g 0 -p "<System disk>\<Directory of neural network location>\Neural_network_name.ann" -v
  3. --int8=1 is a parameter to create a quantized version of the cache for those neural networks for which quantization is available. By default, the --int8=0 parameter is disabled.
    Command example:
    C:\Program Files (x86)\Axxon PSIM\Modules64\caffewrapper\NeuroAnalyticsGpuCacheGenerator.exe -g 0 --int8=1

    Attention!

    The neural networks for which the quantization mode is available are included in neural analytics together with the *.info file.

    The neural networks for which the quantization mode is available:

    • GeneralNMCar_v1.0GPU_onnx.ann—vehicles.
    • GeneralNMHuman_v1.0GPU_onnx.ann—human.
    • GeneralNMHumanTopView_v0.8GPU_onnx.ann—human, top view.





  • No labels