Page History

...

Install the utility

The GPU Cache Generatorcache generator utility is used to pre-create a cache of neural networks that are used in the operation of detectors.

...

1. Download the utility file from the AxxonSoft official website.
2. Run the downloaded file as system administrator.
3. In the setup window that opens, click the Next button.
   
   
4. Click the Install button.
   
   
5. Confirm installation as administrator.
6. Wait for the installation process to complete.
   Image Removed
   After installation, a new window opens with a message about the completion of the utility installation.
Click the Finish button to confirm completion of the installation.
InfotitleNote
7.  
   Image Added
   
8. By default, the utility window opens after installation is complete. If you don’t want to launch the utility after installation is complete, clear the Launch the GPU cache generator checkbox.
9. If you want to view the documentation for the GPU cache generator utility, set the Open the user's guide checkbox.
Image Removed

The utility installation is complete.

Utility interface

...

1. By default, the checkbox is clear.
2. Click the Finish button to confirm completion of the installation.
   

The installation of the GPU cache generator utility is complete.

Cache generation

To generate a cache:

1. Stop the server (see Stop the server).
2. Run the GPU cache generator utility from the Start menu → Programs → GPU cache generator. When you launch the utility, a window opens

...

1. with the following warning: Attention. Please stop VMS server and other services that use GPU resources. This is

...

1. critical to ensuring maximum efficiency of the cache generation process. If you don’t stop the

...

1. server and

...

1. services, the utility can continue to work, but

...

1. the caching result can be less effective, and the process is slower due to competition for GPU resources.

Image Removed

...

1. To confirm stopping all applications using the GPU, click the Yes, I have closed all applications that use GPU button.

...

1. Set the Image Added checkboxes next to the detectors/neural models for which you want to create a cache. The utility window is divided into two areas:

...

1. • Detectors—list of available detectors.

...

1. • Neural models—list of neural networks for which you can generate a cache.
     

Image Removed

...

1. • 
     Elements in these areas are interconnected: when you select a

...

1. • detector on the left, all neural networks associated with

...

1. • it are

...

1. • displayed on the right

...

1. • , and vice versa.
     The table

...

1. • lists the

...

1. • detectors and neural networks associated with them:
     

     Detector	Neural models
     Barcode

...

1. • detector	GeneralNM barcodes
     Equipment detector

...

1. • 	Ppe helmet (head) general Ppe safety vest (body) general Ppe segmentation by pose origin
     Fire detector	Best fire v1 (Normal mode) Fire scanned v1 (Scanning mode)
     Meta-detector	Blip img only Blip text only

...

1. • Neural counter or Stopped object detector

     GeneralNM car v1.0 GeneralNM human v1.0 GeneralNM human and vehicle large v1.0 GeneralNM human and vehicle medium v1.0 GeneralNM human and vehicle nano v1.0 GeneralNM human top view large v1.0 GeneralNM human top view medium v1.0 GeneralNM human top view nano v1.0 GeneralNM human top view v0.8

...

1. • Neural tracker

     GeneralNM car v1.0 GeneralNM human v1.0 GeneralNM human and vehicle large v1.0 GeneralNM human and vehicle medium v1.0 GeneralNM human and vehicle nano v1.0 GeneralNM human top view large v1.0 GeneralNM human top view medium v1.0 GeneralNM human top view nano v1.0 GeneralNM human top view v0.8 Dpe 1638 light pa 100 k (

...

1. • Attributes recognition) Reid 15 0 256 osnetfpn segmentation noise 20 common 29 (Similitude search)

...

1. • Human pose detector	General human pose estimation General human pose estimation yolov8 large General human pose estimation yolov8 medium General human pose estimation yolov8 nano
     Person-based privacy masking

...

1. • 	General human pose estimation
     Privacy masking

...

1. • 	Privacy masking origin
     Smoke detector	Best smoke v1 (Normal mode) Smoke scanned v1 (Scanning mode)
     Water level detector	Water level rule net origin
     Custom neural networks

...

1. • When you

...

1. • use a

...

1. • custom neural network, you must specify the path to the file in *.ann or *.annext format, provided that

...

1. • this neural network can be run on

...

1. • the GPU

...

1. • Note title Attention! A trained neural network for a particular scene allows you to detect only objects of a certain type (for example, a person, a cyclist, a motorcyclist, and so on). To train your neural network, contact AxxonSoft (see Data collection requirements for neural network training). If you use a standard neural network (training wasn't performed in operating conditions), we guarantee an overall accuracy of 80-95% and a percentage of false positives of 5-20% (see Data collection requirements for neural network training). You cannot specify the network file in Windows OS. You must place the neural network file locally, that is, on the same server where you install Axxon One. For correct neural network operation on Linux OS, place the corresponding file locally in the /opt/AxxonSoft/DetectorPack/NeuroSDK directory or in the network folder with the corresponding access permissions. When you run the GPU cache generator utility again, the file of the custom neural network isn't displayed in the Neural models list.

2. Click the Image Added

Generating a cache

To generate a cache:

1. In the right part of the main window of the utility, set the checkboxes next to the neural networks for which you want to create a cache.

Click the Image Removed
2. button in the lower right part of the window
to go to
3. .
4. Configure the cache generation
settings.In the window that opens, set the checkbox next to the video card for which the cache is created.
5. parameters specified in the table.
   

   Parameter	Value	Description
   Graphics processors for performing operations
   NVIDIA <model> (see List of Nvidia GPUs)	Image Added	Note title Attention! Cache generation is only supported for NVIDIA graphics cards, as TensorRT technology

doesn’t

6. doesn't support other graphics cards.

Configure the parameters of cache generation specified in the table:
ParameterValueDescription

7. Set the checkbox next to the video card for which the cache is created
   	Image Added
   Additional parameters
   Enable int8 calibration

Image Removed

8. Image Added

   Note title Attention! This parameter is available only for neural networks

with a corresponding *.info file.

9. for which the quantization mode is available and which are included in the neural analytics package along with the *.info file of the same name: GeneralNM car v1.0, GeneralNM human v1.0, GeneralNM human and vehicle large v1.0, GeneralNM human and vehicle medium v1.0, GeneralNM human and vehicle nano v1.0, GeneralNM human top view large v1.0, GeneralNM human top view medium v1.0, GeneralNM human top view nano v1.0, GeneralNM human top view v0.8. If you select neural networks for which the quantization mode isn't available in the previous window, then a cache will not be generated for them.

10. By default, the checkbox is clear. To enable the Int8 quantization mode for a neural network, set the checkbox

. Neural networks for which the quantization mode is available are included in the neural analytics package along with the *.info file of the same name

11. 	Image Added

Image Removed

12. Enable verbose logging mode

Image Removed

13. Image Added

    By default, the checkbox is clear. To enable logging of the process of initialization and cache generation, set the checkbox

.

14. Info title Note Enabling the parameter provides detailed information about the cache generation process but increases the volume of logs and can slow down the generation process


InfotitleNote

15. . Logs for each neural network are saved in a separate file in the directory C:\Users\<username>\.gpuCacheGenerator\logs. Previous logs are automatically deleted each time you run the utility.

Image Removed

16. Image Added

    The cache will be saved

AXXONGPU

Specify the directory of cache storage


Info

title	Note

17. Select a directory to store the cache for all used detectors and neural networks. The approximate cache size depends on the number and type of neural networks used. The minimum size is 70 MB. If you don’t specify the GPU_CACHE_DIR system variable, by default, the cache is saved in the directory: C:\Users\<user_name>\.gpuCacheGenerator\ (see Appendix 9. Creating system variable). If you specify the GPU_CACHE_DIR system variable, the cache is saved at the path specified in it. When you select a cache directory via the utility, the value of the GPU_CACHE_DIR system variable is updated to the selected path

.
18. 
    
19. Click the
Image Removed
20. Image Added button in the lower right part of the window to proceed to generating a cache for all selected neural networks.

Info

title	Note

21.  If you select several neural networks, they are processed one after another.
    The current progress status is displayed for each neural network.
Wait for
22. Possible statuses:
    • Ready (the line is outlined in green).
    • In progress.
    • In queue.
    • Error (the line is outlined in red).
23. When the generation process
to complete. If the cache is successfully generated, the
24. is complete, click the Image Added button in the lower right part of the window.
    

Cache generation is complete. The created files are available for use by detectors.

Cache generation is complete.

Repair the utility

You must repair the utility when its operation is disrupted due to changes in its working files or environment. To repair the utility:

1. Open the .msi file of the utility.
2. In the window that opens, click the Next button.
   Image Added
3. Click the Repair button.
   Image Added
4. In the window that opens, confirm the repair by clicking the Repair button.
   Image Added
5. Wait for the utility to complete the repair process. When the repair is complete, a new window opens informing you that the utility is repaired.
   Image Added
6. Click the Finish button.

The repair process is complete.

Remove utility

To remove the utility:

1. Open the .msi file of the utility.
2. In the window that opens, click the Next button.
   Image Added
3. Click the Remove button.
   Image Added
4. In the window that opens, confirm the removal by clicking the Remove button.
   Image Added
5. Wait for the utility to complete the removal process. When the process is complete, a new window opens informing you that the utility is removed.
   Image Added
6. Click the Finish button.

The removal process is complete.