Versions Compared

Old Version 8

changes.mady.by.user Alena Kniazeva

Saved on

compared with

New Version 41

changes.mady.by.user Alena Kniazeva

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Section
Column
width50%
Panel
borderColor#CCCCCC
bgColor#FFFFFF
titleBGColor#F0F0F0
borderStylesolid
titleOn the page:

Table of Contents

Column


Tip

Video requirements for scene analytics detection toolsVideo stream and scene requirements for neural tracker operationthe Neural tracker and its sub-detectors

Image requirements for the Neural tracker and its sub-detectorsObjects image requirements for neural tracker

Hardware requirements for neural analytics operation

Optimizing the operation of neural analytics on GPU in Windows OS

Optimizing the operation of neural analytics on GPU in Linux OS

Configuring the detection tool

To configure the neural tracker-based Scene Analytics detection tools Neural tracker, do the following:

...

  1. Go to the Detection Tools tab.

  2. Below the required camera, click Create… → Category: Trackers → Neural tracker.

By default, the detection tool is enabled and set to detect moving people.

If necessary, you can change the detection tool parameters. The list of parameters is given in the table:

ParameterValueDescription
Object features
Record objects trackingYes

By default, metadata are recorded into the database. To disable metadata recording,

...

select the No value

No
Video streamMain stream

If the camera supports multistreaming,

...

 select the stream for which detection is needed

...

Other
EnableYesBy default, the detection tool is enabled. To disable, select the No value
No
NameNeural trackerEnter the detection tool name or leave the default name
Decoder modeAuto

Select a processing resource for decoding video streams

...

. When you select a GPU, a stand-alone graphics card takes priority (when decoding with

...

Nvidia NVDEC chips). If there is no appropriate GPU, the decoding will use the Intel Quick Sync Video technology. Otherwise, CPU resources will be used for decoding

...

CPU
GPU
HuaweiNPU
Neural filter modeCPU

Select a processing resource for neural network operation (see Hardware requirements for neural analytics operation, Selecting Nvidia GPU when configuring detectors)

Note
titleAttention!
  • We recommend using the GPU. It may take several minutes to launch the algorithm on Nvidia GPU after you apply the settings. You can use caching to speed up future launches (see Optimizing the operation of neural analytics on GPU in Windows OS, Optimizing the operation of neural analytics on GPU in Linux OS).
  • Starting with Detector Pack 3.11, Intel HDDL and Intel NCS aren’t supported.
  • Starting with Detector Pack 3.12, the parameter is removed from the detection tool settings, and Neural filter runs on the same processor as Neural tracker. If before Detector Pack update, you select a different processor in the Neural filter mode parameter, after the update, the detection tool works without Neural filter.
Nvidia GPU 0
Nvidia GPU 1
Nvidia GPU 2
Nvidia GPU 3
Intel NCS (not supported)
Intel HDDL (not supported)
Intel GPU
Huawei NPU
Number of frames processed per second6

Specify the number of frames

...

for the neural network to process per second

...

. The higher the value, the more accurate the tracking, but the load on the CPU is also higher. The value must be in the range [0.016, 100].

Note
titleAttention!

We recommend the value of at least 6 FPS

...

. For fast moving objects (running individuals, vehicles), you

...

must set the frame rate at 12 FPS or above

...

.

TypeNeural trackerName of the detection tool type (non-editable field)
Advanced settings
Camera position

Wall To sort out false events from the detection tool when using a fisheye camera, select the correct device location. For other devices, this parameter is irrelevant
Ceiling
Hide moving objects

Yes

By default, the parameter is disabled. If you don't need to detect moving objects, select the Yes value. An object is considered static if it doesn't change its position more than 10% of its width or height during its track lifetime

Note
titleAttention!

If a static object starts moving, the detection tool will create a track, and the object will no longer be considered static.

No
Hide static objects

Yes

By default, the parameter is disabled. If you don't need to detect static objects, select the Yes value. This parameter lowers the number false events from the detection tool when detecting moving objects. An object is considered static if it has not moved more than 10% of its width or height during the whole time of its track existence.

Note
titleAttention!

If a static object starts moving, the detection tool will create a track, and the object will no longer be considered static.

No
Minimum number of detection triggers6Specify the 
Minimum number of detection triggers for the

...

Neural tracker to display the object's track

...

. The higher the value, the

...

longer the time interval between the detection of an object

...

and the display of its track on the screen. Low values

...

of this parameter can lead to false events from the detection tool. The value must be in the range [2, 100]
Model quantization

Yes

By default, the parameter is disabled. The parameter is applicable only to standard neural networks for Nvidia GPU. It allows you to reduce the consumption of computation power. The neural network is selected automatically depending on the value selected in the Detection neural network parameter. To quantize the model, select the Yes value

Note
titleAttention!

AxxonSoft conducted a study in which a neural network model was trained to identify the characteristics of the detected object with quantization. The following results of the study were obtained: model quantization can lead to both an increase in the percentage of recognition and a decrease. This is due to the generalization of the mathematical model. The difference in detection ranges within ±1.5%, and the difference in object identification ranges within ±2%.

  • The first launch of a detection tool with the Model quantization parameter enabled can take longer than a standard launch.
  • If GPU caching is used, next time the detection tool with quantization will run without delay.
No
Neural network file 

If you use a custom

...

neural network, select the corresponding file

...

Note
titleAttention!
  • To train your neural network, contact AxxonSoft (

...

...

  • for example, a person, a cyclist, a motorcyclist,

...

  • and so on).
  • If the neural network file is not specified, the default file

...

  • is used

...

  • that is selected automatically depending on the selected

...

  • value in the Detection neural network parameter and the selected processor for the neural network operation

...

  • in the Decoder mode parameter. If you use a custom neural network, enter a path to the file. The selected

...

  • detection neural network is ignored when you use a custom neural network.
  • To ensure the correct operation of the neural network on Linux OS, the corresponding file

...

  • must be located in the /opt/AxxonSoft/DetectorPack/NeuroSDK directory. 

...

  • If you use

...

  1. to use the neural filter, select Yes in the corresponding field (9).

  2. in the Neurofilter file field, select a neural network file (10).

  3. in the Neurofilter mode field, select a processor to be used for neural network work (11, see General Information on Configuring Detection).

Select the processor for the neural network—CPU, one of NVIDIA GPUs or one of Intel GPUs (12, see Hardware requirements for neural analytics operation, General Information on Configuring Detection).

Note
titleAttention!

We recommend using the GPU.

It may take several minutes to launch the algorithm on NVIDIA GPU after you apply the settings. You can use caching to speed up future launches (see Configuring the acceleration of GPU-based neuroanalytics).

If Neural Tracker is running on GPU, object tracks may be lagging behind the objects. If this happens, set the camera buffer size to 1000 milliseconds (see The Video Camera Object).

...

In the Object type field (13), select the recognition object:

  1. Human.
  2. Human (top view).
  3. Vehicle.
  4. Human and Vehicle (Nano)—low accuracy, low processor load.
  5. Human and Vehicle (Medium)—medium accuracy, medium processor load.

  6. Human and Vehicle (Large)—high accuracy, high processor load.

To enable the search for similar persons, in the Similitude search field (14), select Yes. It increases the processor load.

Note
titleAttention!

The Similitude search works only on tracks of people.

...

  • standard neural network (training wasn't performed in operating conditions), we guarantee the overall accuracy of 80-95% and the percentage of false positives of 5-20%. The standard neural networks are located in the C:\Program Files\Common Files\AxxonSoft\DetectorPack\NeuroSDK directory.
Scanning window

YesBy default, the parameter is disabled. To enable the scanning mode, select the Yes value (see Configuring the scanning mode)
No
Scanning window height0

The height and width of the scanning window are determined according to the actual size of the frame and the required number of windows. For example, the real frame size is 1920×1080 pixels. To divide the frame into four equal windows, set the width of the scanning window to 960 pixels and the height to 540 pixels

Scanning window step height0

The scanning step determines the relative offset of the windows. If the step is equal to the height and width of the scanning window respectively, the segments will line up one after another. Reducing the height or width of the scanning step will increase the number of windows due to their overlapping each other with an offset. This will increase the detection accuracy, but will also increase the CPU load.

Note
titleAttention!

...

If a stationary object starts moving, the detection tool will trigger, and the object will no longer be considered stationary.

If necessary, enable the Model quantization option (18). It allows you to reduce the consumption of the GPU processing power.

...

titleAttention!

AxxonSoft conducted a study in which a neural network model was trained to identify the characteristics of the detected object with quantization. The following results of the study were obtained: model quantization can lead to both an increase in the percentage of recognition and a decrease. This is due to the generalization of the mathematical model. The difference in detection ranges within ±1.5%, and the difference in object identification ranges within ±2%.

Model quantization is only applicable to NVIDIA GPUs.

The first launch of a detection tool with quantization enabled may take longer than a standard launch.

The height and width of the scanning step must not be greater than the height and width of the scanning window—the detection tool will not operate with such settings.

Scanning window step width0
Scanning window width0The height and width of the scanning window are determined according to the actual size of the frame and the required number of windows. For example, the real frame size is 1920×1080 pixels. To divide the frame into four equal windows, set the width of the scanning window to 960 pixels and the height to 540 pixels
Selected object classes 

...

If necessary, specify the class of the detected object

...

.

...

 If you want to display tracks of several classes, specify them separated by a comma with a space. For example, 1, 10.
The numerical values of classes for the

...

embedded neural networks: 1—Human/Human (top-down view), 10—Vehicle.

    1. If you leave the field blank, the tracks of all available classes from the neural network will be displayed (

...

    1. Detection neural network, Neural network file).
    2. If you specify a class/classes from the neural network, the tracks of the specified class/classes will be displayed (

...

    1. Detection neural network, Neural network file).
    2. If you specify a class/classes from the neural network and a class/classes missing from the neural network, the tracks of a class/classes from the neural network will be displayed (

...

    1. Detection neural network, Neural network file).

    2. If you specify a class/classes missing from the neural network, the tracks of all available classes from the neural network will be displayed (

...

    1. Detection neural network, Neural network file)

      Info
      titleNote

      Starting

...

    1. with Detector Pack

...

    1.  3.10.2, if you specify a class/classes missing from the neural network, the tracks won’t be displayed (

...

    1. Detection neural network, Neural network file).

Similitude search

Yes

By default, the parameter is disabled. To enable the search for similar persons, select the Yes value. If you enabled the parameter, it increases the processor load.

Note
titleAttention!

The Similitude search works only on tracks of people.

No
Time of processing similitude track (sec)0

Specify the time in seconds for the algorithm to process the track to search for similar persons. The value must be in the range [0, 3600]

Time period of excluding static objects0Specify the time in seconds after which the track of the static object is hidden. If the value of the parameter is 0, the track of the static object isn't hidden. The value must be in the range [0, 86 400]
Track retention time0.7Specify the time in seconds after which the object track is considered lost

...

. This helps if objects in scene temporarily overlap each other. For example, when a larger vehicle

...

completely

...

blocks the smaller one from view.

...

By default, the entire FOV is a detection area. If you need to narrow down the area to be analyzed, you can set one or several detection areas in the preview window.

Info
titleNote

The procedure of setting areas is identical to the primary tracker's (see Setting General Zones for Scene analytics detection tools). The only difference is that the neural tracker areas are processed while the primary tracker areas are ignored.

The value must be in the range [0.3, 1000]
Basic settings
Detection threshold30Specify the Detection threshold for objects in percent. If the recognition probability falls below the specified value, the data will be ignored. The higher the value, the higher the detection quality, but some events from the detection tool may not be considered. The value must be in the range [0.05, 100]
Neural tracker mode








CPU

Select the processor for the neural network operation (see Hardware requirements for neural analytics operation, Selecting Nvidia GPU when configuring detectors).

Note
titleAttention!
  • We recommend using the GPU. It may take several minutes to launch the algorithm on Nvidia GPU after you apply the settings. You can use caching to speed up future launches (see Optimizing the operation of neural analytics on GPU in Windows OS).
  • If neural tracker is running on GPU, object tracks can be lagging behind the objects in the Surveillance window. If this happens, set the camera buffer size to 1000 milliseconds (see Camera).
  • Starting with Detector Pack 3.11, Intel HDDL and Intel NCS aren’t supported.









Nvidia GPU 0
Nvidia GPU 1
Nvidia GPU 2
Nvidia GPU 3
Intel NCS (not supported)
Intel HDDL (not supported)
Intel GPU
Huawei NPU
Detection neural network





Person

Select the detection neural network from the list. Neural networks are named taking into account the objects they detect. The names can include the size of the neural network (Nano, Medium, Large), which indicates the amount of consumed resources. The larger the neural network, the higher the accuracy of object recognition


Person (top-down view)
Person (top-down view Nano)
Person (top-down view Medium)
Person (top-down view Large)
Vehicle
Person and vehicle (Nano)
Person and vehicle (Medium)
Person and vehicle (Large)
Neural network filter
Neural filterYes

By default, the parameter is disabled. To sort out parts of tracks, select the Yes value.

For example:

Neural tracker detects all freight trucks, and the Neural filter sorts out only the tracks that contain trucks with cargo door open

No
Neural filter file 

Select a neural network file

Note
titleAttention!

Starting with Detector Pack 3.12, the neural network file of the Neural filter must match the processor type specified in the Neural tracker mode parameter.


By default, the entire frame is a detection area. If necessary, in the preview window, set detection areas with the help of anchor points Image Added (see Configuring a detection area).

Info
titleNote

For convenience of configuration, you can "freeze" the frame. Click the Image Added button. To cancel the action, click this button again.

The detection area is displayed by default. To hide it, click the Image Added button. To cancel the action, click this button again.

To save the parameters of the detection tool, click the Apply Image Added button. To cancel the changes, click the Cancel Image Added button.

If necessary, you can create and configure the necessary sub-detectors on the basis of Neural tracker (see Standard sub-detectors

...

).

Note
titleAttention!

To

...

get an event from the Motion in area sub-detector on the basis of Neural tracker, an object

...

must be displaced by at least 25% of its width or height in

...

the frame.

Example of configuring Neural tracker for solving typical tasks

ParameterTask: detection of moving peopleTask: detection of moving vehicles
Other
Number of frames processed per second612
Neural network filter
Neural filterNoNo
Basic settings
Detection threshold3030
Advanced settings
Minimum number of detection triggers66
Camera positionWallWall
Hide static objectsYesYes
Neural network file

Path to the *.ann neural network file. You can also select the value in the Detection neural network parameter. In this case, this field must be left blank

Path to the *.ann neural network file. You can also select the value in the  Detection neural network parameter. In this case, this field must be left blank

...