User Testimony

"This program is exactly what I have been searching for"

Dave Anderson
Seattle Department of Transportation
Features » Validation Toolkit

Validation are a part of Data Service Toolkit with Reports and Alarms.

When you purchase a Toolkit for Vista Data Vision no installation is needed, you will simply be issued a new Product key that will unlock the purchased Toolkits.

Validations

Validation is used to automatically or manually repair the data in the database according to user defined boundaries. The user can define a maximum and minimum value, which if exceeded the validation toolkit will change the value to a last known good value.

How does it work?

  • In db.robot.c, set out-of-range limits for one or more (all) sensors.
  • The Validation process checks the data in the database.  It runs every few minutes and checks latest data for errors.
  • If out-of-range noise data is found, it is replaced according to the defined bounderies.  If a change is made, the process is logged.
  • The Validation Process can be made Automatic or Users can perform Validation Manually for a selected time period.

Validation Methods

  • Linear Interpolation over out of range values.
  • Out of range values replaced with NaN.
  • Replace out of range values with last known legal value

When db.robot.c validates data it first checks if the value is within the legal data range, if it is not within the legal limit it next checks if the number of consecutive values out of the legal data range are lower or equal to the selected Gap Size.  If they are lower or equal to the gap size then the values are replaced by the last good value before, else no action is taken.

Example

If the data values for a variable are "23.15; -100; 24.21; 23.98; -6999; -6999; -6999; 24.37; 25.14; 26.73;" and the lower limit for the variable is set to -50 and the upper limit is set to 150.
  • If the Gap Size is set to 4 then after the validation process those same values would be: "23.15; 23.15; 24.21; 23.98; 23.98; 23.98; 23.98; 24.37; 25.14; 26.73;".
  • If the Gap Size had been set to 2 then after the validation process those same values would be: "23.15; 23.15; 24.21; 23.98; -6999; -6999; -6999; 24.37; 25.14; 26.73;".

Images

Validation - 1
Validation - 2