Publications
Notice: Undefined index: admin in /home/pillowan/www-shaw-weil-marian/displayCommon_inc.php on line 171


Notice: Undefined index: displaysql in /home/pillowan/www-shaw-weil-marian/security_inc.php on line 108

Semantic Anomaly Detection in Online Data Sources

Notice: Undefined index: displaysql in /home/pillowan/www-shaw-weil-marian/security_inc.php on line 102

Orna Raz, Philip Koopman, and Mary Shaw
Proceedings of the 24th International Conference on Software Engineering, IEEE Computer Society, 2002, pp. 302-312

KeyWords:anomaly detection,everyday dependability

Online Links:      PDF

Abstract:

Much of the software we use for everyday purposes incorporates elements developed and maintained by someone other than the developer. These elements include not only code and databases but also dynamic data feeds from online data sources. Although everyday software is not mission critical, it must be dependable enough for practical use. This is limited by the dependability of the incorporated elements. It is particularly difficult to evaluate the dependability of dynamic data feeds, because they may be changed by their proprietors as they are used. Further, the specifications of these data feeds are often even sketchier than the specifications of software components. We demonstrate a method of inferring invariants about the normal behavior of dynamic data feeds. We use these invariants as proxies for specifications to perform on-going detection of anomalies in the data feed. We show the feasibility of our approach and demonstrate its usefulness for semantic anomaly detection: identifying occasions when a dynamic data feed is delivering unreasonable values, even though its behavior may be superficially acceptable (i.e., it is delivering parsable results in a timely fashion).

Preferred citation: Orna Raz, Philip Koopman, and Mary Shaw. Semantic anomaly detection in online data sources, Proceedings of the 24th International Conference on Software Engineering, IEEE Computer Society, 2002, pp. 302-312.
Entry last Updated 2007-01-12

Notice: Undefined index: admin in /home/pillowan/www-shaw-weil-marian/displaypaper_inc.php on line 29

You are visiting Mary Shaw's Bibliographic pages (Copyright 2002, 2005,2007 by Roy Weil and others. All rights reserved ) It contains the database of papers published by her and others at Carnegie Mellon Computer Science Department. The software used to index and search these papers is Marian - the on-line-braian, available at Marian's Home site. Comments and suggesions are welcome