Reasoning about model accuracy.

*(English)*Zbl 0787.68090Summary: Although computers are widely used to simulate complex physical systems, crafting the underlying models that enable computer analysis remains a difficult job with only a small number of computer tools for support. Our goal is to mechanize this process by building an automated model management system that evaluates simplifying assumptions and selects appropriate perspectives. We present our initial results: a framework for dynamically changing model accuracy based on model sensitivity analysis. We show how to perform model sensitivity analysis efficiently when one model is a fitting approximation of the other finally, we discuss two implementations of our technique in programs that perform

\(\bullet\) query-directed simplification by adding bounding abstractions, and

\(\bullet\) discrepancy-driven refinement.

Our programs use a mixture of qualitative and quantitative techniques with both symbolic and numeric computations.

\(\bullet\) query-directed simplification by adding bounding abstractions, and

\(\bullet\) discrepancy-driven refinement.

Our programs use a mixture of qualitative and quantitative techniques with both symbolic and numeric computations.

##### MSC:

68T15 | Theorem proving (deduction, resolution, etc.) (MSC2010) |

68U20 | Simulation (MSC2010) |

##### Keywords:

automated reasoning about physical systems; model sensitivity analysis; fitting approximation##### Software:

Mathematica
Full Text:
DOI

##### References:

[1] | Addanki, S.; Cremonini, R.; Penberthy, J.S., Contexts: dynamic identification of common parameters in distributed analysis of complex devices, () · Zbl 0707.68080 |

[2] | Addanki, S.; Cremonini, R.; Penberthy, J.S., Reasoning about assumptions in graphs of models, (), Reprinted in · Zbl 0719.68066 |

[3] | Addanki, S.; Cremonini, R.; Penberthy, J.S., Graphs of models, Artif. intell., 51, 1-3, 145-178, (1991) |

[4] | Amador, F.; Weld, D.S., Multi-level reasoning about populations, () |

[5] | Amarel, S., On representations of problems of reasoning about actions, (), 131-171 · Zbl 0197.14901 |

[6] | Ash, R., () |

[7] | Chiu, C.; Kuipers, B.J., Comparative analysis and qualitative integral representations, () |

[8] | Christensen, J., A hierarchical planner that generates its own hierarchies, (), 1004-1009 |

[9] | Collins, J.; Forbus, K.D., Reasoning about fluids via molecular collections, (), Reprinted in |

[10] | Cournot, A., (), (1897), Reprinted in English as: N. Bacon, translator |

[11] | Crawford, J.; Farquhar, A.; Kuipers, B.J., QPC: a compiler from physical models into qualitative differential equations, () |

[12] | Davis, R., Diagnostic reasoning based on structure and behavior, Artif. intell., 24, 374-410, (1984) |

[13] | de Kleer, J., How circuits work, Artif. intell., 24, 205-280, (1984) |

[14] | de Kleer, J.; Brown, J.S., A qualitative physics based on confluences, (), 24, 7-83, (1984), Reprinted in |

[15] | Denbigh, K.; Turner, J., () |

[16] | Ellman, T., Approximate theory formation: an explanation-based approach, () |

[17] | Enderton, H., () |

[18] | Falkenhainer, B.; Forbus, K.D., Setting up large scale qualitative models, (), Reprinted in |

[19] | Falkenhainer, B.; Forbus, K.D., Compositional modeling, () |

[20] | Falkenhainer, B.; Forbus, K.D., Compositional modeling: finding the right model for the job, Artif. intell., 51, 1-3, 95-144, (1991) |

[21] | Forbus, K.D., Qualitative process theory, (), 24, 85-168, (1984), Reprinted in |

[22] | Forbus, K.D.; Falkenhainer, B., Self-explanatory simulations: an integration of qualitative and quantitative knowledge, (), 380-387 |

[23] | Franke, D.; Dvorak, D., Component connection models, () |

[24] | Giunchiglia, F.; Walsh, T., Abstract theorem proving, (), 372-377 |

[25] | Hamscher, W.C., Modeling digital circuits for troubleshooting, Artif. intell., 51, 1-3, 223-272, (1991) |

[26] | Hanks, S., Practical temporal projection, () |

[27] | Hanks, S., Projecting plans about uncertain worlds, () |

[28] | Haussler, D., Quantifying inductive bias: AI learning algorithms and Valiant’s learning framework, Artif. intell., 36, 2, 177-221, (1988) · Zbl 0651.68104 |

[29] | Hayes, P.J., Naive physics I: ontology for liquids, (), Reprinted in |

[30] | Iwasaki, Y.; Bhandari, I., Formal basis for commonsense abstraction of dynamic systems, (), 307-312 |

[31] | Iwasaki, Y.; Simon, H., Causality in device behavior, (), 29, 1, 3-32, (1986), Reprinted in |

[32] | Joskowicz, L., Simplification and abstraction of kinematic behaviors, (), 1337-1342, Reprinted in |

[33] | Kleppner, D.; Kolenkow, R., () |

[34] | Knoblock, C.A., Learning abstraction hierarchies for problem solving, (), 923-928 |

[35] | Korf, R.E., Towards a model of representation changes, Artif. intell., 14, 41-78, (1980) |

[36] | Korf, R.E., Planning as search: a quantitative approach, Artif. intell., 33, 1, 65-88, (1987) |

[37] | Kuipers, B.J., Qualitative simulation, (), 29, 209-338, (1986), Reprinted in · Zbl 0624.68098 |

[38] | Kuipers, B.J., Abstraction by time-scale in qualitative simulation, (), 621-625, Reprinted in |

[39] | Kuipers, B.J., () |

[40] | Liu, Z.; Farley, A., Shifting ontological perspectives in reasoning about physical systems, () |

[41] | Moses, J., Algebraic simplification: a guide for the perplexed, Commun. ACM, 14, 8, (1971) · Zbl 0222.68017 |

[42] | Mostow, J.; Prieditis, A., Discovering admissible heuristics by abstracting and optimizing: a transformational approach, (), 701-707 · Zbl 0709.68084 |

[43] | Murthy, S., Qualitative reasoning at multiple resolutions, (), 296-300 |

[44] | Murthy, S.; Addanki, S., PROMPT: an innovative design tool, (), 637-642 |

[45] | Nayak, P.Pandurang, Validating approximate equilibrium models, () |

[46] | Nayak, P.Pandurang; Joskowicz, L.; Addanki, S., Automated model selection using context-dependent behaviors, (), 10-24 |

[47] | Patil, R.S.; Szolovits, P.; Schwartz, W., Causal understanding of patient illness in medical diagnosis, () |

[48] | Penberthy, J.S., Incremental analysis and the graph of models: a first step towards analysis in the Plumber’s world, () |

[49] | Plaisted, D.A., Theorem proving with abstraction, Artif. intell., 16, 47-108, (1981) · Zbl 0454.68113 |

[50] | () |

[51] | Rajamoney, S.; Koo, S., Qualitative reasoning with microscopic theories, () |

[52] | Sacerdoti, E.D., Planning in a hierarchy of abstraction spaces, Artif. intell., 5, 115-135, (1974) · Zbl 0288.68052 |

[53] | Sacks, E.P., Hierarchical reasoning about inequalities, (), 649-654, Reprinted in |

[54] | Sacks, E.P., Automatic analysis of one-parameter planar ordinary differential equations by intelligent numerical simulation, Artif. intell., 48, 1, 27-56, (1991) · Zbl 0714.65068 |

[55] | Selman, B.; Kautz, H.A., Knowledge compilation using Horn approximations, () |

[56] | Shirley, M.; Falkenhainer, B., Explicit reasoning about accuracy for approximating physical systems, () |

[57] | Simmons, R., “commonsense” arithmetic reasoning, (), 118-124, Reprinted in |

[58] | Smith, J.M.; Van Ness, H.C., () |

[59] | Spivak, M., () |

[60] | Subramanian, D.; Genesereth, M.R., The relevance of irrelevance, (), 416-422 |

[61] | Sussman, G.J.; Steele, G.L., CONSTRAINTS: a language for expressing almost-hierarchical descriptions, Artif. intell., 14, 1-39, (1980) |

[62] | Thorpe, J., () |

[63] | Weld, D.S., The use of aggregation in causal simulation, (), 30, 1, 1-34, (1986), Reprinted in |

[64] | Weld, D.S., Comparative analysis, (), 36, 3, 333-373, (1988), Reprinted in · Zbl 0654.93004 |

[65] | Weld, D.S., () |

[66] | Weld, D.S., Approximation reformulations, (), 407-412 |

[67] | Weld, D.S., Exaggeration, Artif. intell., 43, 3, 311-368, (1990) · Zbl 0722.76078 |

[68] | () |

[69] | Wellman, M.P., Qualitative simulation with multivariate constraints, () · Zbl 0765.68216 |

[70] | Williams, B.C., Qualitative analysis of MOS circuits, (), 24, 281-346, (1984), Revised version reprinted in |

[71] | Williams, B.C., MINIMA: a symbolic approach to qualitative algebraic reasoning, (), Reprinted in |

[72] | Williams, B.C., Invention from first principles via topologies of interaction, () |

[73] | Williams, B.C., Capturing how things work: constructing critical abstractions of local interactions, () |

[74] | Wolfram, S., () |

This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.