2d Frame Analysis Crack Keygen Software

DOWNLOAD ->>> __https://urlgoal.com/2t2EL9__

ATENA is a finite element based software designed specifically for the analysis of reinforced concrete. With ATENA users can simulate the actual behavior of concrete structures, including concrete cracking, crushing, and yielding of the reinforcement thereby producing a more accurate prediction of load carrying capacity. Additionally, ATENA provides a unique run-time environment, allowing users to see this behavior in real time, as the structure is being analyzed.

The unique runtime environment allows visualization of results in real-time. Users can see crack developments, and contoured results as the analysis progresses. Monitoring points can be defined to produce desired output curves (ex. load vs displacement). 3D cuts can also produce internal moments, normal forces, and shear displays. Parallel processing is supported and provides a 3-4x reduction in computation times.

Stop-motion animation is used to describe animation created by physically manipulating real-world objects and photographing them one frame of film at a time to create the illusion of movement.[61] There are many different types of stop-motion animation, usually named after the medium used to create the animation.[62] Computer software is widely available to create this type of animation; traditional stop-motion animation is usually less expensive but more time-consuming to produce than current computer animation.[62]

OpenFlows WaterGEMS provides you with a comprehensive yet easy-to-use decision-support tool for water distribution networks. The software helps improve your knowledge of how infrastructure behaves as a system, how it reacts to operational strategies, and how it should grow as population and demands increase. From fire flow and water quality simulations, to criticality and energy cost analysis, OpenFlows WaterGEMS has everything you need in a flexible multiplatform environment. OpenFlows WaterGEMS is a superset of OpenFlows WaterCAD.

Trimble Tekla Tedds 2018 v20 is a handy application which can be used for automating your repetitive structural calculations. With this application you have the choice to select one or more than one regularly updated calculation libraries or write one of your own one. You can also combine the structural calculations with 2D frame analysis. You can also download Bentley RAM Structural System CONNECT Edition Free Download.

Using warez version, crack, warez passwords, patches, serial numbers, registration codes, key generator, pirate key, keymaker or keygen forRISA-2D 19.0.0 license key is illegal and prevent future development ofRISA-2D 19.0.0. Download links are directly from our mirrors or publisher's website,RISA-2D 19.0.0 torrent files or shared files from free file sharing and free upload services,including RISA-2D 19.0.0 Rapidshare, MegaUpload, HellShare, HotFile, FileServe, YouSendIt, SendSpace, DepositFiles, Letitbit, MailBigFile, DropSend, MediaMax, LeapFile, zUpload, MyOtherDrive, DivShare or MediaFire,are not allowed!

Your computer will be at risk getting infected with spyware, adware, viruses, worms, trojan horses, dialers, etcwhile you are searching and browsing these illegal sites which distribute a so called keygen, key generator, pirate key, serial number, warez full version or crack forRISA-2D 19.0.0. These infections might corrupt your computer installation or breach your privacy.RISA-2D 19.0.0 keygen or key generator might contain a trojan horse opening a backdoor on your computer.Hackers can use this backdoor to take control of your computer, copy data from your computer or to use your computer to distribute viruses and spam to other people.

Tools for Decision Analysis:Analysis of Risky Decisions If you will begin with certainties, you shall end in doubts, but ifyou will content to begin with doubts, you shall end in almost certainties.-- Francis Bacon Para mis visitantes del mundo de habla hispana, este sitio se encuentra disponible en espaÃ±ol en:Sitio Espejo para AmÃ©rica Latina Sitio en los E.E.U.U. Estonian Translation Making decisions is certainly the most important task of a manager and it is often a very difficult one. This site offers a decision making procedure for solving complex problems step by step.It presents the decision-analysis process for both public and private decision-making, using different decision criteria, different types of information, and information of varying quality. It describes the elements in the analysis of decision alternatives and choices, as well as the goals and objectives that guide decision-making. The key issues related to a decision-maker's preferences regarding alternatives, criteria for choice, and choice modes, together with the risk assessment tools are also presented.Professor Hossein Arsham To search the site, try Edit | Find in page [Ctrl + f]. Enter a word or phrase in the dialogue box, e.g. "risk " or "utility " If the first appearance of the word/phrase is not what you are looking for, try Find Next. MENUIntroduction & SummaryProbabilistic Modeling: From Data to a Decisive KnowledgeDecision Analysis: Making Justifiable, Defensible DecisionsElements of Decision Analysis ModelsDecision Making Under Pure Uncertainty: Materials are presented in the context of Financial Portfolio Selections.Limitations of Decision Making under Pure Uncertainty Coping with UncertaintiesDecision Making Under Risk: Presentation is in the context of Financial Portfolio Selections under risk.Making a Better Decision by Buying Reliable Information: Applications are drawn from Marketing a New Product. Decision Tree and Influence DiagramWhy Managers Seek the Advice From Consulting FirmsRevising Your Expectation and its Risk Determination of the Decision-Maker's UtilityUtility Function Representations with ApplicationsA Classification of Decision Maker's Relative Attitudes Toward Risk and Its ImpactThe Discovery and Management of LossesRisk: The Four Letters WordDecision's Factors-Prioritization & Stability AnalysisOptimal Decision Making ProcessJavaScript E-labs Learning ObjectsA Critical Panoramic View of Classical Decision AnalysisExercise Your Knowledge to Enhance What You Have Learned (PDF)Appendex: A Collection of Keywords and PhrasesCompanion Sites:Business Statistics Success Science Leadership Decision Making Linear Programming (LP) and Goal-Seeking Strategy Linear Optimization Software to Download Artificial-variable Free LP Solution Algorithms Integer Optimization and the Network Models Tools for LP Modeling Validation The Classical Simplex Method Zero-Sum Games with Applications Computer-assisted Learning Concepts and Techniques Linear Algebra and LP Connections From Linear to Nonlinear Optimization with Business Applications Construction of the Sensitivity Region for LP Models Zero Sagas in Four Dimensions Systems Simulation Business Keywords and Phrases Compendium of Web Site Review Collection of JavaScript E-labs Learning Objects Decision Science Resources Compendium of Web Site Review Introduction & SummaryRules of thumb, intuition, tradition, and simple financial analysis are often no longer sufficient for addressing such common decisions as make-versus-buy, facility site selection, and process redesign. In general, the forces of competition are imposing a need for more effective decision making at all levels in organizations. Decision analysts provide quantitative support for the decision-makers in all areas including engineers, analysts in planning offices and public agencies, project management consultants, manufacturing process planners, financial and economic analysts, experts supporting medical/technological diagnosis, and so on and on.Progressive Approach to Modeling: Modeling for decision making involves two distinct parties, one is the decision-maker and the other is the model-builder known as the analyst. The analyst is to assist the decision-maker in his/her decision-making process. Therefore, the analyst must be equipped with more than a set of analytical methods.Specialists in model building are often tempted to study a problem, and then go off in isolation to develop an elaborate mathematical model for use by the manager (i.e., the decision-maker). Unfortunately the manager may not understand this model and may either use it blindly or reject it entirely. The specialist may feel that the manager is too ignorant and unsophisticated to appreciate the model, while the manager may feel that the specialist lives in a dream world of unrealistic assumptions and irrelevant mathematical language.Such miscommunication can be avoided if the manager works with the specialist to develop first a simple model that provides a crude but understandable analysis. After the manager has built up confidence in this model, additional detail and sophistication can be added, perhaps progressively only a bit at a time. This process requires an investment of time on the part of the manager and sincere interest on the part of the specialist in solving the manager's real problem, rather than in creating and trying to explain sophisticated models. This progressive model building is often referred to as the bootstrapping approach and is the most important factor in determining successful implementation of a decision model. Moreover the bootstrapping approach simplifies otherwise the difficult task of model validating and verification processes.What is a System: Systems are formed with parts put together in a particular manner in order to pursuit an objective. The relationship between the parts determines what the system does and how it functions as a whole. Therefore, the relationship in a system are often more important than the individual parts. In general, systems that are building blocks for other systems are called subsystemsThe Dynamics of a System: A system that does not change is a static (i.e., deterministic) system. Many of the systems we are part of are dynamic systems, which are they change over time. We refer to the way a system changes over time as the system's behavior. And when the system's development follows a typical pattern we say the system has a behavior pattern. Whether a system is static or dynamic depends on which time horizon you choose and which variables you concentrate on. The time horizon is the time period within which you study the system. The variables are changeable values on the system.In deterministic models, a good decision is judged by the outcome alone. However, in probabilistic models, the decision-maker is concerned not only with the outcome value but also with the amount of risk each decision carriesAs an example of deterministic versus probabilistic models, consider the past and the future: Nothing we can do can change the past, but everything we do influences and changes the future, although the future has an element of uncertainty. Managers are captivated much more by shaping the future than the history of the past.Uncertainty is the fact of life and business; probability is the guide for a "good" life and successful business. The concept of probability occupies an important place in the decision-making process, whether the problem is one faced in business, in government, in the social sciences, or just in one's own everyday personal life. In very few decision making situations is perfect information - all the needed facts - available. Most decisions are made in the face of uncertainty. Probability enters into the process by playing the role of a substitute for certainty - a substitute for complete knowledge.Probabilistic Modeling is largely based on application of statistics for probability assessment of uncontrollable events (or factors), as well as risk assessment of your decision. The original idea of statistics was the collection of information about and for the State. The word statistics is not derived from any classical Greek or Latin roots, but from the Italian word for state. Probability has a much longer history. Probability is derived from the verb to probe meaning to "find out" what is not too easily accessible or understandable. The word "proof" has the same origin that provides necessary details to understand what is claimed to be true. Probabilistic models are viewed as similar to that of a game; actions are based on expected outcomes. The center of interest moves from the deterministic to probabilistic models using subjective statistical techniques for estimation, testing, and predictions. In probabilistic modeling, risk means uncertainty for which the probability distribution is known. Therefore risk assessment means a study to determine the outcomes of decisions along with their probabilities.Decision-makers often face a severe lack of information. Probability assessment quantifies the information gap between what is known, and what needs to be known for an optimal decision. The probabilistic models are used for protection against adverse uncertainty, and exploitation of propitious uncertainty.Difficulty in probability assessment arises from information that is scarce, vague, inconsistent, or incomplete. A statement such as "the probability of a power outage is between 0.3 and 0.4" is more natural and realistic than their "exact" counterpart such as "the probability of a power outage is 0.36342."It is a challenging task to compare several courses of action and then select one action to be implemented. At times, the task may prove too challenging. Difficulties in decision making arise through complexities in decision alternatives. The limited information-processing capacity of a decision-maker can be strained when considering the consequences of only one course of action. Yet, choice requires that the implications of various courses of action be visualized and compared. In addition, unknown factors always intrude upon the problem situation and seldom are outcomes known with certainty. Almost always, an outcome depends upon the reactions of other people who may be undecided themselves. It is no wonder that decision-makers sometimes postpone choices for as long as possible. Then, when they finally decide, they neglect to consider all the implications of their decision. Emotions and Risky Decision: Most decision makers rely on emotions in making judgments concerning risky decisions. Many people are afraid of the possible unwanted consequences. However, do we need emotions in order to be able to judge whether a decision and its concomitant risks are morally acceptable. This question has direct practical implications: should engineers, scientists and policy makers involved in developing risk regulation take the emotions of the public seriously or not? Even though emotions are subjective and irrational (or a-rational), they should be a part of the decision making process since they show us our preferences. Since emotions and rationality are not mutually exclusive, because in order to be practically rational, we need to have emotions. This can lead to an alternative view about the role of emotions in risk assessment: emotions can be a normative guide in making judgments about morally acceptable risks. Most people often make choices out of habit or tradition, without going through the decision-making process steps systematically. Decisions may be made under social pressure or time constraints that interfere with a careful consideration of the options and consequences. Decisions may be influenced by one's emotional state at the time a decision is made. When people lack adequate information or skills, they may make less than optimal decisions. Even when or if people have time and information, they often do a poor job of understanding the probabilities of consequences. Even when they know the statistics; they are more likely to rely on personal experience than information about probabilities. The fundamental concerns of decision making are combining information about probability with information about desires and interests. For example: how much do you want to meet her, how important is the picnic, how much is the prize worth? Business decision making is almost always accompanied by conditions of uncertainty. Clearly, the more information the decision maker has, the better the decision will be. Treating decisions as if they were gambles is the basis of decision theory. This means that we have to trade off the value of a certain outcome against its probability. To operate according to the canons of decision theory, we must compute the value of a certain outcome and its probabilities; hence, determining the consequences of our choices. The origin of decision theory is derived from economics by using the utility function of payoffs. It suggests that decisions be made by computing the utility and probability, the ranges of options, and also lays down strategies for good decisions: This Web site presents the decision analysis process both for public and private decision making under different decision criteria, type, and quality of available information. This Web site describes the basic elements in the analysis of decision alternatives and choice, as well as the goals and objectives that guide decision making. In the subsequent sections, we will examine key issues related to a decision-makerÂ’s preferences regarding alternatives, criteria for choice, and choice modes.Objectives are important both in identifying problems and in evaluating alternative solutions. Evaluating alternatives requires that a decision-makerÂ’s objectives be expressed as criterion that reflects the attributes of the alternatives relevant to the choice. The systematic study of decision making provides a framework for choosing courses of action in a complex, uncertain, or conflict-ridden situation. The choices of possible actions, and the prediction of expected outcomes, derive from a logical analysis of the decision situation. A Possible Drawback in the Decision Analysis Approach: You might have already noticed that the above criteria always result in selection of only one course of action. However, in many decision problems, the decision-maker might wish to consider a combination of some actions. For example, in the Investment problem, the investor might wish to distribute the assets among a mixture of the choices in such a way to optimize the portfolio's return. Visit the Game Theory with Applications Web site for designing such an optimal mixed strategy.Further Readings:Arsham H., A Markovian model of consumer buying behavior and optimal advertising pulsing policy, Computers and Operations Research, 20(2), 35-48, 1993. Arsham H., A stochastic model of optimal advertising pulsing policy, Computers and Operations Research, 14(3), 231-239, 1987. Ben-Haim Y., Information-gap Decision Theory: Decisions Under Severe Uncertainty, Academic Press, 2001.Golub A., Decision Analysis: An Integrated Approach, Wiley, 1997.Goodwin P., and G. Wright, Decision Analysis for Management Judgment, Wiley, 1998. van Gigch J., Metadecisions: Rehabilitating Epistemology, Kluwer Academic Publishers, 2002.Wickham Ph., Strategic Entrepreneurship: A Decision-making Approach to New Venture Creation and Management, Pitman, 1998. Probabilistic Modeling: From Data to a Decisive Knowledge Knowledge is what we know well. Information is the communication of knowledge. In every knowledge exchange, there is a sender and a receiver. The sender make common what is private, does the informing, the communicating. Information can be classified as explicit and tacit forms. The explicit information can be explained in structured form, while tacit information is inconsistent and fuzzy to explain. Know that data are only crude information and not knowledge by themselves. Data is known to be crude information and not knowledge by itself. The sequence from data to knowledge is: from Data to Information, from Information to Facts, and finally, from Facts to Knowledge. Data becomes information, when it becomes relevant to your decision problem. Information becomes fact, when the data can support it. Facts are what the data reveals. However the decisive instrumental (i.e., applied) knowledge is expressed together with some statistical degree of confidence. Fact becomes knowledge, when it is used in the successful completion of a decision process. Once you have a massive amount of facts integrated as knowledge, then your mind will be superhuman in the same sense that mankind with writing is superhuman compared to mankind before writing. The following figure illustrates the statistical thinking process based on data in constructing statistical models for decision making under uncertainties. The above figure depicts the fact that as the exactness of a statistical model increases, the level of improvements in decision-making increases. That's why we need probabilistic modeling. Probabilistic modeling arose from the need to place knowledge on a systematic evidence base. This required a study of the laws of probability, the development of measures of data properties and relationships, and so on. Statistical inference aims at determining whether any statistical significance can be attached that results after due allowance is made for any random variation as a source of error. Intelligent and critical inferences cannot be made by those who do not understand the purpose, the conditions, and applicability of the various techniques for judging significance.Knowledge is more than knowing something technical. Knowledge needs wisdom. Wisdom is the power to put our time and our knowledge to the proper use. Wisdom comes with age and experience. Wisdom is the accurate application of accurate knowledge and its key component is to knowing the limits of your knowledge. Wisdom is about knowing how something technical can be best used to meet the needs of the decision-maker. Wisdom, for example, creates statistical software that is useful, rather than technically brilliant. For example, ever since the Web entered the popular consciousness, observers have noted that it puts information at your fingertips but tends to keep wisdom out of reach. Considering the uncertain environment, the chance that "good decisions" are made increases with the availability of "good information." The chance that "good information" is available increases with the level of structuring the process of Knowledge Management. One may ask, "What is the use of decision analysis techniques without the best available information delivered by Knowledge Management?" The answer is: one can not make responsible decisions until one possess enough knowledge. However, for private decisions one may rely on, e.g., the psychological motivations, as discusses under "Decision Making Under Pure Uncertainty" in this site. Moreover, Knowledge Management and Decision Analysis are indeed interrelated since one influences the other, both in time, and space. The notion of "wisdom" in the sense of practical wisdom has entered Western civilization through biblical texts. In theHellenic experience this kind of wisdom received a more structural character in the form of philosophy. In this sense philosophy also reflects one of the expressions of traditional wisdom.Making decisions is certainly the most important task of a manager and it is often a very difficult one. This site offers a decision making procedure for solving complex problems step by step.The Decision-Making Process: Unlike the deterministic decision-making process, in the decision making process under uncertainty the variables are often more numerous and more difficult to measure and control. However, the steps are the same. They are:SimplificationBuilding a decision modelTesting the modelUsing the model to find the solutionIt is a simplified representation of the actual situationIt need not be complete or exact in all respectsIt concentrates on the most essential relationships and ignores the less essential ones.It is more easily understood than the empirical situation and, hence, permits the problem to be more readily solved with minimum time and effort.It can be used again and again for like problems or can be modified. Fortunately the probabilistic and statistical methods for analysis and decision making under uncertainty are more numerous and powerful today than even before. The computer makes possible many practical applications. A few examples of business applications are the following:An auditor can use random sampling techniques to audit the account receivable for client.A plant manager can use statistic quality control techniques to assure the quality of his production with a minimum of testing or inspection.A financial analyst may use regression and correlation to help understand the relationship of a financial ratio to a set of other variables in business.A market researcher may use test of significant to accept or reject the hypotheses about a group of buyers to which the firm wishes to sell a particular product.A sale manager may use statistical techniques to forecast sales for the coming year.Further Readings:Berger J., Statistical Decision Theory and Bayesian Analysis, Springer, 1978.Corfield D., and J. Williamson, Foundations of Bayesianism, Kluwer Academic Publishers, 2001. Contains Logic, Mathematics, Decision Theory, and Criticisms of Bayesianism.GrÃ¼nig R., KÃ¼hn, R.,and M. Matt, (Eds.), Successful Decision-Making: A Systematic Approach to Complex Problems, Springer, 2005. It is intended for decision makers in companies, in non-profit organizations and in public administration.Lapin L., Statistics for Modern Business Decisions, Harcourt Brace Jovanovich, 1987.Lindley D., Making Decisions, Wiley, 1991.Pratt J., H. Raiffa, and R. Schlaifer, Introduction to Statistical Decision Theory, The MIT Press, 1994.Press S., and J. Tanur, The Subjectivity of Scientists and the Bayesian Approach, Wiley, 2001. Comparing and contrasting the reality of subjectivity in the work of history's great scientists and the modern Bayesian approach to statistical analysis.Tanaka H., and P. Guo, Possibilistic Data Analysis for Operations Research, Physica-Verlag, 1999. Decision Analysis: Making Justifiable, Defensible DecisionsDecision analysis is the discipline of evaluating complex alternatives in terms of values and uncertainty. Values are generally expressed monetarily because this is a major concern for management. Furthermore, decision analysis provides insight into how the defined alternatives differ from one another and then generates suggestions for new and improved alternatives. Numbers quantify subjective values and uncertainties, which enable us to understand the decision situation. These numerical results then must be translated back into words in order to generate qualitative insight.Humans can understand, compare, and manipulate numbers. Therefore, in order to create a decision analysis model, it is necessary to create the model structure and assign probabilities and values to fill the model for computation. This includes the values for probabilities, the value functions for evaluating alternatives, the value weights for measuring the trade-off objectives, and the risk preference.Once the structure and numbers are in place, the analysis can begin. Decision analysis involves much more than computing the expected utility of each alternative. If we stopped there, decision makers would not gain much insight. We have to examine the sensitivity of the outcomes, weighted utility for key probabilities, and the weight and risk preference parameters. As part of the sensitivity analysis, we can calculate the value of perfect information for uncertainties that have been carefully modeled. There are two additional quantitative comparisons. The first is the direct comparison of the weighted utility for two alternatives on all of the objectives. The second is the comparison of all of the alternatives on any two selected objectives which shows the Pareto optimality for those two objectives.Complexity in the modern world, along with information quantity, uncertainty, and risk, make it necessary to provide a rational decision making framework. The goal of decision analysis is to give guidance, information, insight, and structure to the decision-making process in order to make better, more 'rational' decisions. A decision needs a decision maker who is responsible for making decisions. This decision maker has a number of alternatives and must choose one of them. The objective of the decision-maker is to choose the best alternative. When this decision has been made, events that the decision-maker has no control over may have occurred. Each combination of alternatives, followed by an event happening, leads to an outcome with some measurable value. Managers make decisions in complex situations. Decision tree and payoff matrices illustrate these situations and add structure to the decision problems.Further Readings:Arsham H., Decision analysis: Making justifiable, defensible decisions, e-Quality, September, 2004.Forman E., and M. Selly, Decision by Objectives: How to Convince Others That You Are Right, World Scientific, 2001.Gigerenzer G., Adaptive Thinking: Rationality in the Real World, Oxford University Press, 2000.GirÃ³n F., (Ed.), Applied Decision Analysis, Kluwer Academic, 1998.Manning N., et al., Strategic Decision Making In Cabinet Government: Institutional Underpinnings and Obstacles, World Bank, 1999. Patz A., Strategic Decision Analysis: A General Management Framework, Little and Brown Pub., 1981.Vickers G., The Art of Judgment: A Study of Policy Making, Sage Publications, 1995. Von Furstenberg G., Acting Under Uncertainty: Multidisciplinary Conceptions, Kluwer Academic Publishers, 1990. Elements of Decision Analysis Models The mathematical models and techniques considered in decision analysis are concerned with prescriptive theories of choice (action). This answers the question of exactly how a decision maker should behave when faced with a choice between those actions which have outcomes governed by chance, or the actions of competitors. Decision analysis is a process that allows the decision maker to select at least and at most one option from a set of possible decision alternatives. There must be uncertainty regarding the future along with the objective of optimizing the resulting payoff (return) in terms of some numerical decision criterion. The elements of decision analysis problems are as follow:A sole individual is designated as the decision-maker. For example, the CEO of a company, who is accountable to the shareholders.A finite number of possible (future) events called the 'States of Nature' (a set of possible scenarios). They are the circumstances under which a decision is made. The states of nature are identified and grouped in set "S"; its members are denoted by "s(j)". Set S is a collection of mutually exclusive events meaning that only one state of nature will occur. A finite number of possible decision alternatives (i.e., actions) is available to the decision-maker. Only one action may be taken. What can I do? A good decision requires seeking a better set of alternatives than those that are initially presented or traditionally accepted. Be brief on the logic and reason portion of your decision. While there are probably a thousand facts about an automobile, you do not need them all to make a decision. About a half dozen will do.Payoff is the return of a decision. Different combinations of decisions and states of nature (uncertainty) generate different payoffs. Payoffs are usually shown in tables. In decision analysis payoff is represented by positive (+) value for net revenue, income, or profit and negative (-) value for expense, cost or net loss. Payoff table analysis determines the decision alternatives using different criteria. Rows and columns are assigned possible decision alternatives and possible states of nature, respectively. Constructing such a matrix is usually not an easy task; therefore, it may take some practice.Source of Errors in Decision Making: The main sources of errors in risky decision-making problems are: false assumptions, not having an accurate estimation of the probabilities, relying on expectations, difficulties in measuring the utility function, and forecast errors.Consider the following Investment Decision-Making Example:The Investment Decision-Making Example: States of Nature Growth Medium G No Change Low G MG NC L Bonds 12% 8 7 3 Actions Stocks 15 9 5 -2 Deposit 7 7 7 7 The States of Nature are the states of economy during one year. The problem is to decide what action to take among three possible courses of action with the given rates of return as shown in the body of the table.Further Readings:Borden T., and W. Banta, (Ed.), Using Performance Indicators to Guide Strategic Decision Making, Jossey-Bass Pub., 1994. Eilon S., The Art of Reckoning: Analysis of Performance Criteria, Academic Press, 1984. Von Furstenberg G., Acting Under Uncertainty: Multidisciplinary Conceptions, Kluwer Academic Publishers, 1990.Coping With UncertaintiesThere are a few satisfactory description of uncertainty, one of which is the concept and the algebra of probability. To make serious business decisions one is to face a future in which ignorance and uncertainty increasingly overpower knowledge, as ones planning horizon recedes into the distance. The deficiencies about our knowledge of the future may be divided into three domains, each with rather murky boundaries:Risk: One might be able to enumerate the outcomes and figure the probabilities. However, one must lookout for non-normal distributions, especially those with Â“fat tailsÂ”, as illustrated in the stock market by the rare events. Uncertainty: One might be able to enumerate the outcomes but the probabilities are murky. Most of the time, the best one can do is to give a rank order to possible outcomes and then be careful that one has not omitted one of significance.Black Swans: The name comes from an Australian genetic anomaly. This is the domain of events which are either Â“extremely unlikelyÂ” or Â“inconceivableÂ” but when they happen, and they do happen, they have serious consequences, usually bad. An example of the first kind is the Exxon Valdez oil spill, of the second, the radiation accident at Three Mile Island. In fact, all highly man-made systems, such as, large communications networks, nuclear-powered electric-generating stations and spacecraft are full of hidden Â“paths to failureÂ”, so numerous that we cannot think of all of them, or not able to afford the time and money required to test for and eliminate them. Individually each of these paths is a black swan, but there are so many of them that the probability of one of them being activated is quite significant.While making business decisions, we are largely concerned with the domain of risk and usually assume that the probabilities follow normal distributions. However, we must be concerned with all three domains and have an open mind about the shape of the distributions. Continuum of pure uncertainty and certainty: The domain of decision analysis models falls between two extreme cases. This depends upon the degree of knowledge we have about the outcome of our actions, as shown below: Ignorance Risky Situation Complete Knowledge _______________________________________________________________ Pure Uncertainty Probabilistic Deterministic Model Model Model One "pole" on this scale is deterministic, such as the carpenter's problem. The opposite "pole" is pure uncertainty. Between these two extremes are problems under risk. The main idea here is that for any given problem, the degree of certainty varies among managers depending upon how much knowledge each one has about the same problem. This reflects the recommendation of a different solution by each person. Probability is an instrument used to measure the likelihood of occurrence for an event. When you use probability to express your uncertainty, the deterministic side has a probability of 1 (or zero), while the other end has a flat (all equally probable) probability. For example, if you are certain of the occurrence (or non-occurrence) of an event, you use the probability of one (or zero). If you are uncertain, and would use the expression "I really don't know," the event may or may not occur with a probability of 50%. This is the Bayesian notion that probability assessment is always subjective. That is, the probability always depends upon how much the decision maker knows. If someone knows all there is to know, then the probability will diverge either to 1 or 0. The decision situations with flat uncertainty have the largest risk. For simplicity, consider a case where there are only two outcomes, with one having a probability of p. Thus, the variation in the states of nature is p(1-p). The largest variation occurs if we set p = 50%, given each outcome an equal chance. In such a case, the quality of information is at its lowest level. Remember from your Statistics course that the quality of information and variation are inversely related. That is, larger variation in data implies lower quality data (i.e. information).Relevant information and knowledge used to solve a decision problem sharpens our flat probability. Useful information moves the location of a problem from the pure uncertain "pole" towards the deterministic "pole". Probability assessment is nothing more than the quantification of uncertainty. In other words, quantification of uncertainty allows for the communication of uncertainty between persons. There can be uncertainties regarding events, states of the world, beliefs, and so on. Probability is the tool for both communicating uncertainty and managing it (taming chance). There are different types of decision models that help to analyze the different scenarios. Depending on the amount and degree of knowledge we have, the three most widely used types are:Decision-making under pure uncertaintyDecision-making under riskDecision-making by buying information (pushing the problem towards the deterministic "pole")In decision-making under pure uncertainty, the decision maker has absolutely no knowledge, not even about the likelihood of occurrence for any state of nature. In such situations, the decision-maker's behavior is purely based on his/her attitude toward the unknown. Some of these behaviors are optimistic, pessimistic, and least regret, among others. The most optimistic person I ever met was undoubtedly a young artist in Paris who, without a franc in his pocket, went into a swanky restaurant and ate dozens of oysters in hopes of finding a pearl to pay the bill. Optimist: The glass is half-full.Pessimist: The glass is half-empty.Manager: The glass is twice as large as it needs to be.Or, as in the follwoing metaphor of a captain in a rough sea: The pessimist complains about the wind;the optimist expects it to change;the realist adjusts the sails.Optimists are right; so are the pessimists. It is up to you to choose which you will be. The optimist sees opportunity in every problem; the pessimist sees problem in every opportunity.Both optimists and pessimists contribute to our society. The optimist invents the airplane and the pessimist the parachute.Whenever the decision maker has some knowledge regarding the states of nature, he/she may be able to assign subjective probability for the occurrence of each state of nature. By doing so, the problem is then classified as decision making under risk. In many cases, the decision-maker may need an expert's judgment to sharpen his/her uncertainties with respect to the likelihood of each state of nature. In such a case, the decision-maker may buy the expert's relevant knowledge in order to make a better decision. The procedure used to incorporate the expert's advice with the decision maker's probabilities assessment is known as the Bayesian approach. For example, in an investment decision-making situation, one is faced with the following question: What will the state of the economy be next year? Suppose we limit the possibilities to Growth (G), Same (S), or Decline (D). Then, a typical representation of our uncertainty could be depicted as follows: Further Readings:Howson C., and P. Urbach, Scientific Reasoning: The Bayesian Approach, Open Court Publ., Chicago, 1993. Gheorghe A., Decision Processes in Dynamic Probabilistic Systems, Kluwer Academic, 1990. Kouvelis P., and G. Yu, Robust Discrete Optimization and its Applications, Kluwer Academic Publishers, 1997. Provides a comprehensive discussion of motivation for sources of uncertainty in decision process, and a good discussion on minmax regret and its advantages over other criteria.Decision Making Under Pure Uncertainty In decision making under pure uncertainty, the decision-maker has no knowledge regarding any of the states of nature outcomes, and/or it is costly to obtain the needed information. In such cases, the decision making depends merely on the decision-maker's personality type. Personality Types and Decision Making: Pessimism, or Conservative (MaxMin). Worse case scenario. Bad things always happen to me. B 3 a) Write min # in each action row, S -2 b) Choose max # and do that action. D 7 * Optimism, or Aggressive (MaxMax). Good things always happen to me. B 12 a) Write max # in each action row, S 15 * b) Choose max # and do that action. D 7 Coefficient of Optimism (Hurwicz's Index), Middle of the road: I am neither too optimistic nor too pessimistic.a) Choose an a between 0 & 1, 1 means optimistic and 0 means pessimistic,b) Choose largest and smallest # for each action,c) Multiply largest payoff (row-wise) by a and the smallest by (1- a ),d) Pick action with largest sum.For example, for a = 0.7, we have B (.7*12) + (.3*3) = 9.3 S (.7*15) + .3*(-2) = 9.9 * D (.7*7) + (.3*7) = 7 Minimize Regret: (Savag's Opportunity Loss) I hate regrets and therefore I have to minimize my regrets. My decision should be made so that it is worth repeating. I should only do those things that I feel I could happily repeat. This reduces the chance that the outcome will make me feel regretful, or disappointed, or that it will be an unpleasant surprise. Regret is the payoff on what would have been the best decision in the circumstances minus the payoff for the actual decision in the circumstances. Therefore, the first step is to setup the regret table: a) Take the largest number in each states of nature column (say, L).b) Subtract all the numbers in that state of nature column from it (i.e. L - Xi,j).c) Choose maximum number of each action.d) Choose minimum number from step (d) and take that action. The Regret Matrix G MG NC L Bonds (15-12) (9-8) (7-7) (7-3) 4 * Stocks (15-15) (9-9) (7-5) (7+2) 9 Deposit (15-7) (9-7) (7-7) (7-7) 8 You may try checking your computations using Decision Making Under Pure Uncertainty JavaScript, and then performing some numerical experimentation for a deeper understanding of the concepts.Limitations of Decision Making under Pure Uncertainty Decision analysis in general assumes that the decision-maker faces a decision problem where he or she must choose at least and at most one option from a set of options. In some cases this limitation can be overcome by formulating the decision making under uncertainty as a zero-sum two-person game. In decision making under pure uncertainty, the decision-maker has no knowledge regarding which state of nature is "most likely" to happen. He or she is probabilistically ignorant concerning the state of nature therefore he or she cannot be optimistic or pessimistic. In such a case, the decision-maker invokes consideration of security. Notice that any technique used in decision making under pure uncertainties, is appropriate only for the private life decisions. Moreover, the public person (i.e., you, the manager) has to have some knowledge of the state of nature in order to predict the probabilities of the various states of nature. Otherwise, the decision-maker is not capable of making a reasonable and defensible decision. You might try to use Decision Making Under Uncertainty JavaScript E-lab for checking your computation, performing numerical experimentation for a deeper understanding, and stability analysis of your decision by altering the problem's parameters. Further Readings:Biswas T., Decision Making Under Uncertainty, St. Martin's Press, 1997. Driver M., K. Brousseau, and Ph. Hunsaker, The Dynamic Decisionmaker: Five Decision Styles for Executive and Business Success, Harper & Row, 1990. Eiser J., Attitudes and Decisions, Routledge, 1988.Flin R., et al., (Ed.), Decision Making Under Stress: Emerging Themes and Applications, Ashgate Pub., 1997. Ghemawat P., Commitment: The Dynamic of Strategy, Maxwell Macmillan Int., 1991. Goodwin P., and G. Wright, Decision Analysis for Management Judgment, Wiley, 1998. Decision Making Under Risk Risk implies a degree of uncertainty and an inability to fully control the outcomes or consequences of such an action. Risk or the elimination of risk is an effort that managers employ. However, in some instances the elimination of one risk may increase some other risks. Effective handling of a risk requires its assessment and its subsequent impact on the decision process. The decision process allows the decision-maker to evaluate alternative strategies prior to making any decision. The process is as follows: The problem is defined and all feasible alternatives are considered. The possible outcomes for each alternative are evaluated.Outcomes are discussed based on their monetary payoffs or net gain in reference to assets or time.Various uncertainties are quantified in terms of probabilities.The quality of the optimal strategy depends upon the quality of the judgments. The decision-maker should identify and examine the sensitivity of the optimal strategy with respect to the crucial factors. Whenever the decision maker has some knowledge regarding the states of nature, he/she may be able to assign subjective probability estimates for the occurrence of each state. In such cases, the problem is classified as decision making under risk. The decision-maker is able to assign probabilities based on the occurrence of the states of nature. The decision making under risk process is as follows:a) Use the information you have to assign your beliefs (called subjective probabilities) regarding each state of the nature, p(s),b) Each action has a payoff associated with each of the states of nature X(a,s),c) We compute the expected payoff, also called the return (R), for each action R(a) = Sums of [X(a,s) p(s)],d) We accept the principle that we should minimize (or maximize) the expected payoff, e) Execute the action which minimizes (or maximize) R(a). Expected Payoff: The actual outcome will not equal the expected value. What you get is not what you expect, i.e. the "Great Expectations!"a) For each action, multiply the probability and payoff and then,b) Add up the results by row,c) Choose largest number and take that action. G (0.4) MG (0.3) NC (0.2) L (0.1) Exp. Value B 0.4(12) + 0.3(8) + 0.2(7) + 0.1(3) = 8.9 S 0.4(15) + 0.3(9) + 0.2(5) + 0.1(-2) = 9.5* D 0.4(7) + 0.3(7) + 0.2(7) + 0.1(7) = 7 The Most Probable States of Nature (good for non-repetitive decisions)a) Take the state of nature with the highest probability (subjectively break any ties),b) In that column, choose action with greatest payoff.In our numerical example, there is a 40% chance of growth so we must buy stocks.Expected Opportunity Loss (EOL):a) Setup a loss payoff matrix by taking largest number in each state of nature column(say L), and subtract all numbers in that column from it, L - Xij,b) For each action, multiply the probability and loss then add up for each action,c) Choose the action with smallest EOL. Loss Payoff Matrix G (0.4) MG (0.3) NC (0.2) L (0.1) EOL B 0.4(15-12) + 0.3(9-8) + 0.2(7-7) + 0.1(7-3) 1.9 S 0.4(15-15) + 0.3(9-9) + 0.2(7-5) + 0.1(7+2) 1.3* D 0.4(15-7) + 0.3(9-7) + 0.2(7-7) + 0.1(7-7) 3.8 Computation of the Expected Value of Perfect Information (EVPI)EVPI helps to determine the worth of an insider who possesses perfect information. Recall that EVPI = EOL.a) Take the maximum payoff for each state of nature,b) Multiply each case by the probability for that state of nature and then add them up,c) Subtract the expected payoff from the number obtained in step (b) G 15(0.4) = 6.0 MG 9(0.3) = 2.7 NC 7(0.2) = 1.4 L 7(0.1) = 0.7 + ---------- 10.8 Therefore, EVPI = 10.8 - Expected Payoff = 10.8 - 9.5 = 1.3. Verify that EOL=EVPI.The efficiency of the perfect information is defined as 100 [EVPI/(Expected Payoff)]%Therefore, if the information costs more than 1.3% of investment, don't buy it. For example, if you are going to invest $100,000, the maximum you should pay for the information is [100,000 * (1.3%)] = $1,300I Know Nothing: (the Laplace equal likelihood principle) Every state of nature has an equal likelihood. Since I don't know anything about the nature, every state of nature is equally likely to occur:a) For each state of nature, use an equal probability (i.e., a Flat Probability),b) Multiply each number by the probability,c) Add action rows and put the sum in the Expected Payoff column,d) Choose largest number in step (c) and perform that action. G MG NC L Exp. Payoff Bonds 0.25(12) 0.25(8) 0.25(7) 0.25(3) 7.5 * Stocks 0.25(15) 0.25(9) 0.25(5) 0.25(-2) 6.75 Deposit 0.25(7) 0.25(7) 0.25(7) 0.25(7) 7 A Discussion on Expected Opportunity Loss (Expected Regret): Comparing a decision outcome to its alternatives appears to be an important component of decision-making. One important factor is the emotion of regret. This occurs when a decision outcome is compared to the outcome that would have taken place had a different decision been made. This is in contrast to disappointment, which results from comparing one outcome to another as a result of the same decision. Accordingly, large contrasts with counterfactual results have a disproportionate influence on decision making.Regret results compare a decision outcome with what might have been. Therefore, it depends upon the feedback available to decision makers as to which outcome the alternative option would have yielded. Altering the potential for regret by manipulating uncertainty resolution reveals that the decision-making behavior that appears to be risk averse can actually be attributed to regret aversion.There is some indication that regret may be related to the distinction between acts and omissions. Some studies have found that regret is more intense following an action, than an omission. For example, in one study, participants concluded that a decision maker who switched stock funds from one company to another and lost money, would feel more regret than another decision maker who decided against switching the stock funds but also lost money. People usually assigned a higher value to an inferior outcome when it resulted from an act rather than from an omission. Presumably, this is as a way of counteracting the regret that could have resulted from the act. You might like to use Making Risky Decisions JavaScript E-lab for checking your computation, performing numerical experimentation for a deeper understanding, and stability analysis of your decision by altering the problem's parameters. Further Readings:Beroggi G., Decision Modeling in Policy Management: An Introduction to the Analytic Concepts, Boston, Kluwer Academic Publishers, 1999. George Ch., Decision Making Under Uncertainty: An Applied Statistics Approach, Praeger Pub., 1991.Rowe W., An Anatomy of Risk, R.E. Krieger Pub. Co., 1988. Suijs J., Cooperative Decision-Making Under Risk, Kluwer Academic, 1999. Making a Better Decision by Buying Reliable Information (Bayesian Approach) In many cases, the decision-maker may need an expert's judgment to sharpen his/her uncertainties with respect to the probable likelihood of each state of nature. For example, consider the following decision problem a company is facing concerning the development of a new product: States of Nature High Sales Med. Sales Low Sales A(0.2) B(0.5) C(0.3) A1 (develop) 3000 2000 -6000 A2 (don't develop) 0 0 0 The probabilities of the states of nature represent the decision-maker's (e.g. manager) degree of uncertainties and personal judgment on the occurrence of each state. We will refer to these subjective probability assessments as 'prior' probabilities.The expected payoff for each action is: A1= 0.2(3000) + 0.5(2000) + 0.3(-6000)= $ -200 and A2= 0; so the company chooses A2 because of the expected loss associated with A1, and decides not to develop.However, the manager is hesitant about this decision. Based on "nothing ventured, nothing gained" the company is thinking about seeking help from a marketing research firm. The marketing research firm will assess the size of the product's market by means of a survey. Now the manager is faced with a new decision to make; which marketing research company should he/she consult? The manager has to make a decision as to how 'reliable' the consulting firm is. By sampling and then reviewing the past performance of the consultant, we can develop the following reliability matrix: 1. Given What Actually Happened in the Past A B C 2. What the Ap 0.8 0.1 0.1 Consultant Bp 0.1 0.9 0.2 Predicted Cp 0.1 0.0 0.7 All marketing research firms keep records (i.e., historical data) of the performance of their past predictions. These records are available to their clients free of charge. To construct a reliability matrix, you must consider the marketing research firm's performance records for similar products with high sales. Then, find the percentage of which products the marketing research firm correctly predicted would have high sales (A), medium sales (B), and little (C) or almost no sales. Their percentages are presented by P(Ap|A) = 0.8, P(Bp|A) = 0.1, P(Cp|A) = 0.1, in the first column of the above table, respectively. Similar analysis should be conducted to construct the remaining columns of the reliability matrix. Note that for consistency, the entries in each column of the above reliability matrix should add up to one. While this matrix provides the conditional probabilities such as P(Ap|A) = 0.8, the important information the company needs is the reverse form of these conditional probabilities. In this example, what is the numerical value of P(A|Ap)? That is, what is the chance that the marketing firm predicts A is going to happen, and A actually will happen? This important information can be obtained by applying the Bayes Law (from your probability and statistics course) as follows: a) Take probabilities and multiply them "down" in the above matrix, b) Add the rows across to get the sum,c) Normalize the values (i.e. making probabilities adding up to 1) by dividing each column number by the sum of the row found in Step b, 0.2 0.5 0.3 A B C SUM 02(0.8) = 0.16 0.5(0.1) = 0.05 0.3(0.1) = 0.03 0.24 0.2(0.1) = 0.02 0.5(0.9) = 0.45 0.3(0.2) = 0.06 0.53 0.2(0.1) = 0.02 0.5(0) = 0 0.3(0.7) = 0.21 0.23 A B C (.16/.24)=.667 (.05/.24)=.208 (.03/.24)=.125 (.02/.53)=.038 (0.45/.53)=.849 (.06/.53)=.113 (.02/.23)=.087 (0/.23)=0 (0.21/.23)=.913 You might like to use Computational Aspect of Bayse' Revised Probability JavaScript E-lab for checking your computation, performing numerical experimentation for a deeper understanding, and stability analysis of your decision by altering the problem's parameters. d) Draw the decision tree. Many managerial problems, such as this example, involve a sequence of decisions. When a decision situation requires a series of decisions, the payoff table cannot accommodate the multiple layers of decision-making. Thus, a decision tree is needed.Do not gather useless information that cannot change a decision: A question for you: In a game a player is presented two envelopes containing money. He is told that one envelope contains twice as much money as the other envelope, but he does not know which one contains the larger amount. The player then may pick one envelope at will, and after he has made a decision, he is offered to exchange his envelope with the other envelope.If the player is allowed to see what's inside the envelope he has selected at first, should the player swap, that is, exchange the envelopes? The outcome of a good decision may not be good, therefor one must not confuse the quality of the outcome with the quality of the decision. As Seneca put it "When the words are clear, then the thought will be also".Decision Tree and Influence Diagram Decision Tree Approach: A decision tree is a chronological representation of the decision process. It utilizes a network of two types of nodes: decision (choice) nodes (represented by square shapes), and states of nature (chance) nodes (represented by circles). Construct a decision tree utilizing the logic of the problem. For the chance nodes, ensure that the probabilities along any outgoing branch sum to one. Calculate the expected payoffs by rolling the tree backward (i.e., starting at the right and working toward the left). You may imagine driving your car; starting at the foot of the decision tree and moving to the right along the branches. At each square you have control, to make a decision and then turn the wheel of your car. At each circle, Lady Fortuna takes over the wheel and you are powerless. Here is a step-by-step description of how to build a decision tree:Draw the decision tree using squares to represent decisions and circles to represent uncertainty,Evaluate the decision tree to make sure all possible outcomes are included,Calculate the tree values working from the right side back to the left, Calculate the values of uncertain outcome nodes by multiplying the value of the outcomes by their probability (i.e., expected values).On the tree, the value of a node can be calculated when we have the values for all the nodes following it. The value for a choice node is the largest value of all nodes immediately following it. The value of a chance node is the expected value of the nodes following that node, using the probability of the arcs. By rolling the tree backward, from its branches toward its root, you can compute the value of all nodes including the root of the tree. Putting these numerical results on the decision tree results in the following graph: A Typical Decision TreeClick on the image to enlarge it Determine the best decision for the tree by starting at its root and going forward. Based on proceeding decision tree, our decision is as follows:Hire the consultant, and then wait for the consultant's report.If the report predicts either high or medium sales, then go ahead and manufacture the product.Otherwise, do not manufacture the product.Check the consultant's efficiency rate by computing the following ratio: (Expected payoff using consultant dollars amount) / EVPI. Using the decision tree, the expected payoff if we hire the consultant is: EP = 1000 - 500 = 500, EVPI = .2(3000) + .5(2000) + .3(0) = 1600. Therefore, the efficiency of this consultant is: 500/1600 = 31%If the manager wishes to rely solely on the marketing research firm's recommendations, then we assign flat prior probability [as opposed to (0.2, 0.5, 0.3) used in our numerical example].Clearly the manufacturer is concerned with measuring the risk of the above decision, based on decision tree.Coefficient of Variation as Risk Measuring Tool and Decision Procedure: Based on the above decision, and its decision-tree, one might develop a coefficient of variation (C.V) risk-tree, as depicted below: Coefficient of Variation as a Risk Measuring Tool and Decision ProcedureClick on the image to enlarge it Notice that the above risk-tree is extracted from the decision tree, with C.V. numerical value at the nodes relevant to the recommended decision. For example the consultant fee is already subtracted from the payoffs. From the above risk-tree, we notice that this consulting firm is likely (with probability 0.53) to recommend Bp (a medium sales), and if you decide to manufacture the product then the resulting coefficient of variation is very high (403%), compared with the other branch of the tree (i.e., 251%).Clearly one must not consider only one consulting firm, rather one must consider several potential consulting during decision-making planning stage. The risk decision tree then is a necessary tool to construct for each consulting firm in order to measure and compare to arrive at the final decision for implementation. The Impact of Prior Probability and Reliability Matrix on Your Decision: To study how important your prior knowledge and/or the accuracy of the expected information from the consultant in your decision our numerical example, I suggest redoing the above numerical example in performing some numerical sensitivity analysis. You may start with the following extreme and interesting cases by using this JavaScript for the needed computation:Consider a flat prior, without changing the reliability matrix.Consider a perfect reliability matrix (i.e., with an identity matrix), without changing the prior.Consider a perfect prior, without changing the reliability matrix.Consider a flat reliability matrix (i.e., with all equal elements), without changing the prior.Consider the consultant prediction probabilities as your own prior, without changing the reliability matrix.Influence diagrams: As can be seen in the decision tree examples, the branch and node description of sequential decision problems often become very complicated. At times it is downright difficult to draw the tree in such a manner that preserves the relationships that actually drive the decision. The need to maintain validation, and the rapid increase in complexity that often arises from the liberal use of recursive structures, have rendered the decision process difficult to describe to others. The reason for this complexity is that the actual computational mechanism used to analyze the tree, is embodied directly within the trees and branches. The probabilities and values required to calculate the expected value of the following branch are explicitly defined at each node. Influence diagrams are also used for the development of decision models and as an alternate graphical representations of decision trees. The following figure depicts an influence diagram for our numerical example. In the influence diagram above, the decision nodes and chance nodes are similarly illustrated with squares and circles. Arcs (arrows) imply relationships, including probabilistic ones.Finally, decision tree and influence diagram provide effective methods of decision-making because they:Clearly lay out the problem so that all options can be challenged Allow us to analyze fully the possible consequences of a decision Provide a framework to quantify the values of outcomes and the probabilities of achieving them Help us to make the best decisions on the basis of existing information and best guessesVisit also:Decision Theory and Decision TreesFurther ReadingsBazerman M., Judgment in Managerial Decision Making, Wiley, 1993.Connolly T., H. Arkes, and K. Hammond (eds), Judgment and Decision Making: An Interdisciplinary Reader, Cambridge University Press, 2000. Cooke R., Experts in Uncertainty, Oxford Univ Press, 1991. Describes much of the history of the expert judgment problem. It also includes many of the methods that have been suggested to do numerical combination of expert uncertainties. Furthermore, it promotes a method that has been used extensively by us and many others, in which experts are given a weighting that judge their performance on calibration questions. This is a good way of getting around the problem of assessing the "quality" of an expert, and lends a degree of objectivity to the results that is not obtained by other methods.Bouyssou D., et al., Evaluation and Decision Models: A Critical Perspective, Kluwer Academic Pub, 2000. Daellenbach H., Systems and Decision Making: A Management Science Approach, Wiley, 1994.Goodwin P., and G. Wright, Decision Analysis for Management Judgment, Wiley, 1998.Klein D., Decision-Analytic Intelligent Systems: Automated Explanation and Knowledge Acquisition, Lawrence Erlbaum Pub., 1994. Thierauf R., Creative Computer Software for Strategic Thinking and Decision Making: A Guide for Senior Management and MIS Professionals, Quorum Books, 1993. Why Managers Seek the Advice From Consulting Firms Managers pay consultants to provide advisory service work that falls into one of the following categories: Work they are not -- or feel they are not Â— competent to do themselves.Work they do not want to do themselves.Work they do not have time to do themselves.All such work falls under the broad umbrella of consulting service. Regardless of why managers pay others to advise them, they typically have high expectations concerning the quality of the recommendations, measured in terms of reliability and cost. However, the manager is solely responsible for the final decision he/she is making and not the consultants.The following figure depicts the process of the optimal information determination. For more details, read the Cost/Benefit Analysis.The Determination of the Optimal InformationDeciding about the Consulting Firm: Each time you are thinking of hiring a consultant you may face the danger of looking foolish, not to mention losing thousands or even millions of dollars. To make matters worse, most of the consulting industry's tried-and-true firms have recently merged, split, disappeared, reappeared, or reconfigured at least once. How can you be sure to choose the right consultants?Test the consultant's knowledge of your product. It is imperative to find out the depth of a prospective consultant's knowledge about your particular product and its potential market.Ask the consultant to provide a generic project plan, task list, or other documentation about your product.Is there an approved budget and duration?What potential customers' involvement is expected?Who is expected to provide the final advice and provide sign-off?Even the best consultants are likely to have some less-than-successful moments in their work history. Conducting the reliability analysis process is essential. Ask specific questions about the consultants' past projects, proud moments, and failed efforts. Of course it's important to check a potential consultant's references. Ask for specific referrals from as many previous clients or firms with similar businesses to yours. Get a clearly written contract, accurate cost estimates, the survey statistical sample size, and the commitment on the completion and written advice on time.Further ReadingHoltz H., The Complete Guide to Consulting Contracts: How to Understand, Draft, and Negotiate Contracts and Agreements that Work, Dearborn Trade, 1997.Weinberg G., Secrets of Consulting: A Guide to Giving and Getting Advice Successfully, Dorset House, 1986. Revising Your Expectation and its Risk In our example, we saw how to make decision based on objective payoff matrix by computing the expected value and the risk expressed as coefficient of variation as our decision criteria. While, an informed decision-maker might be able to construct his/her subjective payoff matrix, and then following the same decision process, however, in many situations it becomes necessary to combine the two.Application: Suppose the following information is available from two independent sources: Revising the Expected Value and the Variance Estimate SourceExpected value Variance Sales managerm1 = 110s12 = 100 Market surveym2 = 70s22 = 49 The combined expected value is:[m1/s12 + m2/s22 ] / [1/s12 + 1/s22]The combined variance is:2 / [1/s12 + 1/s22]For our application, using the above tabular information, the combined estimate of expected sales is 83.15 units with combined variance of 65.77, having 9.6% risk value.You may like using Revising the Mean and Variance JavaScript to performing some numerical experimentation. You may apply it for validating the above example and for a deeper understanding of the concept where more than 2-sources of information are to be combined.Determination of the Decision-Maker's Utility Function We have worked with payoff tables expressed in terms of expected monetary value. Expected monetary value, however, is not always the best criterion to use in decision making. The value of money varies from situation to situation and from one decision maker to another. Generally, too, the value of money is not a linear function of the amount of money. In such situations, the analyst should determine the decision-maker's utility for money and select the alternative course of action that yields the highest expected utility, rather than the highest expected monetary value.Individuals pay insurance premiums to avoid the possibility of financial loss associated with an undesirable event occurring. However, utilities of different outcomes are not directly proportional to their monetary consequences. If the loss is considered to be relatively large, an individual is more likely to opt to pay an associated premium. If an individual considers the loss inconsequential, it is less likely the individual will choose to pay the associated premium. Individuals differ in their attitudes towards risk and these differences will influence their choices. Therefore, individuals should make the same decision each time relative to the perceived risk in similar situations. This does not mean that all individuals would assess the same amount of risk to similar situations. Further, due to the financial stability of an individual, two individuals facing the same situation may react differently but still behave rationally. An individual's differences of opinion and interpretation of policies can also produce differences.The expected monetary reward associated with various decisions may be unreasonable for the following two important reasons:1. Dollar value may not truly express the personal value of the outcome. This is what motivates some people to play the lottery for $1. 2. Expected monetary values may not accurately reflect risk aversion. For example, suppose you have a choice of between getting $10 dollars for doing nothing, or participating in a gamble. The gamble's outcome depends on the toss of a fair coin. If the coin comes up heads, you get $1000. However, if it is tails, you take a $950 loss.The first alternative has an expected reward of $10, the second has an expected reward of 0.5(1000) + 0.5(- 950) = $25. Clearly, the second choice is preferred to the first if expected monetary reward were a reasonable criterion. But, you may prefer a sure $10 to running the risk of losing $950. Why do some people buy insurance and others do not? The decision-making process involves psychological and economical factors, among others. The utility concept is an attempt to measure the usefulness of money for the individual decision maker. It is measured in 'Utile'. The utility concept enables us to explain why, for example, some people buy one dollar lotto tickets to win a million dollars. For these people 1,000,000 ($1) is less than ($1,000,000). These people value the chance to win $1,000,000 more than the value of the $1 to play. Therefore, in order to make a sound decision considering the decision-maker's attitude towards risk, one must translate the monetary payoff matrix into the utility matrix. The main question is: how do we measure the utility function for a specific decision maker?Consider our Investment Decision Problem. What would the utility of $12 be?a) Assign 100 utils and zero utils to the largest and smallest ($) payoff, respectively in the payoff matrix. For our numerical example, we assign 100 utils to 15, and 0 utils to -2,b) Ask the decision maker to choose between the following two scenarios:1) Get $12 for doing nothing (called, the certainty equivalent, the difference between a decision maker's certainty equivalent and the expected monetary value is called the risk premium.) OR2) Play the following game: win $15 with probability (p) OR -$2 with probability (1-p), where p is a selected number between 0 and 1. By changing the value of p and repeating a similar question, there exists a value for p at which the decision maker is indifferent between the two scenarios. Say, p = 0.58.c) Now, the utility for $12 is equal to 0.58(100) + (1-0.58)(0) = 58. d) Repeat the same process to find the utilities for each element of the payoff matrix. Suppose we find the following utility matrix: Monetary Payoff Matrix Utility Payoff Matrix A B C D A B C D 12 8 7 3 58 28 20 13 15 9 5 -2 100 30 18 0 7 7 7 7 20 20 20 20 At this point, you may apply any of the previously discussed techniques to this utility matrix (instead of monetary) in order to make a satisfactory decision. Clearly, the decision could be different.Notice that any technique used in decision making with utility matrix is indeed very subjective; therefore it is more appropriate only for the private life decisions. You may like to check your computations using Determination of Utility Function JavaScript, and then perform some numerical experimentation for a deeper understanding of the concepts.Utility Function Representations with Applications Introduction: A utility function transforms the usefulness of an outcome into a numerical value that measures the personal worth of the outcome. The utility of an outcome may be scaled between 0, and 100, as we did in our numerical example, converting the monetary matrix into the utility matrix . This utility function may be a simple table, a smooth continuously increasing graph, or a mathematical expression of the graph.The aim is to represent the functional relationship between the entries of monetary matrix and the utility matrix outcome obtained earlier. You may ask what is a function? What is a function? A function is a thing that does something. For example, a coffee grinding machine is a function that transforms the coffee beans into powder. A utility function translates (converts) the input domain (monetary values) into output range, with the two end-values of 0 and 100 utiles. In other words, a utility function determines the degrees of the decision-maker sensible preferences.This chapter presents a general process for determining utility function. The presentation is in the context of the previous chapter's numerical results, although there are repeated data therein. Utility Function Representations with Applications: There are three different methods of representing a function: The Tabular, Graphical, and Mathematical representation. The selection of one method over another depends on the mathematical skill of the decision-maker to understand and use it easily. The three methods are evolutionary in their construction process, respectively; therefore, one may proceed to the next method if needed. The utility function is often used to predict the utility of the decision-maker for a given monetary value. The prediction scope and precision increases form the tabular method to the mathematical method. Tabular Representation of the Utility Function: We can tabulate the pair of data (D, U) using the entries of the matrix representing the monetary values (D) and their corresponding utiles (U) from the utility matrix obtained already. The Tabular Form of the utility function for our numerical example is given by the following paired (D, U) table:Utility Function (U) of the Monetary Variable (D) in Tabular Form D 12 8 7 3 15 9 5 -2 7 7 7 7 U 58 28 20 13 100 30 18 0 20 20 20 20 Tabular Representation of the Utility Function for the Numerical ExampleAs you see, the tabular representation is limited to the numerical values within the table. Suppose one wishes to obtain the utility of a dollar value, say $10. One may apply an interpolation method: however since the utility function is almost always non-linear; the interpolated result does not represent the utility of the decision maker accurately. To overcome this difficulty, one may use the graphical method.Graphical Representation of the Utility Function: We can draw a curve using a scatter diagram obtained by plotting the Tabular Form on a graph paper. Having the scatter diagram, first we need to decide on the shape of the utility function. The utility graph is characterized by its properties of being smooth, continuous, and an increasing curve. Often a parabola shape function fits well for relatively narrow domain values of D variable. For wider domains, one may fit few piece-wise parabola functions, one for each appropriate sub-domain. For our numerical example, the following is a graph of the function over the interval used in modeling the utility function, plotted with its associated utility (U-axis) and the associated Dollar values (D-axis). Note that in the scatter diagram the multiple points are depicted by small circles. Graphical Representation of the Utility Function for the Numerical ExampleThe graphical representation has a big advantage over the tabular representation in that one may read the utility of dollar values say $10, directly from the graph, as shown on the above graph, for our numerical example. The result is U = 40, approximately. Reading a value from a graph is not convenient; therefore, for prediction proposes, a mathematical model serves best. Mathematical Representation of the Utility Function: We can construct a mathematical model for the utility function using the shape of utility function obtained by its representation by Graphical Method. Often a parabola shape function fits well for relatively narrow domain values of D variable. For wider domains, one may fit a few piece-wise parabola functions, one for each appropriate sub-domain. We know that we want a quadratic function that best fits the scatter diagram that has already been constructed. Therefore, we use a regression analysis to estimate the coefficients in the function that is the best fit to the pairs of data (D, U).Parabola models: Parabola regressions have three coefficients with a general form: U = a + bD + cD2,wherec = { S (Di - Dbar)2Ã—Ui - n[S(Di - Dbar)2Ã— SUi]} / {n S(Di - Dbar)4 - [S(Di - Dbar)2] 2}b = [S(Di- Dbar) Ui]/[ S(Di - Dbar)2] - 2Ã—cÃ—Dbar a = {SUi - [cÃ— S(D i - Dbar) 2)}/n - (cÃ—DbarÃ—Dbar + bÃ—Dbar),where Dbar is the mean of Di's.For our numerical example i = 1, 2,..., 12. By evaluating these coefficients using the information given in tabular form section, the "best" fit is characterized by its coefficients estimated values: c = 0.291, b = 1.323, and a = 0.227. The result is; therefore, a utility function approximated by the following quadratic function:U = 0.291D2 + 1.323D + 0.227, for all D such that -2 Â£ D Â£ 15. The above mathematical representation provides more useful information than the other two methods. For example, by taking the derivative of the function provides the marginal value of the utility; i.e.,Marginal Utility = 1.323 + 0.582D, for all D such that -2 2b1af7f3a8

__https://sway.office.com/XgOffzBmqIdxnExx__

__https://sway.office.com/nkwlBD5X0fmABgGX__

__https://sway.office.com/GYiVqW3oeIHPOBv6__

__https://sway.office.com/PTxr5iPLQYdHTZfT__

__https://sway.office.com/b2Oeszeg9sswDjc2__

__https://sway.office.com/FwAXcjFIcgoYVoBt__

__https://sway.office.com/dV2IxHi5W2c8zEDJ__

__https://sway.office.com/iYndubM3mTAKMCJs__

__https://sway.office.com/Jd8nNHQ0jzChsxy8__

__https://sway.office.com/vbRdhsiSlHtXdEQm__

__https://sway.office.com/Orr48X1m7HVZcTOa__

__https://sway.office.com/LhLR8SGNRiGOhaex__

__https://sway.office.com/hF8EWfS1esBAbeEz__

__https://sway.office.com/JreQQHzGTiGLrlAq__

__https://sway.office.com/Oaly8rdBaSB6sb8T__

__https://sway.office.com/Tfxv3dmYqaKrMy6l__

__https://sway.office.com/IkBZjmARCk7w5HyH__

__https://sway.office.com/MEA2zvee8QbfElG4__

__https://sway.office.com/qfhV7tzukqKXxFkC__

__https://sway.office.com/ZEzRjeP9bNKtXob2__

__https://sway.office.com/GM6GqCCPexoqvOT6__

__https://sway.office.com/1bUG1oPnxwLtoq08__

__https://sway.office.com/7TiC9QwR8H53GS0Q__

__https://sway.office.com/pdAXn0JTQxj9swmT__

__https://sway.office.com/yXpeHH07QGUBuDob__

__https://sway.office.com/VpEKC3wwThDyIiEc__

__https://sway.office.com/msXgRrI2gXIyzNR3__

__https://sway.office.com/xi0rGdPlfG64BCAQ__

__https://sway.office.com/9DF0dR2yZjlS1AwO__

__https://sway.office.com/HX3oNH5g1yQgCJng__

__https://sway.office.com/lENjsKoLP16Z0HWd__

__https://sway.office.com/YrpqHKmP86nAKLrE__

__https://sway.office.com/6JIvbYNplmGM1q2e__

__https://sway.office.com/qAtlKrdnZkDkIHgV__

__https://sway.office.com/zQRMBHnw5xPCk7zc__

__https://sway.office.com/OBpN7vw0UCVw9BAm__

__https://sway.office.com/DoJqu5IErN0Kyn1w__

__https://sway.office.com/TT5FKi7NQwRJFiuf__

__https://sway.office.com/Lu9Hzmeet3DsRo7i__

__https://sway.office.com/63gaTfdNzPSoeXDF__

__https://sway.office.com/vJV5xCi0udAlqN9h__

__https://sway.office.com/sCXN1DbAJyXlMira__

__https://sway.office.com/m0Z9mAnbgPdc84xa__

__https://sway.office.com/9AqTVlFyHADpAe9I__

__https://sway.office.com/AwzHSVcczd4SBCVo__

__https://sway.office.com/yKXzxAr8EqK1RnAT__

__https://sway.office.com/UmqsAUC950rMWXjE__

__https://sway.office.com/yIsITeRMTfG1poOE__

__https://sway.office.com/HrLvs43QBLD24Rhp__

__https://sway.office.com/DfYPSF6eqp2f0Yyt__

__https://sway.office.com/ozdPjmD26NMILkJO__

__https://sway.office.com/gmJxbZU7E7UX8IE0__

__https://sway.office.com/jW1kjo12oo4TYxjB__

__https://sway.office.com/jxIFGXibDAHHtqPn__

__https://sway.office.com/Vu93mCvARGY52BF8__

__https://sway.office.com/5org6vzm6VFz9zGh__

__https://sway.office.com/vKNbHkJicojFqp9g__

__https://sway.office.com/AEQMGSQUI6InvDoK__

__https://sway.office.com/NNh8DUbi6EWZWMmY__

__https://sway.office.com/k4ECEDUGkebEfEVE__

__https://sway.office.com/LaPyUlEBvPuuq5ml__

__https://sway.office.com/6Wumdw7R0IIVQ7dB__

__https://sway.office.com/oGJ8CGi0TSbXNjFU__

__https://sway.office.com/6oj6H81Wk6DRkFl1__

__https://sway.office.com/haKUeVjZS8jFRMjz__

__https://sway.office.com/cArR47FtsBlUqMtO__

__https://sway.office.com/ZWUCy7MIFe4TgzkT__

__https://sway.office.com/yNUCI6FJ9hkHojQO__

__https://sway.office.com/CeUDifefcA26FvT6__

__https://sway.office.com/YwzGe4vQX2eu2aUI__

__https://sway.office.com/CwpArGWLl9htIFdX__

__https://sway.office.com/AdXBzHRVyBdqCWm4__

__https://sway.office.com/LFEeS1odRRi7ZFyB__

__https://sway.office.com/okPkOnC75TwfYicL__

__https://sway.office.com/2sqpNYOdyIpyAh6s__

__https://sway.office.com/RBBfT0rXwF27f1xD__

__https://sway.office.com/mvH4HQGXfJH2gLEw__

__https://sway.office.com/GL0QMFHPb7Vwy7fT__

__https://sway.office.com/cdkxhOQp5axoy6pe__

__https://sway.office.com/RJK4zZZtzXPxs2Ci__

__https://sway.office.com/3rR3qlA3PCdtTjFa__

__https://sway.office.com/OJqFAH4CvuZEmpsm__

__https://sway.office.com/dtYjlW3F1xqn3Whb__

__https://sway.office.com/Ht5FA3ol3rDEK2FA__

__https://sway.office.com/YxxkjC0rQawq7T2B__

__https://sway.office.com/c7g57ccWz4CVC0D1__

__https://sway.office.com/7p0Ofkwvsp7Qa14d__

__https://sway.office.com/D158sO6mnme5vxBZ__

__https://sway.office.com/RhlvvdLgUYd8Oxt5__

__https://sway.office.com/s9cWKmwBvY7boGi1__

__https://sway.office.com/IC6IkhjcZwP1hwhM__

__https://sway.office.com/d7CQi2Hj5O6GOCtm__

__https://sway.office.com/5A8ACafWP9I69psn__

__https://sway.office.com/JW75Y7wTjTyG3e18__

__https://sway.office.com/QQHw4LwRHzu2gAlX__

__https://sway.office.com/Aoh8Z4PMQPfedlBe__

__https://sway.office.com/1PecYuOZQmLqHC7u__

__https://sway.office.com/NVf9VVA5J4IZEton__

__https://sway.office.com/q7FREuCI1NhVtsQi__

__https://sway.office.com/qi75ZSnO9wQpKNRy__

__https://sway.office.com/eLfoajbbempkT9VU__

__https://sway.office.com/pAcVQ2v5riri4aTp__

__https://sway.office.com/9PDcBqqtAVlcwZhg__

__https://sway.office.com/WL6uFzS6WKNUBjUi__

__https://sway.office.com/SvuDQ8Q09UlyaAvh__

__https://sway.office.com/lO5cSTEG3r52EbJ1__

__https://sway.office.com/2FE2X506NlnUSIU9__

__https://sway.office.com/cXAtH2gnL0XFPmiB__

__https://sway.office.com/pDuNpQ1imQKEjuaa__

__https://sway.office.com/3EsbZg81Q4IBdcWN__

__https://sway.office.com/pBNQhSoVmX0YfLOv__

__https://sway.office.com/Hloc5rVPHFH9QMNz__

__https://sway.office.com/gdM4m9mX3jTNqvqz__

__https://sway.office.com/2Q8lVX5BfL4AZ2jG__

__https://sway.office.com/mE4rxRAsnDtn40ye__

__https://sway.office.com/wxFFyLiBJ7dnWRoy__

__https://sway.office.com/654ZUQOQYMDVzx2l__

__https://sway.office.com/DMuYdCslRnVqEmSF__

__https://sway.office.com/Hl9iclp2RLX5AEzy__

__https://sway.office.com/WlEBN52Kavxeevjc__

__https://sway.office.com/ajZWiOO1F1o5fMOy__

__https://sway.office.com/RyI2yVzp4hadUWGe__

__https://sway.office.com/qgGaCHYmv8nLAKp4__

__https://sway.office.com/Z8wBPnBgmULSWQ3A__

__https://sway.office.com/yM3tODzLkVGfwg09__

__https://sway.office.com/I0ZoUGk3kYXtsOy1__

__https://sway.office.com/1jMfRAbPsvzOMF9h__

__https://sway.office.com/NtusH0EvXUmfMU3N__

__https://sway.office.com/rGJOKoDH1OVcqzBn__

__https://sway.office.com/RDU8DJhdkzT2Cm0N__

__https://sway.office.com/dav4LsRVZsH98FT0__

__https://sway.office.com/CjiZNpfMeyjBLCEx__

__https://sway.office.com/59EBQSBdcjznTzym__

__https://sway.office.com/w7BIi1HTAWdBPxha__

__https://sway.office.com/cxGyHcwigmGemE06__

__https://sway.office.com/CimDC4kHnXOYliDX__

__https://sway.office.com/PfEmxWlCGyOTps4S__

__https://sway.office.com/P52O7SKfiWpSo6UY__

__https://sway.office.com/AVV24MYgbijeMJjK__

__https://sway.office.com/qGmS9AtZWSPlQ1rH__

__https://sway.office.com/TKU2rteV2dM9jQXU__

__https://sway.office.com/GkNZrt1DvUdge2H1__

__https://sway.office.com/Den62tam3atSapjU__

__https://sway.office.com/ylGaR6XmE9M3KTzr__

__https://sway.office.com/v7QVECgdIr8UqUBm__

__https://sway.office.com/6evoBFFo4nzui3Ef__

__https://sway.office.com/iRb842QLuqbyfwi4__

__https://sway.office.com/vHXXpqayy972hO0x__

__https://sway.office.com/V8XGw7I2zBQ3AUsy__

__https://sway.office.com/iPsjqQxMzJV2Qrkf__

__https://sway.office.com/HzgqsE4MSjuZh5zq__

__https://sway.office.com/xXxNGuNp9NWFC3WX__

__https://sway.office.com/Wz1zsfHlshAsRZ59__

__https://sway.office.com/mjWwSkiyEhQXCqv3__

__https://sway.office.com/bDtqWmvr8aO0m8DI__

__https://sway.office.com/7ZfVc4GlhmzAwrRV__

__https://sway.office.com/KTLYB4bpOn37nXPm__

__https://sway.office.com/z8uRM9RPRHhAj8jq__

__https://sway.office.com/yMFD0NbUUyaLCB9B__

__https://sway.office.com/MH4z0857raIPB7NY__

__https://sway.office.com/5ZDEWaHmQBDrnlJD__

__https://sway.office.com/qrlXer5M6PHnjkPQ__

__https://sway.office.com/FWpYTh5Iqt7R0sxd__

__https://sway.office.com/aq1XemtXFxQt8MWn__

__https://sway.office.com/hdLiMla5tWFFn7qW__

__https://sway.office.com/b2HTfCQthJcDCGNs__

__https://sway.office.com/exTtpHfOtr6a5jXy__

__https://sway.office.com/9h5ZAbhUfWSsjXZf__

__https://sway.office.com/XSg27UJ5AUTAeNU1__

__https://sway.office.com/kCAQH5azHT4q71Bw__

__https://sway.office.com/lW2syGFHNJ46HqE9__

__https://sway.office.com/v9RmYqBIhRz27e7K__

__https://sway.office.com/yFeHi0naPTo3dXMm__

__https://sway.office.com/uBR4Y0R5c5R1EDlJ__

__https://sway.office.com/jG2G7KgypyhNEk5V__

__https://sway.office.com/AdNrSwnpK3mm1VGJ__

__https://sway.office.com/Z5TlNbLwbuhcEEPs__

__https://sway.office.com/dvZGZwWQ3plp7sK7__

__https://sway.office.com/j8R3pzZixaMQcvyk__

__https://sway.office.com/vtK4bTOVLKswJAdv__

__https://sway.office.com/6T0hQ8QqAGEYyAjN__

__https://sway.office.com/JUF1wCFbxM6b6T6W__

__https://sway.office.com/H2bJGLPK7oSPQifT__

__https://sway.office.com/AQfQTnvvBdaxkgd5__

__https://sway.office.com/0j9tZFbzdOh4s3xA__

__https://sway.office.com/ij0YiRFQXGdogFxw__

__https://sway.office.com/xzx0PVK05tBq5QB4__

__https://sway.office.com/Ljen8y9rMTyShE1B__

__https://sway.office.com/iphbM692LmRJ8Grv__

__https://sway.office.com/2GCMl3y6ghnmQmJw__

__https://sway.office.com/zn9od8p9d15c8cPO__

__https://sway.office.com/yRa8zlkOOG65q3Ql__

__https://sway.office.com/mygvm7lMY8Lp1q4o__

__https://sway.office.com/ebxmVOjkljxWt1Ow__

__https://sway.office.com/EHGHrnlWEjsKGELp__

__https://sway.office.com/AkDgC0QABINtD9zV__

__https://sway.office.com/n9fyibJToGHJOaPw__

__https://sway.office.com/JamYTMonEIc5iXXb__

__https://sway.office.com/lNuRP1MA7VKQn4kU__

__https://sway.office.com/8B9YZkcBKP5Xxp91__

__https://sway.office.com/paNb3aMbVDZu8NuU__

__https://sway.office.com/H5cQwxZqO6wCFowy__

__https://sway.office.com/FoNalOP3vs6hyIhf__

__https://sway.office.com/RYsA5l1vI88Pl3jD__

__https://sway.office.com/tlSznq8Hhy0AoH5m__

__https://sway.office.com/eWGC3fwot3nSaFoD__

__https://sway.office.com/ZAT2detASqfhrhRa__

__https://sway.office.com/3sU9YojENCd2CpQB__

__https://sway.office.com/CEPD1eswXiIhwHqa__

__https://sway.office.com/ClxYUJaH87CBejqm__

__https://sway.office.com/VsCdUV4JavTqeIPj__

__https://sway.office.com/01oqlQoXaUneJ2oA__

__https://sway.office.com/cqCDLDAGYBfnmPZQ__

__https://sway.office.com/IqD16jG6slgHwKAm__

__https://sway.office.com/qPwXMrw8qss9b6xm__

__https://sway.office.com/eigmQHmC2Xc5ohXK__

__https://sway.office.com/R68dhbxbsjr4zKsM__

__https://sway.office.com/GhB9JcO8fcGMjQ5p__

__https://sway.office.com/UuGBXCJbXGUoiiWi__

__https://sway.office.com/V3Bniy7mqEcaxdLy__

__https://sway.office.com/nC3JQv5PlIa6y6ij__

__https://sway.office.com/qxqVUcBDDuqevAsF__

__https://sway.office.com/Pm1JuJI0DRAtlYpf__

__https://sway.office.com/BWIRV1jGqqoERu7r__

__https://sway.office.com/iAbmhgLdtuDsY5PD__

__https://sway.office.com/kByz7WSrkzDqqU7R__

__https://sway.office.com/C2HLCmRXe9NzuoHF__

__https://sway.office.com/GC6ZsnhVSbZDPUpj__

__https://sway.office.com/DN6fCxZS1fXDb8Xt__

__https://sway.office.com/CGUGi73mrjcHPOg9__

__https://sway.office.com/o9dCVrMQpvW86IGz__

__https://sway.office.com/BhBH17ZxrTsobNod__

__https://sway.office.com/EYacU1tesfvY5THZ__

__https://sway.office.com/L4i4wgWajWHTleds__

__https://sway.office.com/cpoYrJ1DkvIdE0Wy__

__https://sway.office.com/qgHooPSySovxBGS8__

__https://sway.office.com/OCEf4l4hruflA1Fc__

__https://sway.office.com/TF71y7EwYLilQVs2__

__https://sway.office.com/efgBJGE1CKk78H3C__

__https://sway.office.com/RpAsayQyYHlaK5SZ__

__https://sway.office.com/C2Yv7KEf3WMmHvNz__

__https://sway.office.com/VUfO6dscu3Kp3KgD__

__https://sway.office.com/g1h5catJUtWWPdvQ__

__https://sway.office.com/t2Ss391g0Zwvdv19__

__https://sway.office.com/c006T9xxrXMcC6bR__

__https://sway.office.com/FYrhw6bYhbb7VHjt__

__https://sway.office.com/hgh5QPCiSfH17AvB__

__https://sway.office.com/1bWyEzWVBoSyzuzo__

__https://sway.office.com/GqFb4zY8D2C75Xpb__

__https://sway.office.com/ea9eDdzNoJJjyoOB__

__https://sway.office.com/F0wNM3MX2Td3xA40__

__https://sway.office.com/tiXnrfXFaEvGvPuR__

__https://sway.office.com/aOQkd7BJhHbZ9AP4__

__https://sway.office.com/k5AHaY2hWW1OOipc__

__https://sway.office.com/4tVV3m9EMw49Y6P6__

__https://sway.office.com/CW5XMHO1MSt3JuSb__

__https://sway.office.com/nlN4XuR7DuCFSI6J__

__https://sway.office.com/4AxFSxsaGsRf7GQk__

__https://sway.office.com/qAT45L0dP90zIjHK__

__https://sway.office.com/2DmPhtbpwgxPbGEg__

__https://sway.office.com/HetRys0AipX3Dgi5__

__https://sway.office.com/P0dgiVFB5DR04jqM__

__https://sway.office.com/FUeXZAbmsZgUZmzi__

__https://sway.office.com/QSW4c9TP8iS7aD5C__

__https://sway.office.com/3L5FsQ2wDJUUZVtY__

__https://sway.office.com/MaPT9udGkWmaTVmn__

__https://sway.office.com/j0uhjVywIS3HifkP__

__https://sway.office.com/ZFzJ5OP7GiRaRKed__

__https://sway.office.com/ZZCrZpW5SffC3dRC__

__https://sway.office.com/1aE3Gm38aImwKQ6h__

__https://sway.office.com/jVjsFy4nsjrQrbSz__

__https://sway.office.com/IdzAYFSN6hzepEa1__

__https://sway.office.com/yi48MU4ewAhMPkJU__

__https://sway.office.com/PIqYsK1YPuzMC9Tp__

__https://sway.office.com/FLwPd6mDGISzYFTt__