tag:blogger.com,1999:blog-90297139001458598492024-03-03T10:22:09.244+00:00Bruce Edmonds...(academic) thoughts, reading and activitiesBruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.comBlogger107125tag:blogger.com,1999:blog-9029713900145859849.post-27454202108206343742024-02-06T08:51:00.002+00:002024-02-06T08:51:28.355+00:00Sorry, server temporarily out of action......due to university IT admin deciding its OS was too old and so a security rick. sigh.Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-3809495214342884462022-09-19T10:23:00.004+01:002022-09-19T12:08:16.409+01:00Two aspects of AI - complexity and autonomy - and what it means for dealing with them <h2>The conflation of <i>complexity</i> and <i>autonomy</i></h2>
<p>Thinking in this area is often muddied by conflating two different aspects of what is called "Artificial Intelligence" (AI): (1) the complexity of the algorithms involved, which means we (as humans) can not fully understand or predict what they will come up with and (2) the autonomy of AI entities, which means that they have their own goals and priorities which might be different from ours.</p>
Some examples illustrate the difference. <p>
</p><li>A trained machine learning (ML) algorithm, such as a neural network, can be very complex - hard to understand how it distinguishes patterns and comes up with its outputs. This makes them hard to use because one does not know all their limitations and biases. An algorithm that works well when trained on one set of data, may suddenly work much less well for similar data from another context (as people are finding in the ML replication crisis). A consequence of this complexity is that one can not simply use it, like a car - one has to be trained to use it over a period of time (like learning to sail). However, ML algorithms have no autonomy.<p>
</p></li><li>It is hard to find a simple example of something with autonomy but no complexity, because it takes a process of <i>some</i> complexity for autonomy to be realised. Simple machines or entities usually have little autonomy. However, the complexity does not have to be 'inside' the entity but can be in the process that makes them. If a set of entities is evolving to thrive in a complex environment, then some of those solutions might be very simple but have goals that are very different from what we would like. The complexity is in the process of evolution which only sometimes results in complex entities. Examples include viruses (which are *relatively* simple compared to us) and active solutions that are evolved <i>in silico</i>. The result can be an ecology of entities that makes the achievement of our goals harder.<p>
</p></li><li>Of course, some entities are both complex <i>and</i> autonomous, e.g. a horse. However, training can help manage both. The training and human-socialisation of a horse makes it less autonomous - more willing to accept our goals over its own. The co-training of horse and riders makes the interaction between the two more predictable - simpler - but this is never as simple as a set of well-defined signals (though these help). An ill-treated or frustrated horse might well go against the intentions of its owners but in highly predictable and understandable ways. A human-socialised, but poorly trained, horse may wish to please its rider but misunderstand and do something unpredictable.<p>
Some of the confusion arises because both autonomy and complexity make AI entities hard to 'use'. However, they need to be dealt with in different ways (from the point of view of us humans).
</p><h2>Dealing with Complex AI</h2>
To use a complex tool well requires a lot of training (or other meta-analysis). You can not hope to just apply it "off the shelf". This is not surprising given the extent to which people confuse themselves or make mistakes with something as simple as regression analysis. As with learning to ride a horse, it is going to take a while to get the feel of a complex tool, learning when it can be successfully used, how to use it well, how to check it is giving you good results and how to interpret the results that come from it. Complex analytic tools are still useful, extending our mental capacities in a similar way that machines extend our physical capacities. They stand between us in terms of our understanding of what they are analysing, allowing us more leverage, even if this is now indirect. Such complex tools may require other tools to manage, check and understand what they are doing, so that we might develop a hierarchy of tools analysing tools, with humans at one end and the problems we are grappling with at the other. Such a system of very indirect understanding is inevitable if we are to push the envelope further, but even more tricky to manage.
<h2>Dealing with Autonomous AI</h2>
Dealing with autonomous entities is another matter entirely, though a familiar one. When we deal with other species or groups of people, particularly when we do not have much previous experience with them, we face this problem. Yes they may be hard to understand due to their unfamiliar complexity but that is just the start of the difficulties, which present even when we have a lot of experience of their kind. You can not simply 'use' such entities, even after a period of extensive training. Part of the confusion with algorithmic autonomous entities is that often it is assumed that one can, just because they are built of algorithms. Here we should look to clues as to what to do in ecology and sociology. <p>
Most fundamentally, the goals and motivations of the other entities matter. Tame rats make great pets - they are sociable, adaptable, intelligent and affectionate, but _only_ given that their needs for food, shelter, social contact etc. are completely met by their human owners. Wild rats have goals that are incompatible with those of humans when they get into our houses and store rooms. The options are (a) war: killing and capturing them (b) making sure they inhabit different spaces by stopping them getting inside (c) sufficiently interfering with them (for example by feeding them outside but including contraceptive chemicals) - negotiation with wild rats is not possible (d) fleeing to avoid them (e.g. going to live on an island as some birds do). Many other species have goals that are completely compatible with humans (many wild birds) and so we can quite happily live side by side and peaceably. Thus, whilst we have any control over the matter, it is important to not create autonomous AI entities which have goals or needs that will compete with ours. Thus we should not be seeking to make AI entities that are similar to ourselves, but ones that might be complementary. Species that inhabit the same ecological space will be in competition with each other (e.g. red and grey squirrels), and one might eventually win out as a result, species that are very different (e.g. elephants and egrets) can be compatible. Longer-term evolution can result in competition and co-adaptation so that an ecosystem works as a whole, but this can be as predator-prey cycles or more cooperative co-adaptation (such as dogs and humans).</p><p>
If the goals and the motivations of the group of entities are sufficiently compatible with ours (either being complementary or just very different), then some accommodation between us and them is possible. This might involve learning not to encroach on each other's domains, with sanctions for breaches, so we can live happily side-by-side or it might involve more active communication and cooperation. Here the sociology of cooperation comes into play, the different ways in which some kind of cooperation or trust can emerge and be maintained. Here agent-based simulation can help us de-bug and inform efforts to cooperate, especially in helping identify 'early-warning' indicators of when cooperation is breaking down. There is now a substantial body of work on the mechanisms that can support cooperation, even in social dilemma situations where it might benefit individuals in the short-term to do otherwise.</p><p>
For example, one could imagine that a whole ecology of autonomous entities might be encouraged to inhabit the information sphere, as long as they are motivated to simplify and analyse that information rather than pollute it. In such a case it might be a matter of system farming rather than direct control or management that might be the correct strategy - feeding/motivating the ecology in suitable ways, dealing with crises and other difficulties (such as disease or computer viruses) rather than complete understanding or planning. Such a system could provide us with a highly complex, but effective set of compatible AI entities, which we did not fully understand (nor they understand us) but with a mutual basis for cooperation based on our complementarity. However, the mutual rewards and basic needs of both humans and information-entities would have to be very carefully understood and managed.</p><p>
In terms of interaction between individuals, high complexity (and hence no complete mutual understanding) need not stop effective coordination. Humans are highly complex and do not completely understand how they or others make decisions, which is often highly influenced by feelings and unconscious processing (e.g. pattern recognition), but can still effectively cooperate with each other. As long as: (a) they can justify their relevant actions in terms that are understood and acceptable to the other (even if this is not completely true) (b) agree coordination in terms of these justifications and (c) influence their own decision-making processes so to be in accord with the coordination.</p><p></p><p></p><p></p><p></p></li><p></p>Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-33071041111883407232022-07-08T10:31:00.003+01:002022-07-08T10:31:44.780+01:00Sorry main webpage temporarily out of action.....should be back in about a week.Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-42146513384559625862021-01-11T12:07:00.001+00:002021-01-11T12:07:36.450+00:00Bad Science keeps getting cited<p>There is a problem in the efficacy of science in terms of correcting itself. Whilst in the very long-term erroneous and important science does get corrected, in the short and medium term papers continue to get cited even when the science they describe is debunked, falsified or even retracted. </p><p>The problem seems to be (a) that severe criticism or retraction notices are not easily detectable on the page where the paper is read (a problem compounded when there are different copies of the paper around on pre-print services etc.) and (b) that papers get more readers (and hence citations) the more it is cited, so once a paper starts getting cited a lot, its citation rate is self-sustaining.</p><p>Some examples:</p><ul style="text-align: left;"><li> (Schneider et al. 2020) report about a paper that was retracted due to falsified clinical trial data, but has continued to be cited in the 11 years after that - mostly with citations that give no indication of its retraction or weakness (in 96% of citing articles). This is not so surprising given the main page of the paper gives no indication that it is retracted (<a href="https://journal.chestnet.org/article/S0012-3692(15)49623-0/">https://journal.chestnet.org/article/S0012-3692(15)49623-0/</a>). </li><li>The case I know personally about is (Riolo et al 2001), which was heavily criticised (e.g. Roberts & Sherratt 2002, Edmonds & Hales 2003). The original model is very brittle and it is clear the authors did not understand their own model or results (changing a "<=" to a "<" in the formulation makes the effect they report disappear because the former forces agents with 0 tolerance to cooperate with clones of themselves and hence proliferate). Despite this the original paper is cited over 800 times according to Google citations.</li></ul><p>(Schneider et al. 2020) report on some of the literature reporting other cases. <a href="https://retractionwatch.com/">Retraction Watch</a> documents retractions by journals and indeed has a "leader board" for the 10 most cited retracted papers (<a href="https://retractionwatch.com/the-retraction-watch-leaderboard/top-10-most-highly-cited-retracted-papers/">https://retractionwatch.com/the-retraction-watch-leaderboard/top-10-most-highly-cited-retracted-papers/</a>), with one paper being cited 1146 times <i><b>after</b></i> it was retracted.</p><p>That good science gets cited and then attracts more readers is clearly a good thing, but when the reverse happens the communication of its (lack of) quality does not work well. <i>Firstly</i>, there is the laziness of many researchers who cited papers without reading them (basing their citations on the citations of others). <i>Secondly</i>, when a paper is simply severely criticised this is difficult to know without reading many papers that cited a paper - a very time-consuming process. The only way in which the correction of bad science works is if the paper that criticises such research is cited many more times than the original.</p><p>Some mechanism whereby the quality of papers is communicated post-review is needed. The review process can only stop some bad science from being published because completely checking research is infeasible (unless this is a core part of one's own research).<br /></p><h2 style="text-align: left;">References</h2><p>Edmonds, B. and Hales, D. (2003) <span style="font-style: italic;">Replication,
Replication
and Replication - Some Hard Lessons from Model Alignment</span>.
Journal of Artificial Societies and Social Simulation 6(4) (<a href="http://jasss.soc.surrey.ac.uk/6/4/11.html">http://jasss.soc.surrey.ac.uk/6/4/11.html</a>). <br /></p><p>Riolo, Rick L., Michael D. Cohen, and Robert Axelrod. "Evolution of cooperation without reciprocity." <i>Nature</i> 414.6862 (2001): 441-443. <a href="https://www.nature.com/articles/35106555">https://www.nature.com/articles/35106555</a> <br /></p><p>Schneider, J., Ye, D., Hill, A.M. <i>et al.</i> Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data.
<i>Scientometrics</i> <b>125, </b>2877–2913 (2020). <a href="https://doi.org/10.1007/s11192-020-03631-1">https://doi.org/10.1007/s11192-020-03631-1</a></p><p>Roberts, G., Sherratt, T. Does similarity breed cooperation?.
<i>Nature</i> <b>418, </b>499–500 (2002). <a href="https://doi.org/10.1038/418499b">https://doi.org/10.1038/418499b</a> </p>Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-84502224169808201762020-11-05T10:49:00.002+00:002020-11-05T10:50:27.548+00:00My summary of the ABC news analysis of US election exit polls<p class="MsoNormal">This is my summary of the Analysis of US exit polls done by ABC news. Full details at: <a href="https://abcnews.go.com/Elections/exit-polls-2020-us-presidential-election-results-analysis">https://abcnews.go.com/Elections/exit-polls-2020-us-presidential-election-results-analysis</a></p>
<p class="MsoNormal">On the leaders, the parties or issues that have become
partisan, division was also highly partisan and symmetric, including views on: the economy, abortion,
covid, counting votes "properly", health care, climate change, BLM/racism,
and the competency of the Federal government.</p><p class="MsoNormal">Looking at all other factors which indicated a 60% or more tendency to
vote for Republican or Democrat it found:<br /></p>
<ul style="text-align: left;"><li>Those voting <span style="color: #cc0000;"><i><b>Democrat</b></i></span> had a tendency to be: Black, Hispanic,
Asian, had an advanced degree, in a worse/same financial situation, valued personal
qualities of candidate (good judgement candidate, can unite country), had a positive
view of state voting, might have voted for independents before, came from city
over 50K residents, or were young (18-29, non-married women, first time voters).</li><li>Those voting <span style="color: #3d85c6;"><i><b>Republican</b></i></span> had a tendency to be: White 45-59,
Christian, may have decided their vote in the last week, were doing better
financially than 2016, liked a strong leader.</li></ul>
<p class="MsoNormal">Extracts from the full details for these factors are as follows:</p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Are you:</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(15,318 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Black 12% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">87%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">12%</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 3;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Hispanic/Latino 13% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">66%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">32%</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 4; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Asian 3% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">63%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">31%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">In which age group are you?</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(15,452 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">18-29 17% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">62%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">35%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Age by race</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(15,205 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">White 45-59 18% responded</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">38%</span></p>
</td>
<td style="background: rgb(217, 149, 148) none repeat scroll 0% 0%; mso-background-themecolor: accent2; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">60%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Which best describes your
education? You have:</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(15,344 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">An advanced degree after a bachelor's degree (such as JD,
MA, MBA, MD, PhD) 16% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">62%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">36%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Gender by marital status</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(3,748 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Non-married women 24% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">62%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">37%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Are you:</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(2,470 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Protestant 14% responded</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">28%</span></p>
</td>
<td style="background: rgb(217, 149, 148) none repeat scroll 0% 0%; mso-background-themecolor: accent2; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">71%</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 3;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Catholic 27% responded</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">37%</span></p>
</td>
<td style="background: rgb(217, 149, 148) none repeat scroll 0% 0%; mso-background-themecolor: accent2; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">62%</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 4; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Other Christian 31% responded</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">32%</span></p>
</td>
<td style="background: rgb(217, 149, 148) none repeat scroll 0% 0%; mso-background-themecolor: accent2; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">67%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Are you gay, lesbian, bisexual or
transgender?</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(3,615 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Yes 7% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">61%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">28%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Is this the first year you have
ever voted?</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(3,953 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Yes 13% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">66%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">32%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">When did you finally decide for
whom to vote in the presidential election?</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(3,731 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">In the last week 2% responded</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">30%</span></p>
</td>
<td style="background: rgb(217, 149, 148) none repeat scroll 0% 0%; mso-background-themecolor: accent2; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">63%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Compared to four years ago, is
your family's financial situation:</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(3,731 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Better today 41% responded</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">25%</span></p>
</td>
<td style="background: rgb(217, 149, 148) none repeat scroll 0% 0%; mso-background-themecolor: accent2; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">72%</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 3;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Worse today 20% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">74%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">23%</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 4; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">About the same 38% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">64%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">33%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Which ONE of these four candidate
qualities mattered most in deciding how you voted for president? (CHECK ONLY
ONE)</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(3,845 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Can unite the country 19% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">76%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">23%</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 3;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Is a strong leader 32% responded</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">28%</span></p>
</td>
<td style="background: rgb(217, 149, 148) none repeat scroll 0% 0%; mso-background-themecolor: accent2; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">71%</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 4; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Has good judgment 23% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">68%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">27%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Which was more important in your
vote for president today?</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(3,845 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">My candidate's personal qualities 23% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">66%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">30%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Do you think your state makes it
easy or difficult for you to vote?</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(3,741 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Somewhat easy 25% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">63%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">36%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Was your vote for president
mainly:</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(3,870 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Against his opponent 24% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">68%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">30%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">In the 2016 election for
president, did you vote for:</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(3,870 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Hillary Clinton (Dem) 40% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">95%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">4%</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 3;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Donald Trump (Rep) 42% responded</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">8%</span></p>
</td>
<td style="background: rgb(217, 149, 148) none repeat scroll 0% 0%; mso-background-themecolor: accent2; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">92%</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 4;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Other5 % responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">62%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">24%</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 5; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Did not vote 11% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">61%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">37%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184;">
<thead>
<tr style="mso-yfti-firstrow: yes; mso-yfti-irow: 0;">
<td colspan="3" style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Population of area, three
categories</span></p>
</td>
</tr>
<tr style="mso-yfti-irow: 1;">
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">(15,343 Respondents)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (D)</span></b></p>
</td>
<td style="padding: 0.75pt;">
<p align="center" class="MsoNormal" style="margin-bottom: 0cm; text-align: center;"><b><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">Voted (R)</span></b></p>
</td>
</tr>
</thead>
<tbody><tr style="mso-yfti-irow: 2; mso-yfti-lastrow: yes;">
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">City over 50,000 30% responded</span></p>
</td>
<td style="background: rgb(149, 179, 215) none repeat scroll 0% 0%; mso-background-themecolor: accent1; mso-background-themetint: 153; padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">60%</span></p>
</td>
<td style="padding: 0.75pt;">
<p class="MsoNormal" style="margin-bottom: 0cm;"><span style="font-family: "Times New Roman"; font-size: 10pt; mso-fareast-font-family: "Times New Roman";">37%</span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal"> </p>
<p class="MsoNormal"> </p>
<p><style>
<!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"Franklin Gothic Book";
panose-1:2 11 5 3 2 1 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin-top:0cm;
margin-right:0cm;
margin-bottom:6.0pt;
margin-left:0cm;
mso-pagination:widow-orphan;
font-size:12.0pt;
mso-bidi-font-size:11.0pt;
font-family:"Franklin Gothic Book";
mso-fareast-font-family:Calibri;
mso-bidi-font-family:"Times New Roman";}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;
mso-ansi-language:EN-US;}size:595.0pt 842.0pt;
margin:2.0cm 2.0cm 2.0cm 2.0cm;
mso-header-margin:35.45pt;
mso-footer-margin:35.45pt;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}</style></p>Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-21542474980465831992020-10-08T10:53:00.022+01:002020-10-23T12:48:12.006+01:00Some warning signs of wishful thinking<p>Sorting out whether we believe something for a good reason or because we want it to be true (or, oddly, because we fear it to be true) is hard. Even those I consider very rational are not always good at this (including myself), and some that are most partisan use this trait ruthlessly. However, there are some (fallible) signals that can help alert oneself of such wishful thinking, such as the following.<br /></p><ol style="text-align: left;"><li><i><b>It sanctions me doing something I want to do</b></i> (drive in the car when I could have cycled, take an international holiday, eat a huge slice of over-rich chocolate cake etc.)</li><li><i><b>It helps me criticise/attack/despise something I already dislike/think is bad</b></i> (a government, a politician, a law, a restriction, the green movement, Capitalism, foreign aid, Brexit supporters etc.)</li><li><i><b>The formulation of the belief shifts over time</b></i> (from "smoking is not harmful" to "there is no evidence it is" to "it is harmful but only one of a complex of factors", from denying the earth's temperature is rising to denying it is due to humans to denying it is worth stopping etc.)</li><li><i><b>The belief is constructed so that it is hard to disprove</b></i> (conspiracy theories are often like this, but so too are many political claims, e.g.. some of the claims of Brexit or Remain camps, the benefit of homoeopathic cures, crystals)</li><li><i><b>It sanctions me not doing something I do not want to do</b></i> (find a job if I am lazy, get exercise if I am unhealthy, change my mind if I do not want to, admit to being wrong if this is embarrassing, avoid doing my expenses, wear a mask, wear a cycle helmet etc.)</li><li><i><b>The use of obviously weak arguments to support the belief</b></i> (it does not cost much anyway, I was going that way anyway, it is my right to do it, it won't harm anyone, Dominic Cummings did it so why not me, anything X says is rubbish, etc.)</li><li><i><b>The invention of new supporting arguments only formulated when old ones are revealed to be weak or wrong</b></i> (in economics - ok we know people are not rational but collectively they behave as if they are, the climate is warming due to the sunspot cycle etc.)</li><li><i><b>The belief signals membership of a group I wish to belong to</b></i> (holocaust denial, global warming will result in the extinction of all humans, greed is good etc.)</li><li><i><b>Support of the belief is based on the persecution or the weakness of the arguments by those opposing it</b></i> (Big Pharma would want this, they say there is a magic money tree, various Nationalist claims, the Government does not want you to know this etc.)</li><li><i><b>It is involved in a highly political or personalised argument</b></i> (Brexit, HCQ, Republican/Democrat, Immigration, lockdown, taxes etc.)</li><li><i><b>There is no positive evidence for the belief</b></i> - rather a (perceived) lack of negative evidence (herbal remedies, superstitions, free will/denial of free will, chemicals in the drinking water are affecting me, self-supporting arguments such as everyone is lying etc.)</li><li><i><b>Hype, ridicule or insults are used to defend the belief </b></i>(if you follow that line you would not be able to do anything, "socialist" in the US, only a stupid person would believe that, that is what they want you to believe, Trump is the best/worst president <i>ever</i> etc.)</li><li><i><b>All my friends/group/kind believe it </b></i>- though this often not an explicit/conscious reason (shaving, our group is superior to others/outsiders, our technique is better, British humour is unique and similar national myths, any diet that involves harm to animals is wrong etc.)</li><li><i><b>It is too interesting</b></i> - too surprising, funny, odd etc. False beliefs are not constrained by boring facts and thus can be far more engaging (internet memes, the earth is hollow, you too can be thin with this simple trick etc.)<br /></li><li><i><b>It is comforting</b></i> or otherwise gives me status (Earth is the centre of the universe, Humans are the pinnacle of creation/evolution, simple theories are more likely to be true, your country is special/unique etc.)</li><li><i><b>New phrases/words are used that are invented by believers</b></i> - because this indicates this is more a group membership thing than a matter of truth (sheeple, Remoaners, follow the crumbs etc.)</li><li><i><b>It can be expressed in a very few words</b></i> and has lots of CAPITALS and exclamation marks!!(political slogans, ads, tweets, etc.)</li><li><i><b>Support is mostly via a list of personal endorsements </b></i>(these are easy to collect at a trivial level and very hard to check)</li><li><i><b>When critiqued the response is not to engage with the argument </b></i>but to reply with something else. (The warning sign here is a lack of interest in the the <i>basis</i> for the belief - the belief comes first)</li><li><i><b>It is contrary to general opinion</b></i> since this makes the believers special and different (and hence gives status) - the narrative of the prophet in the wilderness or one man against the system (and, yes, in common narratives - e.g. films - this person is almost invariably male).<br /></li></ol><p><br />I <b>NOT</b> saying that these are <i>infallible</i> signs of a wrong belief (some of these hold for some truths), and I am <b>NOT</b> saying one shouldn't do these things (e.g. critiquing something you feel is wrong might well be a good thing to do). It just each of these should give one pause to question the corresponding belief a bit more than one might otherwise do. If one's reflection on the grounds for the belief indicate they are not so solid, then think of independent ways/evidence to check that belief or just shift position to a less certain belief, noting the doubt.<br /></p><p>Clearly, I should populate this list with references to evidence (but
who would read that anyway ;-), which I may get around to. However, I
will update this list when I find more suggestions to add.</p><p>Also one should distinguish these <i><b>warning signs</b></i> from aspects that are merely <i><b>not</b></i> <i><b>entirely reliable</b></i> indications of truth, including the following (nothing outside formal systems can be 100% proved).<br /></p><ul style="text-align: left;"><li>That a clever person says it (like me 8-)</li><li>That there is a debate or many views about this (that there are climate deniers or anti-vaxxers in TV debates does not mean they have strong arguments or reliable evidence)</li><li>That it is repeated by many users or on many websites (that Biden used an earpiece in the debate, that the Oklahoma bomber was an Islamic refugee etc.) </li><li>There are non-peer-reviewed/non-rigourous papers that claim this (look at the pre-print literature on COVID19)<br /></li><li>I find it a useful/insightful way of thinking about things (if something can help one get to true insights it might equally help one to misleading ones)<br /></li><li>It is plausible given what I know (plausibility makes it a hypothesis not a fact)<br /></li><li>It fits with all my other knowledge/beliefs (but those might also be wrong)<br /></li><li>It was taught to me at school (I was taught continental drift was false)<br /></li><li>I read it in a book/newspaper (some authors, editors, journalists and publishers care to restrict publication to statements that are well supported, but many do not)<br /></li><li>An example of this is documented (examples are good starting points, but not enough to support generalisation)</li><li>It is complicated or technical (just because it is impressive is not enough to make it true, but it does indicate more effort has been put in to it).</li><li>That it is in the interest of some institution or block for you to disbelieve it (one can't ignore power relations when assessing truth, but the effect of power is complex)<br /></li></ul><p></p><p><br /></p>Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-14235596306017972922019-03-21T11:34:00.001+00:002019-03-21T11:34:31.431+00:00Slides of talk: "The Evolution of Empirical ABMS"A talk at the workshop on "<i>Agent-Based Models in Philosophy: Prospects and Limitations</i>", Workshop on Agent-Based Models in Philosophy, Rurh University, Bochum, Germany. March 2019<br />
<br />Abstract:<br />
<br />ABMs (like other kinds of model) can be used in a purely abstract
way, as a kind of thought experiment - a way of thinking about some
aspect of the world that is too complicated to hold in our mind (in all
its detail). In this way it both informs and complements discursive
thought. However there is another set of uses for ABMs - empirical uses -
where the mapping between the model and sets of observation-derived
data are crucial. For these uses, one has to (a) use the mapping to get
from some data to the model (b) use the model for some inference and (c)
use the mapping again back to data. This includes both predictive and
explanatory uses of ABMs. These are easily distinguishable from abstact
uses becuase there is a fixed and well-defined relationship between the
model and the data, this is not flexible on a case by case basis. In
these cases the reliability comes from the composite (a)-(b)-(c)
mapping, so that simplifying step (b) can be counterproductive if that
means weakening steps (a) and (c) because it is the strength of the
overall chain that is important. Taking the use of models in quantum
mechanics as an example, one can see that sometimes the evolution of the
formal models driven by empirical adequacy can be more important than
the attendent abstract models used to get a feel for what is happening.
Although using ABM's for empirical purposes is more challenging than for
purely abstract purposes, they are being increasingly used for
empirical explanation rather than thought experiments, and there is no
reason to suppose that robust empirical adequacy is unachievable.<br />
<br />
Slides at: <a href="https://www.slideshare.net/BruceEdmonds/the-evolution-of-empirical-abms-137463946">https://www.slideshare.net/BruceEdmonds/the-evolution-of-empirical-abms-137463946 </a><br />
<br />
<br />Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-72684698316234570662018-08-21T13:22:00.000+01:002018-08-21T13:22:02.963+01:00Slides from my plenary "How social simulation could help social science deal with context"An invited talk at <a href="https://ssc2018.dsv.su.se/">Social Simulation 2018</a><br />
<br />
This points out how context-sensitivity is fundamental to much human
social behaviour, but largely bypassed or ignored in social science. I
more formal social science, it is usual to assume or fit universal
models, even if this covers a lot of different contexts. In qualitative
social science context is almost deified, and any generalisation across
contexts is passed on to those that learn from it. Agent-based modelling
allows for context-sensitive models to be developed and hence the role
of context explored and better understood. The talk discussed a
framework for analysing narrative text using the
Context-Scope-Narrative-Elements (CSNE) framework. It also illustrates a
cognitive model that allows for context-dependent knowledge to be
implemented wthin an agent in a simulation. The talk ends with a plea to
avoid uncecessary or premature summarisation (using averages etc.).<br />
<br />
Slides at: <a href="https://www.slideshare.net/BruceEdmonds/how-social-simulation-could-help-social-science-deal-with-context">https://www.slideshare.net/BruceEdmonds/how-social-simulation-could-help-social-science-deal-with-context</a>Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-23737953743558093492018-07-15T15:42:00.001+01:002018-07-15T15:42:30.651+01:00Slides from talk at MABS2018: "Mixing ABM and Policy ... what could possibly go wrong?"Invited talk at 19th International Workshop on Multi-Agent Based Simulation at Stockholm on 14th July 2018.<br />
<h2>
Mixing ABM and Policy ... what could possibly go wrong?</h2>
This talk looks at a number of ways in which using ABM in the context of influencing policy can go wrong: during model construction, with model application and other.<br />
<br />
It is related to the book chapter:<br />
<blockquote class="tr_bq">
<span class="authors__name" itemprop="name">Aodha, L.</span><span class="author-information"><span class="authors__contact"><span class="gtm-email-author"> and </span></span></span>Edmonds,
B. (2017) Some pitfalls to beware when applying models to issues of policy
relevance. In Edmonds, B. & Meyer, R. (eds.) Simulating Social
Complexity - a handbook, 2nd edition. Springer, 801-822.</blockquote>
See the slides at: <a href="https://www.slideshare.net/BruceEdmonds/mixing-abm-and-policywhat-could-possibly-go-wrong">https://www.slideshare.net/BruceEdmonds/mixing-abm-and-policywhat-could-possibly-go-wrong</a>Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-71386144021952557622018-06-25T19:45:00.004+01:002018-06-25T19:45:46.608+01:00Paper published in "Journal of Conflict Resolution": "Intragenerational Cultural Evolution and Ethnocentrism" by David Hales and myselfThis #cfpm_org paper is suggestive of a process of cultural (horizontal) intragenerational processes of in-group favouritism and contrasts with Axelrod and Hammond's (2006) model of the (vertical) evolution of a fixed in-group preference.<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEheE-7CPq5XUQizgasQKdljZNsHXqoZzaHjkt8Dgx5By8Z4oXMs86E3aw-TE9H-JUSeoGSH642w9VeNJV0ljkLwbc6sXWAega69oHZvQ7wEBqURJ0_AvIUfzlOv1JRoY-ItxtlQJYwVe9k/s1600/The+Journal+of+Conflict+Resolution+logo.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="184" data-original-width="274" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEheE-7CPq5XUQizgasQKdljZNsHXqoZzaHjkt8Dgx5By8Z4oXMs86E3aw-TE9H-JUSeoGSH642w9VeNJV0ljkLwbc6sXWAega69oHZvQ7wEBqURJ0_AvIUfzlOv1JRoY-ItxtlQJYwVe9k/s1600/The+Journal+of+Conflict+Resolution+logo.png" /></a></div>
<div data-module-name="article-badge-bar">
<div class="articleMeta ja">
<div class="hlFld-Title">
<div class="publicationContentTitle">
<h1>
Intragenerational Cultural Evolution and Ethnocentrism
</h1>
</div>
</div>
<div class="copyrightStatement">
</div>
<div class="articleMetaDrop publicationContentDropZone" data-pb-dropzone="articleMetaDropZone">
</div>
<div class="publicationContentAuthors">
<div class="author-container js__articleAuthorContainer" data-author-container-selector=".NLM_contrib-group" data-authorname-selector=".contribDegrees > .entryAuthor" data-max-authors="5">
<div class="authors">
<div class="hlFld-ContribAuthor">
<span class="contribDegrees"> by <a href="http://www.davidhales.com/"><i><b>David Hales</b></i></a></span> and <span class="contribDegrees"> <a href="http://cfpm.org/~bruce">Bruce Edmonds</a></span></div>
</div>
</div>
</div>
<span class="publicationContentEpubDate dates">
<b>First Published </b> June 21, 2018
</span>
<span class="ArticleType">
<span>Research Article </span></span><div class="widget articleInformation none widget-none widget-compact-all" id="fb19a7b7-16b8-4189-b700-b2b06e745c58">
</div>
<div class="articleMetaDrop publicationContentDropZone publicationContentDropZone1" data-pb-dropzone="articleMetaDropZone1">
<div class="widget layout-one-column none widget-none widget-compact-all" id="80078b98-037a-4dab-b149-628ef0ecefc6">
<div class="wrapped ">
<div class="widget-body body body-none body-compact-all">
<div class="pb-columns row-fluid">
<div class="width_1_1">
</div>
</div>
</div>
</div>
</div>
</div>
<div>
</div>
</div>
</div>
<div class="hlFld-Abstract">
<a href="https://draft.blogger.com/null" name="abstract"></a><div class="sectionInfo abstractSectionHeading">
<h2 class="sectionHeading">
Abstract</h2>
</div>
<div class="abstractSection abstractInFull">
Ethnocentrism
denotes a positive orientation toward those sharing the same ethnicity
and a negative one toward others. Previous models demonstrated how
ethnocentrism might evolve intergenerationally (vertically) when
ethnicity and behavior are inherited. We model short-term <i>intragenerational</i> (horizontal) cultural adaptation where agents have a <i>fixed</i>
ethnicity but have the ability to form and join fluid cultural groups
and to change how they define their in-group based on both ethnic and
cultural markers. We find that fluid cultural markers become the
dominant way that agents identify their in-group supporting positive
interaction between ethnicities. However, in some circumstances,
discrimination evolves in terms of a <i>combination</i> of cultural and
ethnic markers producing bouts of ethnocentrism. This suggests the
hypothesis that in human societies, even in the absence of direct
selection on ethnic marker–based discrimination, selection on the use of
fluid cultural markers can lead to marked changes in ethnocentrism
within a generation.<br />
</div>
</div>
<div class="abstractKeywords">
<div class="hlFld-KeywordText">
<b>Keywords </b>tag-based cooperation, <a class="attributes" href="https://draft.blogger.com/null">altruism</a>, <a class="attributes" href="https://draft.blogger.com/null">cultural evolution</a>, <a class="attributes" href="https://draft.blogger.com/null">in-group bias</a>, <a class="attributes" href="https://draft.blogger.com/null">ethnocentrism</a></div>
<div class="hlFld-KeywordText">
</div>
<div class="hlFld-KeywordText">
This is open access and available at: <a href="http://journals.sagepub.com/doi/10.1177/0022002718780481">http://journals.sagepub.com/doi/10.1177/0022002718780481 </a></div>
</div>
Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-51239707583770015122017-06-27T12:42:00.002+01:002018-07-16T07:47:24.344+01:00Slides for talk and draft paper on: Modelling PurposesA talk at the 2017 <a href="https://www.wur.nl/en/newsarticle/ESSA-Silico-Summer-School-26-30-June-2017-.htm">ESSA SiLiCo Summer school in Wageningen.</a><br />
<br />
Slides at: <a href="https://www.slideshare.net/BruceEdmonds/model-purpose-and-complexity">https://www.slideshare.net/BruceEdmonds/model-purpose-and-complexity</a> <br />
<br />
This discusses some different purposes for a
simulation model and the consequences of this in terms of its
development, checking and justification. It also looks at how complex one's model should be.<br />
<br />
Connected to this is a draft of a paper:<br />
<br />
<b>Abstract </b><br />
How one builds, checks, validates and interprets a model depends on its ‘purpose’. This is true even if the same model is used for different purposes, which means that a model built for one purpose but now used for another may need to be re-checked, re-validated and maybe even rebuilt in a different way. Here we review some of the different purposes for building a simulation model of complex social phenomena, focussing on five in particular: theoretical exposition, prediction, explanation, description and illustration. The chapter looks at some of the implications in terms of the ways in which the intended purpose might fail. In particular, it looks at the ways that a confusion of modelling purposes can fatally weaken modelling projects, whilst giving a false sense of their quality. This analysis motivates some of the ways in which these ‘dangers’ might be avoided or mitigated.<br />
<br />
The citation is: <br />
<blockquote class="tr_bq">
Edmonds, B. & Meyer, R. (2013) Simulating Social Complexity – a handbook. Springer. (<a href="http://www.springer.com/gp/book/9783540938125">Publisher's Page</a>)</blockquote>
<br />
The text of this draft is at: <a href="http://cfpm.org/file_download/178/Five+Different+Modelling+Purposes.pdf">http://cfpm.org/file_download/178/Five+Different+Modelling+Purposes.pdf</a><br />
<br />
There is an updated version with 7 modelling purposes and different modelling *strategies* at: <a href="http://cfpm.org/file_download/186/Different+Modelling+Purposes-JASSS-v1.6.pdf">http://cfpm.org/file_download/186/Different+Modelling+Purposes-JASSS-v1.6.pdf</a><br />
Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-7554682292780718242017-06-09T14:06:00.001+01:002017-06-09T14:06:08.278+01:00Wide variation in number of votes needed to get electedAs usual, there is a very wide variation in the number of votes needed to get each seat in the UK parliament. Provincial parties have it relatively easy (in NI, Wales and Scotland), minority parties spread over the UK have it hard (Green, LibDem, UKIP).<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj2W6vY_Sv-VphNxGVKuPXBorVdsj8jQAWrMpAoTdveX2apsWo1Qd-1-0QvtO-NYnrLNZ_z1Ew1riKypbJvz4uVuql6H3oOWU-_Ge6kzfeyxnRpkZ6oQZml7rz50CBRlrc4IFi9m5Cm-Jo/s1600/seats+per+50kvotes.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="415" data-original-width="796" height="207" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj2W6vY_Sv-VphNxGVKuPXBorVdsj8jQAWrMpAoTdveX2apsWo1Qd-1-0QvtO-NYnrLNZ_z1Ew1riKypbJvz4uVuql6H3oOWU-_Ge6kzfeyxnRpkZ6oQZml7rz50CBRlrc4IFi9m5Cm-Jo/s400/seats+per+50kvotes.png" width="400" /></a></div>
<br />Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-58737976233419062952017-06-02T16:05:00.002+01:002017-06-02T16:09:28.292+01:00Slides for talk on: Modelling Innovation – some options from probabilistic to radicalGiven at the<a href="https://www.ea-aw.de/"> European Academy of Technology and Innovation Assessment</a>, see notice about the talk at: <a href="https://www.ea-aw.de/service/news/2017/05/22/ea-kolloquium-prof-bruce-edmonds-vom-centre-forpolicy-modelling-cfpm-quotmodellier.html">https://www.ea-aw.de/service/news/2017/05/22/ea-kolloquium-prof-bruce-edmonds-vom-centre-forpolicy-modelling-cfpm-quotmodellier.html</a><br />
<br />
<h3>
Abstract:</h3>
<blockquote class="tr_bq">
In general, most modelling of innovation bypasses the creativity involved. Here I look at some of the different options. This loosely follows (but expands) Margaret Boden's analysis of creativity. Four ways are presented and their implementation discussed (a) probabilistic, where the 'innovation' simply corresponds to an unlikely event within a known distribution (b) combinatorial, where innovation is a process of finding the right combination of existing components or aspects (c) complex path-dependency where the path to any particular product is a complex set of decisions or steps and not deducible before it is discovered and (d) radical, where the innovation causes us to think of things in a new way or introduces a novel dimension in which to evaluate. A model of making things that introduces complex path-dependency will be exhibited. Some ways of moving towards (d) the most radical option are discussed and a future possible research agenda outlined.</blockquote>
<br />
Slides are at: <a href="https://www.slideshare.net/BruceEdmonds/modelling-innovation-some-options-from-probabilistic-to-radical">https://www.slideshare.net/BruceEdmonds/modelling-innovation-some-options-from-probabilistic-to-radical</a>Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-17746337950969406272017-05-27T10:41:00.001+01:002017-05-27T10:41:02.176+01:00Bruce's Modelling Gripes, No. 10: That I also do many of the things that annoy meI think this will be my last "gripe" for a while, though it has been fun letting them out. I will now let them build up inside a while before I splurge again.<br />
<br />
Yes, of course, I also do many of the things I have been complaining about in these "Gripes" (though not all of them). It is a fundamental social dilemma -- what is fun or advantageous for you as an individual can be a pain for others -- what is good for the general modelling community might be a "pain in the arse" to do.<br />
<br />
All we can do is to try and set ourselves and others standards and then, collectively, try to keep each other to them - including those who want to suggest these. At certain crucial points they can be enforced (for acceptance for a publication, as a condition for a grant), but even then they are much more effective as part of a social norm -- part of what good/accomplished/reputable modellers <i>do.</i><br />
<br />
So I need this as much as anyone else. Personally I find the honesty ones easy - I have a childish delight in being brutally honest about my own and general academic matters, but find it harder to do the "tidying up" bits once I have sorted out a model - others will find the honesty thing harder because they lack the arrogant confidence I have. Lets keeps us all straight in this increasingly "post-truth" world!<i> </i>Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-90858825522799908632017-05-26T14:40:00.001+01:002017-05-26T14:40:21.478+01:00Bruce's Modelling Gripes, No. 9: Publishing early or publishing lateAlright, so I have cheated and rolled two gripes into one here, but the blog editor seems OK with this.<br />
<ul>
<li>When modellers rush to publishing a full journal article on the fun model they are developing and often <a href="http://bruceedmonds.blogspot.com/2017/05/bruces-modelling-gripes-no-6-over.html">over-claim</a> for it and generally not do enough work, check it or <a href="http://bruceedmonds.blogspot.com/2017/04/bruces-modelling-gripes-no-5-none-or.html">get enough results</a>. A discussion paper or workshop paper is good, but presenting some work as mature when it is only just developing can waste everybody's time.</li>
</ul>
And the opposite extreme... <ul>
<li>When modellers keep a model to themselves for too long, waiting until they have it absolutely perfect before they publish and pretend that there was no messy process getting there. Perfection is fine but, please, please <i><b>also </b></i>put out a discussion paper on the idea early on so we know what you are working on. Also in the journal article be honest about the process you took to get there, including things you tried that did not work - as in a <a href="http://cream-itn.eu/trace">'TRACE' document</a>.</li>
</ul>
We can have the best of both worlds: open discussion papers showing raw ideas, plus journal papers when the work is mature, <i><b>please</b></i>!Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-32819744614949121932017-05-25T23:25:00.000+01:002017-05-25T23:25:10.405+01:00Bruce's Modelling Gripes, No. 8: Unnecessary MathematicsBefore computational simulation developed, the only kind of formal model was mathematical [note 1]. Because it it important to write models formally for the scientific process [note 2] maths became associated with science. However, solving complicated mathematical models is very hard, so to push the envelope of these mathematical models tended to involve cutting edge maths. <br />
<br />
These days when we have a choice of kinds of formal model, we can choose the most appropriate kind of model e.g.: analytic or computational [note 3]. Most complex models are not analytically solvable, so it is usually the computational route that is relevant. <br />
<br />
Some researchers [note 4] feel it is necessary to dress up their models using mathematical formulas, or make the specification of the model more mathematical than it needs to be. This is annoying, not only does it make the specification harder to read, but it reduces one of the advantages of computational modelling -- that the rules can have a natural interpretation in terms of observable processes. [Note 5]<br />
<br />
If this does involve maths, then use it, but do not just to <i><b>look</b></i> 'scientific' -- that is as silly as wearing a white lab coat to program a simulation!<br />
<br />
<br />
<br />
Note 1: This is almost but not quite true, there were models in other formal systems, such as formal logic, but these were vanishingly rare and difficult to use.<br />
<br />
Note 2: Edmonds, B. (2000) <i>The Purpose and Place of Formal Systems in the
Development of Science</i>, CPM Report 00-75, MMU, UK. (<a href="http://cfpm.org/cpmrep75.html">http://cfpm.org/cpmrep75.html</a>)<br />
<br />
Note 3: It does not really matter if one uses maths or code to program, the only important difference is between solving analytically and calculating examples (which is simulating).<br />
<br />
Note 4: All fields have their own 'machismo' how you prove you are a *real* member of the community, in some fields (e.g. economics) this has included showing one's skill at mathematics. Thus this problem is more common in some fields than others, but pretty widespread across many fields.<br />
<br />
Note 5: My first degree was in Mathematics, so I am not afraid of maths, just can step back from the implicit status game of knowing and 'displaying' maths.Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-66193237454774305262017-05-23T23:06:00.000+01:002017-05-23T23:06:18.859+01:00Bruce's Modelling Gripes, No. 7: Assuming simpler is more generalIf one adds in some extra detail to a general model it can become more specific -- that is it then only applies to those cases where that particular detail held. However the reverse is <b>not</b> true: <i>simplifying a model will not make it more general </i>- it is just you can imagine it would be more general.<br />
<br />
To see why this is, consider an accurate linear equation, then eliminate the variable leaving just a constant. The equation is now simpler, but now will only be true at only one point (and only be approximately right in a small region around that point) - it is much less general than the original, because it is true for far fewer cases.<br />
<br />
Only under some special conditions does simplification result in greater generality:<br />
<ol>
<li>When what is simplified away is essentially irrelevant to the outcomes of interest (e.g. when there is some averaging process over a lot of random deviations)</li>
<li>When what is simplified away happens to be constant for all the situations considered (e.g. gravity is always 9.8m/s^2 downwards)</li>
<li>When you loosen your criteria for being approximately right hugely as you simplify (e.g. mover from a requirement that results match some concrete data to using the model as a vague analogy for what is happening)</li>
</ol>
In other cases, where you compare like with like (i.e. you don't move the goalposts such as in (3) above) then it only works if you happen to know <i>what</i> can be safely simplified away.<br />
<br />
Why people think that simplification might lead to generality is somewhat of a mystery. Maybe they assume that the universe has to obey ultimately laws so that simplification is the right direction (but of course, even if this <i>were</i> true, we would not know which way to safely simplify). Maybe they are really thinking about the other direction, slowly becoming more accurate by making the model mirror the target more. Maybe this is just a justification for laziness, an excuse for avoiding messy complicated models. Maybe they just associate simple models with physics. Maybe they just <i><b>hope</b></i> their simple model is more general.Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-18294032651297940212017-05-05T10:06:00.001+01:002017-05-05T18:38:38.712+01:00Bruce's Modelling Gripes, No. 6: Over-hyping significance of a simulation to Funders, Policy Makers and the PublicWhen talking to other simulation modellers, a certain latitude is permissible in terms of describing the potential impact of our models. For example if we say "This simulation could be used to evaluate policy options concerning ...", the audience probably knows that, although this is theoretically possible, the many difficulties in doing this. They make allowance for the (understandable) enthusiasm of the model's creator, for they know such pronouncements will be taken with 'a pinch of salt'.<br />
<br />
However, it is a very different situation when the importance, or impact or possible use of models is exaggerated to an audience of non-modellers, who are likely to take their pronouncements at face value. This includes promises in grant applications, journal publications, public lectures and discussion with policy actors/advisers. They will not be in a position to properly evaluate the claims made and have to take the results on trust (or ignore them along with the advice of other 'experts' and 'boffins').<br />
<br />
The danger is that the reputation of the field will suffer when people rely on models for purposes that they are not established for. The refrain could become "<i>Lies, damned lies, statistics and simulations</i>". This is especially important in this era where scientists are being questioned and sometimes ignored.<br />
<br />
Some of the reasons for such hype lies in the issues discussed in previous posts and some seem to lie elsewhere.<br />
<ul>
<li><a href="http://bruceedmonds.blogspot.nl/2017/03/bruces-modelling-gripes-no1-unclear-or.html">Confusions about purpose</a>, thinking that establishing a simulation for one purpose is enough to suggest a different purpose</li>
<li><a href="http://bruceedmonds.blogspot.nl/2017/04/bruces-modelling-gripes-no-3-thin-or.html">Insufficient validation</a> for the use or importance claimed</li>
<li>Being deceived by the "theoretical spectacles" effect [note 1] -- when one has worked with a model for a while that we tend to see it through the "lens" of that model. Thus we confuse a way of understanding the world for the truth about it.</li>
<li>Sheer fraud: we want a grant, or to get published, or to justify a grant, so we bend the truth about our models somewhat. For example promising far more in a grant proposal than we know we will able to deliver.</li>
</ul>
In a context of other modellers, we can be easily found out and understood. With others we can get away with it for a time, but it will catch up with us in terms of an eventual loss of reputation. We <i><b>really</b></i> do not want to be like the economists!<br />
<br />
Note 1: "theoretical spectacles" was a phrase introduced by Thomas Kuhn to describe the effect of only noticing evidence that is consistent with the theory one believes.<br />
<br />Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-6521861288411640712017-04-27T11:17:00.000+01:002017-04-27T11:19:24.483+01:00Bruce's Modelling Gripes, No. 5: None or not many resultsThe point of a model lies mostly in its results. Indeed, I often only bother to read how a model has been constructed if the results look interesting. One has to remember that how a model is constructed - its basis, the choices you have made, the programming challenges are far, FAR more interesting to you, the programmer, than anyone else. Besides, if you have gone to all the trouble of making a model, the least you can do is extract some results and analyse them.<br />
<br />
Ideally one should include the following:<br />
<ol>
<li>Some indicative results to give readers an idea of the typical or important behaviour of the model. This really helps understand a model's nature and also hints at its "purpose". This can be at a variety of levels - whatever helps to make the results meaningful and vivid. It could include visualisations of example runs as well as the normal graphs -- even following the events happening to a single agent, if that helps.</li>
<li>A sensitivity analysis - checking how varying parameters affects the key results. This involves some judgement as it is usually impossible to do a comprehensive survey. What kind of sensitivity analysis, over what dimensions depends on the nature of the model, but not including ANY sensitivity analysis generally means that you are not (yet?) serious about the model (and if you are not taking it seriously others probably will not either).</li>
<li>In the better papers, some hypotheses about the key mechanisms that seem to determine the significant results are explicitly stated and then tested with some focussed simulation experiments -- trying to falsify the explanations offered. These results with maybe some statistics should be exhibited [note 1].</li>
<li>If the simulation is being validated or otherwise compared against data, this should be (a) shown then (b) measured. [note 2] </li>
<li>If the simulation is claimed to be predictive, its success at repeatedly predicting data (unknown to the modeller at the time) should be tabulated. It is especially useful in this context to give an idea of when the model predicts and when it does not.</li>
</ol>
What you show does depend on your model purpose. If the model is merely to illustrate an idea, then some indicative results may be sufficient for your goal, but more may still be helpful to the reader. If you are aiming to support an explanation of some data then a lot more is required. A theoretical exploration of some abstract mechanisms probably requires a very comprehensive display of results.<br />
<br />
If you have no, or very few results, you should ask yourself if there is any point in publishing. In most occasions it might be better to wait until you have.<br />
<br />
<br />
<br />
Note 1: p-values are probably not relevant here, since by doing enough runs one can pretty much get any p-value one desires. However checking you have the right power is probably important. See<br />
<br />
Note 2: that only some aspects of the results will be considered significant and
other aspects considered model artefacts - it is good practice to be
explicit about this. See<br />
<br />Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-20670114032006297432017-04-20T16:52:00.002+01:002017-04-27T11:19:09.019+01:00Bruce's Modelling Gripes, No. 4: Not being open about code etc.There is no excuse, these days (at least for academic purposes), not to be totally transparent about the details of the simulation. This is simply good scientific practice, so others can check, probe, play around with and inspect what you have done. The collective good that comes of this far outweighs and personal embarrassment at any errors or shortcomings discovered.<br />
<br />
This should include:<br />
<ul>
<li>The simulation code itself, publicly archived somewhere, e.g. openabm.org</li>
<li>Instructions as to how to get the code running (any libraries, special instructions, data needed etc.) </li>
<li>A full description of the simulation, its structures and algorithms (e.g. using the ODD structure or similar)</li>
<li>Links or references to any papers or related models</li>
</ul>
Other things that are useful are:<br />
<ul>
<li>A set of indicative/example results</li>
<li>A sensitivity analysis</li>
<li>An account of how you developed the simulation, what you tried (even if it did not work)</li>
</ul>
For most academics, somehow or other, public money has been spent on funding you do the work, the public have a right to see the results and that you uphold the highest academic standards of openness and transparency. You should do this even if the code is not perfectly documented and rather dodgy! There is no excuse.<br />
<br />
For more on this see: <br />
<blockquote class="tr_bq">
Edmonds, B. & Polhill, G. (2015) <i><span class="il">Open</span> <span class="il">Modelling</span> for Simulators</i>. In Terán, O. &
Aguilar, J. (Eds.) Societal Benefits of Freely Accessible Technologies and
Knowledge Resources. IGI Global, 237-254. <span class="isbn-label">DOI: </span><span title="DOI: 10.4018/978-1-4666-8336-5">10.4018/978-1-4666-8336-5</span>.
(Previous version at <a href="http://cfpm.org/discussionpapers/172/open-modelling-for-simulators-by-bruce-edmonds-and-gary-polhill">http://cfpm.org/discussionpapers/172</a>) </blockquote>
Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-52361998160679930282017-04-12T10:54:00.000+01:002017-04-12T10:54:51.360+01:00Bruce's Modelling Gripes, No. 3: 'thin' or non-existent validationAgent-based models (ABM) are the ultimate in being able to flexibly represent systems we observe. They are also very suggestive in their output - usually more suggestive than their validity would support. For these reasons it is very easy to be taken-in by an ABM, either one's own or another's. Furthermore, good practice in the form of visualisations and co-developing the model with stakeholders increase the danger that all those that might critique the model are cognitively committed to it.<br />
<br />
It is to avoid such (self) deception that validation is undertaken - to make sure our reliance on a model is well-founded and not illusory. Unfortunately, effective validation is resource- and data- intensive and is far from easy. The flexibility in making a model needs to be matched by the strength of the validation checks. To be blunt - it is easy to (unintentionally or otherwise) 'fit' a complex ABM to a single line of data, so it looks convincing. This kind of validation where one aspect of the simulation outcomes is compared against one line of data is called 'thin validation'.<br />
<br />
In physics or other sciences they do do this kind of validation, but they have well-validated micro-foundations so the effective flexibility of their modelling is far less than for a social simulation, where assumptions about the behaviour of the units (typically humans) are not well known. That is why such thin validation is inadequate for social phenomena.<br />
<br />
Of course the kind and relevance of validation depends upon your purpose for modelling. If you are not really talking about the observed world but only exploring an entirely abstract world of mechanisms it might not be relevant. If you are only illustrating an idea or possible series of events and interactions then 'thin' validation might be sufficient.<br />
<br />
However if you are attempting to predict unknown data or establish an explanation for what is observed then you probably need multi-dimensional or multi-aspect validation - checking the simulation in many different ways <i>at once</i>. Thus one might check if the right kind of social network emerges, and statistics about micro-level behaviours are correct and that emergent aggregate time-series are correct and that in snapshots of the simulation there is the right kind of distribution of key attributes. This is 'fat' validation, and then starts to be adequate to pin down our complex constructions.<br />
<br />
Papers that have thin or non-existent validation (e.g. they rely on plausibility alone as a check) might be interesting but should not be interpreted as saying <i><b>anything</b></i> reliable about the world we observe.Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-44662648197096725242017-04-10T13:10:00.001+01:002017-05-25T23:04:43.168+01:00Bruce's Modelling Gripes, No. 2: Making specious excuses for pragmatic limitations on modellingWe are limited beings, with limited time as well as computational and mental capacity. Any modelling of very complex phenomena (social, ecological, biological etc.) will thus be limited in terms of: (a) how much time we can spend on it (b) how much detail we can cope with (checking, validating, understanding etc.) (c) what assumptions we can check<br />
<br />
This is find, but instead of simply being honest about these limits there is a tendency to excuse them, to pretend that these limitations are more fundamentally justified. Three examples are as follows:<br />
<ul>
<li>"for the sake of simplicity" (e.g. <a href="http://jasss.soc.surrey.ac.uk/admin/searchresults.html?q=sake%20of%20simplicity">these articles in JASSS</a>), this implies that simpler models are somehow better in ways beyond that of straightforward pragmatic convenience (e.g. easier to build, check, understand, communicate etc.)</li>
<li>That more complicated models are less complex (e.g. Sun et al.2016) which shows a graph where "<i>complexity may decrease after a certain threshold of model complicatedness</i>". This is sheer wishful thinking, what is more likely to be true is that it is harder to notice complexity in more complicated models, but this is due to our cognitive limitations in terms of pattern recognition, not anything to do with emergent complexity.</li>
<li>Changing English to make our achievements <i>sound</i> more impressive than they are, e.g. to call any calculation using a model a "<i>prediction</i>", when everybody else uses this word to really mean prediction (i.e. anticipating unknown data/observations sufficiently accurately using a model).</li>
</ul>
These weasel words would not matter so much if they were (a) purely internal to the field and everyone understood their meaning and (b) they were not used in public/policy consultations or grant applications where they might be taken seriously. Newcomers to the field often take these excuses too literally and so change what they attempt to do as if these excuses were genuine! This can be an excuse for following the easy option when they should be pushing the boundaries of what is possible. When policy makers/grant funders misunderstand these claims, an inevitable disappointment/disillusionment may follow, damaging the reputation of the field.<br />
<h4>
<b>References</b></h4>
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"Franklin Gothic Book";
panose-1:2 11 5 3 2 1 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin-top:0cm;
margin-right:0cm;
margin-bottom:6.0pt;
margin-left:0cm;
mso-pagination:widow-orphan;
font-size:11.0pt;
font-family:"Franklin Gothic Book";
mso-fareast-font-family:Calibri;
mso-bidi-font-family:"Times New Roman";
mso-ansi-language:EN-GB;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;
mso-header-margin:36.0pt;
mso-footer-margin:36.0pt;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<span lang="EN-GB" style="font-family: "franklin gothic book"; font-size: 11.0pt;">Sun,
Z., Lorscheid, I., Millington, J. D., Lauf, S., Magliocca, N. R., Groeneveld,
J., ... & Buchmann, C. M. (2016). Simple or complicated agent-based models?
A complicated issue. Environmental Modelling & Software, 86, 56-67.</span>
Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-29248379480979140972017-03-27T20:42:00.004+01:002017-03-27T20:42:56.137+01:00Bruce's Modelling Gripes, No.1: Unclear or confused modelling purposeOK, maybe I am just becoming a grumpy ol man, but I thought I would start a series about tendencies in my own field that I think are bad :-), so here goes...<br />
<h3>
<b>Modelling Gripe No.1: Unclear or confused modelling purpose</b></h3>
A model is a tool. Tools are useful for a particular purpose. To justify a new model one has to show it is good for its intended purpose. Some modelling purposes include: prediction, explanation, analogy, theory exploration, illustration... others are listed by Epstein [1]. Even if a model is good for more than one purpose, it needs to be justified separately for each purpose claimed.<br />
<br />
So here are 3 common confusions of purpose:<br />
<br />
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"Franklin Gothic Book";
panose-1:2 11 5 3 2 1 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin-top:0cm;
margin-right:0cm;
margin-bottom:3.0pt;
margin-left:0cm;
mso-pagination:widow-orphan;
font-size:12.0pt;
mso-bidi-font-size:11.0pt;
font-family:"Franklin Gothic Book";
mso-fareast-font-family:Calibri;
mso-bidi-font-family:"Times New Roman";
mso-ansi-language:EN-GB;}
em
{mso-style-priority:20;
mso-style-unhide:no;
mso-style-qformat:yes;
font-family:Calibri;
mso-ascii-font-family:Calibri;
mso-ascii-theme-font:major-latin;
mso-hansi-font-family:Calibri;
mso-hansi-theme-font:major-latin;
font-weight:bold;
mso-bidi-font-weight:normal;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
margin-top:0cm;
margin-right:0cm;
margin-bottom:3.0pt;
margin-left:36.0pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
mso-bidi-font-size:11.0pt;
font-family:"Franklin Gothic Book";
mso-fareast-font-family:Calibri;
mso-bidi-font-family:"Times New Roman";
mso-ansi-language:EN-GB;}
p.MsoListParagraphCxSpFirst, li.MsoListParagraphCxSpFirst, div.MsoListParagraphCxSpFirst
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
mso-bidi-font-size:11.0pt;
font-family:"Franklin Gothic Book";
mso-fareast-font-family:Calibri;
mso-bidi-font-family:"Times New Roman";
mso-ansi-language:EN-GB;}
p.MsoListParagraphCxSpMiddle, li.MsoListParagraphCxSpMiddle, div.MsoListParagraphCxSpMiddle
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
mso-bidi-font-size:11.0pt;
font-family:"Franklin Gothic Book";
mso-fareast-font-family:Calibri;
mso-bidi-font-family:"Times New Roman";
mso-ansi-language:EN-GB;}
p.MsoListParagraphCxSpLast, li.MsoListParagraphCxSpLast, div.MsoListParagraphCxSpLast
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:3.0pt;
margin-left:36.0pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
mso-bidi-font-size:11.0pt;
font-family:"Franklin Gothic Book";
mso-fareast-font-family:Calibri;
mso-bidi-font-family:"Times New Roman";
mso-ansi-language:EN-GB;}
p.Numbered, li.Numbered, div.Numbered
{mso-style-name:Numbered;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"List Paragraph";
margin-top:0cm;
margin-right:0cm;
margin-bottom:3.0pt;
margin-left:36.0pt;
mso-add-space:auto;
text-indent:0cm;
mso-pagination:widow-orphan;
mso-list:l0 level1 lfo1;
tab-stops:list 18.0pt;
font-size:12.0pt;
mso-bidi-font-size:11.0pt;
font-family:"Franklin Gothic Book";
mso-fareast-font-family:Calibri;
mso-bidi-font-family:"Times New Roman";
mso-ansi-language:EN-GB;}
p.NumberedCxSpFirst, li.NumberedCxSpFirst, div.NumberedCxSpFirst
{mso-style-name:NumberedCxSpFirst;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"List Paragraph";
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:0cm;
mso-pagination:widow-orphan;
mso-list:l0 level1 lfo1;
tab-stops:list 18.0pt;
font-size:12.0pt;
mso-bidi-font-size:11.0pt;
font-family:"Franklin Gothic Book";
mso-fareast-font-family:Calibri;
mso-bidi-font-family:"Times New Roman";
mso-ansi-language:EN-GB;}
p.NumberedCxSpMiddle, li.NumberedCxSpMiddle, div.NumberedCxSpMiddle
{mso-style-name:NumberedCxSpMiddle;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"List Paragraph";
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:0cm;
mso-pagination:widow-orphan;
mso-list:l0 level1 lfo1;
tab-stops:list 18.0pt;
font-size:12.0pt;
mso-bidi-font-size:11.0pt;
font-family:"Franklin Gothic Book";
mso-fareast-font-family:Calibri;
mso-bidi-font-family:"Times New Roman";
mso-ansi-language:EN-GB;}
p.NumberedCxSpLast, li.NumberedCxSpLast, div.NumberedCxSpLast
{mso-style-name:NumberedCxSpLast;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"List Paragraph";
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:3.0pt;
margin-left:36.0pt;
mso-add-space:auto;
text-indent:0cm;
mso-pagination:widow-orphan;
mso-list:l0 level1 lfo1;
tab-stops:list 18.0pt;
font-size:12.0pt;
mso-bidi-font-size:11.0pt;
font-family:"Franklin Gothic Book";
mso-fareast-font-family:Calibri;
mso-bidi-font-family:"Times New Roman";
mso-ansi-language:EN-GB;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;
mso-header-margin:36.0pt;
mso-footer-margin:36.0pt;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:888150590;
mso-list-type:hybrid;
mso-list-template-ids:-62855436 1114557396 134807577 134807579 134807567 134807577 134807579 134807567 134807577 134807579;}
@list l0:level1
{mso-level-style-link:Numbered;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:17.85pt;
text-indent:-17.85pt;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
-->
</style>
<br />
<div class="Numbered" style="margin-bottom: .0001pt; margin-bottom: 0cm; margin-left: 17.85pt; margin-right: 0cm; margin-top: 0cm; mso-list: l0 level1 lfo2; tab-stops: 36.0pt; text-indent: -17.85pt;">
<span style="font-family: inherit;"><span lang="EN-GB" style="mso-bidi-font-family: "Franklin Gothic Book"; mso-fareast-font-family: "Franklin Gothic Book";"><span style="mso-list: Ignore;">1.<span style="font-feature-settings: normal; font-kerning: auto; font-language-override: normal; font-size-adjust: none; font-size: 7pt; font-stretch: normal; font-style: normal; font-synthesis: weight style; font-variant: normal; font-weight: normal; line-height: normal;">
</span></span></span><em>Understanding
Theory or Analogy </em><em><span style="mso-char-type: symbol; mso-symbol-font-family: Symbol;">-></span></em><em> Explanation</em><span lang="EN-GB">. Once one has immersed oneself in a model, there is a danger that
the world looks like this model to its author. Here the temptation is to immediately
jump to an explanation of something in the world. A model can provide a way of
looking at some phenomena, but just because one can view some phenomena in a
particular way does not make it a good explanation. </span></span></div>
<span style="font-family: inherit;">
</span><div class="Numbered" style="margin-bottom: .0001pt; margin-bottom: 0cm; margin-left: 17.85pt; margin-right: 0cm; margin-top: 0cm; mso-list: none; tab-stops: 36.0pt;">
<br /></div>
<span style="font-family: inherit;">
</span><div class="Numbered" style="margin-bottom: .0001pt; margin-bottom: 0cm; margin-left: 17.85pt; margin-right: 0cm; margin-top: 0cm; mso-list: l0 level1 lfo1; tab-stops: 36.0pt; text-indent: -17.85pt;">
<span style="font-family: inherit;"><span lang="EN-GB" style="mso-bidi-font-family: "Franklin Gothic Book"; mso-fareast-font-family: "Franklin Gothic Book";"><span style="mso-list: Ignore;">2.<span style="font-feature-settings: normal; font-kerning: auto; font-language-override: normal; font-size-adjust: none; font-size: 7pt; font-stretch: normal; font-style: normal; font-synthesis: weight style; font-variant: normal; font-weight: normal; line-height: normal;">
</span></span></span><em>Explanation </em><em><span style="mso-char-type: symbol; mso-symbol-font-family: Symbol;">-></span></em><em> Prediction</em><span lang="EN-GB">. A model that establishes an explanation traces a (complex) set of causal
steps from the model set-up to outcomes that compare well with observed data.
It is thus tempting to suggest that one can use this model to predict this
observed data. However, establishing that a model is good for prediction
requires its testing against unknown data many times – this goes way beyond
what is needed to establish a candidate explanation for some phenomena. </span></span></div>
<span style="font-family: inherit;">
</span><div class="Numbered" style="margin-bottom: .0001pt; margin-bottom: 0cm; margin-left: 17.85pt; margin-right: 0cm; margin-top: 0cm; mso-list: none; tab-stops: 36.0pt;">
<br /></div>
<span style="font-family: inherit;">
</span><div class="Numbered" style="margin-bottom: .0001pt; margin-bottom: 0cm; margin-left: 17.85pt; margin-right: 0cm; margin-top: 0cm; mso-list: l0 level1 lfo1; tab-stops: 36.0pt; text-indent: -17.85pt;">
<span style="font-family: inherit;"><span lang="EN-GB" style="mso-bidi-font-family: "Franklin Gothic Book"; mso-fareast-font-family: "Franklin Gothic Book";"><span style="mso-list: Ignore;">3.<span style="font-feature-settings: normal; font-kerning: auto; font-language-override: normal; font-size-adjust: none; font-size: 7pt; font-stretch: normal; font-style: normal; font-synthesis: weight style; font-variant: normal; font-weight: normal; line-height: normal;">
</span></span></span><em>Illustration -></em><em><span style="mso-char-type: symbol; mso-symbol-font-family: Symbol;"></span></em><em> Understanding Theory</em><span lang="EN-GB">. A neat illustration of an idea, suggests a mechanism. Thus the
temptation is to use a model designed as an illustration or playful exploration
as being sufficient for the purpose of a Understanding Theory. Understanding
Theory involves the extensive testing of code to check the behaviour and any assumptions.
An illustration, however suggestive, is not that rigorous. For example, it
maybe that an illustrated process only appears under very particular
circumstances, or it may be that the outcomes were due to aspects of the model
that were thought to be unimportant. The work to rule out these kinds of
possibility is what differentiates using a model as an illustration from
modelling for Understanding Theory.</span></span></div>
<div class="Numbered" style="margin-bottom: .0001pt; margin-bottom: 0cm; margin-left: 17.85pt; margin-right: 0cm; margin-top: 0cm; mso-list: l0 level1 lfo1; tab-stops: 36.0pt; text-indent: -17.85pt;">
<br /></div>
<span lang="EN-GB">Unfortunately many authors are not clear in their papers about specifying exactly for which purpose they are justifying their model. Maybe they have not thought about it, maybe they are just confused and maybe they are just being sloppy (e.g. assuming because its good for one purpose it is good for another).</span><br />
<br />
<br />Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-70604692017725836572017-03-06T11:44:00.003+00:002017-03-06T11:44:32.580+00:00The Post-Truth Drift -- why it is partly the fault of Science (a short essay)In a time which talks about being in a "post-truth" era of public discourse and where the reputation of "experts" as a group is questioned, it is easy to blame others for the predicament that Scientists find themselves (e.g. politicians, journalists, big business interests etc.). However, I argue that substantial part of the blame must fall on ourselves, the scientists -- that we have (collectively), more than anyone, knocked away the pedestal on which they stood.<br /><br />Firstly, scientists have increasingly allowed their work to be prematurely publicised - "announcing" breakthroughs with the first indicative results (or even before). It is, of course, understandable that scientists should believe in their own research, but it should be part of the discipline that we do not claim more than we have proved. Partly this is due to funding and institutional pressure, to quickly claim impact and progress (I remember an EU funding call that asked for "fundamental theoretical breakthroughs" and "policy impact" in the same project), but again it is part of the job to resist these pressures. More fundamentally, the basis for academic reputation has changed from cautious work to being first with new theories -- from collective to individual achievement.<br /><br />The result of this over-hyping of results is that science loses its reputation for caution and reliability. This has been particularly stark in some of the "softer" sciences like nutrition or economics. All the clever mathematics in the world did not stop economists missing the last economic collapse - their lack of empirical foundations coming back to bite them. In the case of nutrition, a series of discoveries have been announced before their full complexity is understood. <br /><br />However this goes a lot further than the softer sciences. The recent crisis in reproducibility in many fields indicates that publication has overtaken caution even for results that are not publicised outside their own field. This indicates that there is an imbalance in these fields with not enough people replicating and checking work and too many racing to discover things first. This is evident in some fields where there are a lot of researchers proposing or talking about abstract theories and not many doing the more concrete work, such as empirical measurement. Reputation should follow when an idea or model empirically checks out and not before. <br /><br />Measuring academic reputation on citation-based indices reinforces this deleterious trend - one can get many citations for proposing an attractive or controversial idea, but it is independent of whether one was right or not. If we reward academics by their academic popularity with their peers rather than whether they were right, then that will affect the kind of academics we attract into the profession. Many fields are dominated by cliques who cite each other and (consciously or unconsciously) determine the methodological norms. <br /><br />All fields need some methodological norms, however these norms can come about in ways that are independent of their success or reliability. Papers that grab a lot of attention can be more influential in these terms than those that turned out to be right. All fields seem to adjust their standards of success to ensure that the field, as a whole, can demonstrate progress and hence justify itself. When faced with highly complex phenomena, this can lead to a dilution of the criteria of success so this is achievable. In my field, abstract simulations without strong empirical foundations that provide a way of thinking about issues, gain more attention than they should and, more worryingly, are then advertised as able to perform "what if" analyses on policy inventions (implying their results will somehow correspond to reality). In economics, prediction rather than structural realism was declared as the aim of its modelling, but this weakened to predicting known out-of-sample data. <br /><br />If all this weakening of criteria were internal and scientists were ultra-careful about not deceiving others into thinking their results were reliable, this would not be so bad. However, whether deliberately or otherwise, far too often the funders/policy makers/public are left with an impression that declared findings are more solidly based than they are. This is exacerbated by the grant funding process, where people who promise great results and impact are funded and more realistic proposals rejected. If one gets a grant, based upon such promises there is then pressure to justify outcomes that fall short of these, and to use language to obscure this. <br /><br />Finally, when scientific advice and the policy world meet there is often fundamental misunderstanding, and this is partly the fault of the academics. In the wish for relevance and "impact" academics can be pressured into not being completely honest, and providing the policy makers with what they want regardless of whether this is justified by the science. One trouble with this interface is that there is not a clear line of responsibility -- if the advice from the scientists conflicts with those of the policy makers, what are they to do? If they trust some complex process that they do not understand they are effectively delegating some of their responsibility, if they only trust it if agrees with their intuitions then this selection bias ensures that support rather than critique of decisions gets diffused.<br /><br />The blurring of political and scientific debate that results from a non-cautious entry into policy debate has resulted in a conflation between debate over method and reliability of results to a confrontation of alternative results. Classically science has not debated results, but rather critiqued each other's method. If there are conflicting results this will not be resolved by debate but by further research. Alternative ideas should be tolerated until there is enough evidence to adjudicate between them. The competition should be in terms of sounder method, not in terms of which theory is better on any other grounds. Thus scientific debate has become conflated with political debate where, rightly, different ideas are contrasted and argued about.<br /><br />There are some positive sides for science to the "post-truth" tendencies. The disconnected "ivory tower" school of research is rightly criticised. Whilst what academics do should not be constrained, what they use public money for has to be. The automatic deference that academics used to have from the public has also largely disappeared, meaning that results from scientists will be more readily questioned for its unconscious biases and meaning of its claims. To some extent the profession has become more porous with a wider range of people participating in the process of science - it is not just professors or boffins anymore.<br /><br />Ultimately maintaining academic and research standards is the job of the academics themselves. The institutions they work in, the funders of research and the current governmental priorities mean that other involved actors will have other priorities. Universities compete in terms of the frameworks that government sets (REF, TEF etc.) or league tables constructed on simplistic indices. Funders of research are under pressure to claim research that has immediate and significant impact and publicity. It is only the academics themselves that can resist these pressures and so maintain their own, long-term reputations for independence and reliability. If we do not have these things, why should the public carry on financing us? What will people think of our science in 50 or 100 years time? Let the longer view prevail.Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0tag:blogger.com,1999:blog-9029713900145859849.post-526517598611737212017-02-17T14:54:00.001+00:002017-02-17T14:54:09.659+00:00Discussion paper: "Co-developing beliefs and social influence networks – towards understanding Brexit"Centre for Policy Modelling Discussion paper: <a href="http://cfpm.org/discussionpapers/186/Co-developing+beliefs+and+social+influence+networks" rel="bookmark">CPM-17-235</a><br />
<h2>
Abstract. </h2>
<blockquote class="tr_bq">
A relatively simple model is presented where the beliefs of agents
and their social network co-develop. Agents can either hold or not each
of a fixed menu of candidate beliefs. Depending on their type, agents
have different coherency functions between beliefs, so that they are
more likely to adopt a belief from a neighbour or drop a belief where
this increases the total coherency of their belief set. With given
probabilities links are randomly dropped or added but, if possible,
links are made to a “friend of a friend”. The outcomes when both belief
and link change processes occur are qualitatively different from either
alone, showing the necessity of representing both cognitive and social
processes together. Some example results are shown which moves a little
towards modelling the processes behind divisive collective decisions,
such as the Brexit vote.</blockquote>
<h2>
Downloads</h2>
<ul>
<li>The paper can be downloaded at: <a href="http://cfpm.org/file_download/177/BE-co-evolving+belliefs+and+social+network-AISB08.pdf">http://cfpm.org/file_download/177/BE-co-evolving+belliefs+and+social+network-AISB08.pdf</a></li>
<li>The model can be accessed at: <a href="http://www.openabm.org/model/5116">http://www.openabm.org/model/5116</a></li>
<li>Some slides that discuss the model are at: <a href="https://www.slideshare.net/BruceEdmonds/a-model-of-social-and-cognitive-coherence">https://www.slideshare.net/BruceEdmonds/a-model-of-social-and-cognitive-coherence</a></li>
</ul>
Bruce Edmondshttp://www.blogger.com/profile/02527239324614461479noreply@blogger.com0