There is much discussion about flaws of ‘democratic’ governance systems, supposedly leading to increasingly threatening crises. Calls for ‘fixing’ these challenges tend to focus on single problems, urging single ‘solutions’. Even recommendations for application of ‘systems thinking’ tools seem to be fixated on the phase of ‘problem understanding’ of the process; while promotions of AI (artificial / augmented intelligence) sound like solutions are likely to be found by improved collection and analysis of data, of information in existing ‘knowledge bases’. Little effort seems devoted to actually ‘connecting the dots’ – linking the different aspects and problems, making key improvements that serve multiple purposes. The following attempt is an example of such an effort to develop comprehensive ‘connecting the dots’ remedies – one that itself arguably would help realize the ambitious dream of democracy, proposed for discussion. A selection (not a comprehensive account) of some often invoked problems, briefly:
“Voter apathy” The problem of diminishing participation in current citizen participation in political discourse and decisions / elections, leading to unequal representation of all citizens’ interests;
“Getting all needed information”
The problem of eliciting and assembling all pertinent ‘documented’ information (‘data’) but also critical ‘distributed’ information especially for ‘wicked problems’, – but:
“Avoiding information overload”
The phenomenon of ‘too much information’, much of which may be repetitive, overly rhetorical, judgmental, misleading (untruthful) or irrelevant;
“Obstacles to citizens’ ability to voice concerns”
The constraints to citizens’ awareness of problems, plans, overview of discourse, ability to voice concerns;
“Understanding the problem”
Social problems are increasingly complex, interconnected, ill-structured, explained in different, often contradicting ways, without ‘true’ (‘correct) or ‘false’ answers, and thus hard to understand, leading to solution proposals which may result in unexpected consequences that can even make the situation worse;
“Developing better solutions”
The problem of effectively utilizing all available tools to the development of better (innovative) solutions;
The problem of conducting meaningful (less ‘partisan’ and vitriolic, more cooperative, constructive) discussion of proposed plans and their pros and cons;
“Better evaluation of proposed plans”
The task of meaningful evaluation of proposed plans;
“Developing decisions based on the merit of discourse contributions”
Current decision methods do not guarantee ‘due consideration’ of all citizens’ concerns but tend to ignore and override as much as the contributions and concerns of half of the population (voting minority);
“The lack of meaningful measures of merit of discourse contributions”
Lack of convincing measures of the merit of discourse contributions: ideas, information, strength of evidence, weight of arguments and judgments;
“Appointing qualified people to positions of power”
Finding qualified people for positions of power to make decisions that cannot be determined by lengthy public discourse — especially those charged with ensuring
“Adherence to decisions / laws / agreements”
The problem of ‘sanctions’ ensuring adherence to decisions reached or issued by governance agencies: ‘enforcement’ – (requiring government ‘force’ greater than potential violators leading to ‘force’ escalation;
“Control of power”
To prevent people in positions of power from falling victim to temptations of abusing their power, better controls of power must be developed.
Some connections and responses:
Details of possible remedies / responses to problems, using information technology, aiming at having specific provisions (‘contribution credits’) work together with new methodological tools (argument and quality evaluation) to serve multiple purposes:
Participation and contribution incentives: for example, offering ‘credit points’ for contributions to the planning discourse, saved in participants’ ‘contribution credit account’ as mere ‘contribution’ or participation markers, (to be evaluated for merit later.)
“Getting all needed information”
A public projects ‘bulletin board’ announcing proposed projects / plans, inviting interested and affected parties to contribute comments, information, not only from knowledge bases of ‘documented’ information (supported by technology) but also ‘distributed, not yet documented information from parties affected by the problem and proposed plans.
“Avoiding information overload”
Points given only for ‘first’ entries of the same content and relevance to the topic
(This also contributes to speedy contributions and assembling information)
“Obstacles to citizens’ ability to voice concerns”
The public planning discourse platform accepts entries in all media, with entries displayed on public easily accessible and regularly (ideally real-time) updated media, non-partisan
“Understanding the problem”
The platform encourages representation of the project’s problem, intent and ‘explanation’ from different perspectives. Systems models contribute visual representation of relationships between the various aspects, causes and consequences, agents, intents and variables, supported by translation not only between different languages but also from discipline ‘jargon’ to natural conversational language.
“Developing better solutions”
Techniques of creative problem analysis and solution development, (carried out by ‘special techniques’ teams reporting results to the pain platform) as well as information about precedents and scientific and technology knowledge support the development of solutions for discussion
While all entries are stored for reference in the ‘Verbatim’ repository, the discussion process will be structured according to topics and issues, with contributions condensed to ‘essential content’, separating information claims from judgmental characterization (evaluation to be added separately, below) and rhetoric, for overview display (‘IBIS’ format, issue maps) and facilitating systematic assessment.
“Better evaluation of proposed plans”
Systematic evaluation procedures facilitate assessment of plan plausibility (argument evaluation) and quality (formal evaluation to mutually explain participants’ basis of judgment) or combined plausibility-weighted quality assessment.
“Meaningful measures of merit”
The evaluation procedures produce ‘judgment based’ measures of plan proposal merit that guide individual and collective decision judgments. The assessment results also are used to add merit judgments (veracity, significance, plausibility, quality of proposal) to individuals’ first ‘contribution credit’ points, added to their ‘public credit accounts’.
“Decision based on merit”
For large public (at the extreme, global) planning projects, new decision modes and criteria are developed to replace traditional tools (e.g. majority voting)
“Qualified people to positions of power”
Not all public governance decisions need to or can wait for the result of lengthy discourse, thus, people will have to be appointed (elected) to positions of power to make such decisions. The ‘public contribution credits’ of candidates are used as additional qualification indicators for such positions.
“Control of power”
Better controls of power can be developed using the results of procedures proposed above: Having decision makers ‘pay’ for the privilege of making power decisions using their contribution credits as the currency for ‘investments’ in their decision: Good decision will ‘earn’ future credits based on public assessment of outcomes; poor decisions will reduce the credit accounts of officials, forcing their resignation if depleted. ‘Supporters’ of officials can transfer credits from their own accounts to the official’s account to support the official’s ability to make important decisions requiring credits exceeding their own account. They can also withdraw such contributions if the official’s performance has disappointed the supporter.
This provision may help reduce the detrimental influence of money in governance, and corresponding corruption.
“Adherence to decisions / laws / agreements”
One of the duties of public governance is ‘enforcement’ of laws and decisions. The very word indicates the narrow view of tools for this: force, coercion. Since government force must necessarily exceed that of any would-be violator to be effective, this contributes both to the temptation of corruption, — to abuse their power because there is no greater power to prevent it, and to the escalation of enforcement means (weaponry) by enforces and violators alike. For the problem of global conflicts, treaties, and agreements, this becomes a danger of use of weapons of mass destruction if not defused. The possibility of using provisions of ‘credit accounts’ to develop ‘sanctions’ that do not have to be ‘enforced’ but triggered automatically by the very attempt of violation, might help this important task.
The discussion about whether and to what extent Artificial Intelligence technology can meaningfully support the planning process with contributions similar or equivalent to human thinking is largely dominated by controversies about what constitutes thinking. An exploration of the reasoning patterns in the various phases of human planning discourse could produce examples for that discussion, leaving the determination of that definition label ‘thinking’ open for the time being.
One specific example (only one of several different and equally significant aspects of planning):
People propose plans for action, e.g. to solve problems, and then engage in discussion of the ‘pros and cons’ of those plans: arguments. A typical planning argument can be represented as follows:
“Plan A should be adopted for implementation, because
i) Plan A will produce consequences B, given certain conditions C, and
ii) Consequences B ought to be pursued (are desirable); and
iii) Conditions C are present (or will be, at implementation).
Question 1: could such an argument be produced by automated technological means?
This question is usually followed up by question 2: Would or could the ‘machine’ doing this be able (or should it be allowed) to also make decisions to accept or reject the plan?
Can meaningful answer to these questions be found? (Currently or definitively?)
Beginning with question 1: Formulating such an argument in their minds, humans draw on their memory — or on explanations and information provided during the discourse itself — for items of knowledge that could become premises of arguments:
‘Factual-instrumental’ knowledge of the form “FI (A –> X)”, for example (“A will cause X’, given conditions C;
‘Deontic’ Knowledge: of the form “D(X)” or “X ought to be’ (is desirable)”, and
Factual Knowledge of the form “F ( C)” or “Conditions C are given”.
‘Argumentation-pattern knowledge’: Recognition that any of the three knowledge items above can be inserted into an argument pattern of the form
D(A) <– ((A–> X)|C)) & D(X) & F( C)).
(There are of course many variations of such argument patterns, depending on assertion or negation of the premises, and different kinds of relations between A and X.)
It does not seem to be very difficult to develop a Knowledge Base (collection) of such knowledge items and a search-and-match program that would assemble ‘arguments’ of this pattern.
Any difficulties arguably would be more related to the task of recognizing and suitably extracting such items (‘translating’ it into the form recognizable to the program) from the human recorded and documented sources of knowledge, than to the mechanics of the search-and-match process itself. Interpretation of meaning: is an item expressed in different words equivalent to other terms that are appropriate to the other potential premises in an argument?
Another slight quibble relates to the question whether and to what extent the consequence qualifies as one that ‘ought to be’ (or not) — but this can be dealt with by reformulating the argument as follows:
“If (FI(A –> X|C) & D(X) & F( C)) then D(A)”.
(It should be accompanied by the warning that this formulation that ‘looks’ like a valid logic argument pattern is in fact not really applicable to arguments containing deontic premises, and that a plan’s plausibility does not rest on one single argument but on the weight of all its pros and cons.)
But assuming that these difficulties can be adequately dealt with, the answer to question 1) seems obvious: yes, the machine would be able to construct such arguments. Whether that already qualifies as ‘thinking’ or ‘reasoning’ can be left open; the significant realization is equally obvious: that such contributions could be potentially helpful contributions to the discourse. For example, by contributing arguments human participants had not thought of, they could be helping to meet the aim of ensuring — as much as possible — that the plan will not have ‘unexpected’ undesirable side-and-after-effects. (One important part of H. Rittel’s very definition of design and planning.)
The same cannot as easily be said about question 2.
The answer to that question hinges on whether the human ‘thinking’ activities needed to make a decision to accept or reject the proposed plan can be matched by ‘the machine’. The reason is, of course, that not only the plausibility of each argument will have to be ‘evaluated’, judged, (by assessing the plausibility of each premise) but also that the arguments must be weighed against one another. (A method for doing that has been described e.g in ‘The Fog Island Argument” and several papers.)
So a ‘search and match’ process as the first part of such a judgment process would have to look for those judgments in the data base, and the difficulty here has to do with where such judgments would come from.
The prevailing answers for factual-instrumental premises as well as for fact-premises — premises i) and iii) — are drawing on ‘documented’ and commonly accepted truth, probability, or validity. Differences of opinion about claims drawn from ‘scientific’ and technical work, if any, are decided by a version of ‘majority voting’ — ‘prevailing knowledge’, accepted by the community of scientists or domain experts, ‘settled’ controversies, derived from sufficiently ‘big data’ (“95% of climate scientists…”) can serve as the basis of such judgments. It is often overlooked that the premises of planning arguments, however securely based on ‘past’ measurements, observations etc, are inherently predictions. So any certainty about their past truth must at least be qualified with a somewhat lesser degree of confidence that they will be equally reliably true in future: will the conditions under which the A –> X relationships are assumed to hold, be equally likely to hold in the future? Including the conditions that may be — intentionally or inadvertently — changed as a result of future human activities pursuing different aims than those of the plan?
The question becomes even more controversial for the deontic (ought-) premises of the planning arguments. Where do the judgments come from by which their plausibility and importance can be determined? Humans can be asked to express their opinions — and prevalent social conventions consider the freedom to not only express such judgments but to have them given ‘due consideration’ in public decision-making (however roundabout and murky the actual mechanisms for realizing this may be) as a human right.
Equally commonly accepted is the principle that machines do not ‘have’ such rights. Thus, any judgment about deontic premises that might be used by a program for evaluating planning arguments would have to be based on information about human judgments that can be found in the data base the program is using. There are areas where this is possible and even plausible. Not only is it prudent to assign a decidedly negative plausibility to deontic claims whose realization contradicts natural laws established by science (and considered still valid…like ‘any being heavier than air can’t fly…’). But there also are human agreements — regulations and laws, and predominant moral codes — that summarily prohibit or mandate certain plans or parts of plans; supported by subsequent arguments to the effect that we all ought not break the law, regardless of our own opinions. This will effectively ‘settle’ some arguments.
And there are various approaches in design and planning that seem to aim at finding — or establishing — enough such mandates or prohibitions that, taken together, would make it possible to ‘mechanically’ determine at least whether a plan is ‘admissible’ or not — e.g. for buildings, whether its developer should get a building permit.
This pattern is supported in theory by modal logic branches that seek to resolve deontic claims on the basis of ‘true/false’ judgments (that must have been made somewhere by some authority) of ‘obligatory’, ‘prohibited’, ‘permissible’ etc. It can be seen to be extended by at last two different ‘movements’ that must be seen as sidestepping the judgment question.
One is the call for society as a whole to adopt (collectively agree upon) moral, ethical codes whose function is equivalent to ‘laws’ — from which the deontic judgment about plans could be derived by mechanically applying the appropriate reasoning steps — invoking ‘Common Good’ mandates supposedly accepted unanimously by everybody. The question whether and how this relates to the principle of granting the ‘right’ of freely holding and happily pursuing one’s own deontic opinions is usually not examined in this context.
Another example is the ‘movement’ of Alexander’s ‘Pattern Language’. Contrary to claims that it is a radically ‘new’ theory, it stands in a long and venerable tradition of many trades and disciplines to establish codes and collections of ‘best practice’ rules of ‘patterns’ — learned by apprentices in years of observing the masters, or compiled in large volumes of proper patterns. The basic idea is that of postulating ‘elements’ (patterns) of the realm of plans, and relationships between these, by means of which plans can be generated. The ‘validity’ or ‘quality’ of the generated plan is then guaranteed by the claim that each of the patterns (rules) are ‘valid’ (‘true’, or having that elusive ‘quality without a name’). This is supported by showing examples of environments judged (by intuition, i.e. needing no further justification) to be exhibiting ‘quality’, by applications of the patterns. The remaining ‘solution space’ left open by e.g. the different combinations of patterns, then serves as the basis for claims that the theory offers ‘participation’ by prospective users. However, it hardly needs pointing out that individual ‘different’ judgments — e.g. based on the appropriateness of a given pattern or relationship — are effectively eliminated by such approaches. (This assessment should not be seen as a wholesale criticism of the approach, whose unquestionable merit is to introduce quality considerations into the discourse about built environment that ‘common practice’ has neglected.)
The relevance of discussing these approaches for the two questions above now becomes clear: If a ‘machine’ (which could of course just be a human, untiringly pedantic bureaucrat assiduously checking plans for adherence to rules or patterns) were able to draw upon a sufficiently comprehensive data base of factual-instrumental knowledge and ‘patterns or rules’, it could conceivably be able to generate solutions. And if the deontic judgments have been inherently attached to those rules, it could claim that no further evaluation (i.e. inconvenient intrusion of differing individual judgments would be necessary.
The development of ‘AI’ tools of automated support for planning discourse — will have to make a choice. It could follow this vision of ‘common good’ and valid truth of solution elements, universally accepted by all members of society. Or it could accept the challenge of a view that it either should refrain from intruding on the task of making judgments, or going to the trouble of obtaining those judgments from human participants in the process, before using them in the task of deriving decisions. Depending on which course is followed, I suspect the agenda and tasks of current and further research and development and programming will be very different. This is, in my opinion, a controversial issue of prime significance.
Levels of assessment depth in planning discourse: A three-tier experimental (‘pilot’) version of a planning discourse support systemPosted: February 4, 2018
Thorbjoern Mann, February 2018
A ‘pilot’ version of a needed full scale Planning Discourse Support System (‘PDSS’)
to be run on current social media platforms such as Facebook
The following are suggestions for an experimental application of a ‘pilot’ version of the structured planning discourse platform that should be developed for planning projects with wide public participation, at scales ranging from local issues to global projects.
Currently available platforms do not yet offer all desirable features of a viable PDSS
The eventual ‘global’ platform will require research, development and integrated programming features that current social media platforms do not yet offer. The ‘pilot’ project is aiming at producing adequate material to guide further work and attract support and funding a limited ‘pilot’ version of the eventual platform, that can be run on currently available platforms.
Provisions for realization of key aims of planning: wide participation;
decisions based on merit of discourse contribution;
recognition of contribution merit;
presented as optional add-on features
leading to a three-tier presentation of the pilot platform
One of the key aims of the overall project is the development of a planning process leading to decisions based on the assessed merit of participants’ contributions to the discourse. The procedural provisions for realizing that aim are precisely those that are not supported by current platforms, and will have to be implemented as optional add-on processes (‘special techniques’) by smaller teams, outside of the main discourse. Therefore, the proposal is presented as a set of three optional ‘levels’ of depth of analysis and evaluation. Actual projects may choose the appropriate level inconsideration of the project’s complexity and importance, of the degree of consensus or controversy emerging during the discourse, and the team’s familiarity with the entire approach and the techniques involved.
1 General provisions
2 Basic structured discourse
3 Structured discourse with argument plausibility assessment
4 Assessment of plausibility-adjusted Quality assessment
5 Sample ‘procedural’ agreements
6 Possible decision modes based on contribution merit
7 Discourse contribution merit rewards
1 General Provisions
Main (e.g. Facebook) Group Page
Assuming a venue like Facebook, a new ‘group’ page will be opened for the experiment. It will serve as a forum to discuss the approach and platform provisions, and to propose and select ‘projects’ for discussion under the agreed-upon procedures.
Project proposals and selection
Group members can propose ‘projects’ for discussion. To avoid project discussions being overwhelmed by references to previous research and literature, the projects selected for this experiment should be as ‘new’ (‘unprecedented’) and limited in scope as possible. (Regrettably, this will make many urgent and important issues ineligible for selection.)
Separate Project Page for selected projects
For each selected project, a new group page will be opened to ensure sufficient hierarchical organization options within the project. There will be specific designated threads within each group, providing the basic structure of each discourse. A key feature not seen in social media discussions is the ‘Next step’ interruption of the process, in which participants can choose between several options of continuing or ending the process.
‘Participants’ in projects will be selected from the number of ‘group members’ having signed up, expressing an interest in participating, and agree to proceed according to the procedural agreements for the project.
Main Process and ‘Special Techniques’
The basic process of project discourse is the same for all three levels; the argument plausibility assessment and project quality assessment procedures are easily added to the simple sequence of steps of the ‘basic’ versions described in section 2.
In previous drafts of the proposal, these assessment tools have been described as ‘special techniques’ that would require provisions of formatting, programming and calculation. For any pilot version, they would have to be conducted by ‘special teams’ outside of the main discourse process. This also applies to the proposed three-level versions and the two additional ‘levels’ of assessment presented here. Smaller ‘special techniques teams’ will have to be designated to work outside of the main group discussion, (e.g. by email); they will report their results back to the main project group for consideration and discussion.
For the first implementation of the pilot experiment, only two such special techniques: the technique of argument plausibility assessment, and the evaluation process for plan proposal ‘quality’ (‘goodness’) are considered; they are seen as key components of the effort to link decisions to the merit of discourse contributions.
2 Basic structured discourse
Project selection Group members post suggestions for projects (‘project candidates) on the group’s main ‘bulletin board’. If a candidate is selected, the posting member will act as its ‘facilitator’ or co-facilitator. Selection is done by posting an agreed-upon minimum of ‘likes’ for a project candidate. By posting a ‘like’, group members signal their intention to become ‘project participants’ and actively contribute to the discussion.
Project bulletin page, Project description
For selected projects, a new page serving as introduction and ‘bulletin board’ for the project will be opened. It will contain a description of the project (which will be updated as modifications are agreed upon). For the first pilot exercise, the projects should be an actual plan or action proposals.
On a separate thread, a ‘default’ version of procedural agreements will be posted. They may be modified in response to project conditions and expected level of depth, ideally before the discussion starts. The agreements will specify the selection criteria for issues, and the decision modes for reaching recommendations or decisions on the project proposals. (See section 5 for a default set of agreements).
General discussion thread (unstructured)
A ‘General discussion’ thread will be started for the project, inviting comments from all group members. For this thread, there are no special format expectation other than general ‘netiquette’.
On a ‘bulletin board’ subthread of the project intro thread, participants can propose ‘issue’ or ‘thread’ candidates, about questions or issues that emerge as needing discussion in the ‘general discussion’ thread. Selection will be based on an agreed-upon number of ‘likes, ‘dislikes’ or comments about the respective issue in the ‘general discussion’ thread.
Issue threads: For each selected issue, a separate issue thread will be opened. The questions or claims of issue threads should be stated more specifically in the expectation of clear answers or arguments, and comments should meet those expectations.
It may be helpful to distinguish different types of questions, and their expected responses:
– “Explanatory” questions (Explanations, descriptions, definitions);
– “Factual’ questions (‘Factual’ claims, data, arguments)
– “Instrumental questions” (Instrumental claims” “how to do …”)
– “Deontic” (‘Ought’- questions) (Arguments pro / con proposals)
Links and References thread
Comments containing links and references should provide brief explanations about what positions the link addresses or supports; the links should also be posted on a ‘links and references’ thread.
Visual material: diagrams and maps
Comments can be accompanied by diagrams, maps, photos, or other visual material. Comments should briefly explain the gist of the message supported by the picture. (“What is the ‘argument’ of the image?) For complex discussions, overview ‘maps’ of the evolving network of issues should be posted on the project ‘bulletin’ thread.
Anytime participants sense that the discussion has exhausted itself or needs input of other information or analysis, they can make a motion for a ‘Next step?’ interruption, specifying the suggested next step:
– a decision on the main proposal or a part,
– call for more information, analysis;
– call for a ‘special technique’ (with or without postponement of further discussion)
– call for modifying the proposal, or
– changing procedural rules;
– continuing the discussion or
– dropping the issue, ending the discussion without decision.
These will be decided upon according to the procedural rules ‘currently’ in force.
Decision on the plan proposal
The decision about the proposed plan — or partial decisions about features that should be part of the plan — will be posted on the project’s ‘bulletin board’ thread., together with a brief report. Reports about the process experience, problems and successes, etc. will be of special interest for further development of the tool.
3 Structured discourse with argument plausibility assessment
The sequence of steps for the discourse with added argument plausibility assessment is the same as those of the ‘basic’ process described in section 2 above. At each major step, participants can make interim judgments about the plausibility of the proposed plan, (for comparison with later, more deliberated judgments). At each of these steps, there also exists the option of responding to a ‘Next step?’ motion with a decision to cut the process short, based on emerging consensus or other insights such as ‘wrong question’ that suggest dropping the issue. Without these intermediate judgments, the sequence of steps will proceed to construct an overall judgment of proposal plausibility ‘bottom-up-fashion’ from the plausibility judgments of individual argument premises.
Presenting the proposal
The proposal for which the argument assessment is called, is presented and described in as much detail as is available.
(Optional: Before having studied the arguments, participants make first offhand, overall judgments of proposal plausibility Planploo’ on a +1 / -1 scale, (for comparison with later judgments). Group statistics: e.g. GPlanploo’ are calculated (Mean, range…) and examined for consensus or significant differences. )
Displaying all pro/con arguments
The pro / con arguments having been raised about the issue , displayed in the respective ‘issue’ thread, are displayed and studied, if possible with the assistance of ‘issue maps’ showing the emerging network of interrelated issues. (Optional:) Participants assign a second overall offhand plan plausibility judgment: Planploo”, GPlanploo”)
Preparation of formal argument display and worksheets
For the formal argument plausibility assessment, worksheets are prepared that list
a) the deontic premises of each argument (goals, concerns), and
b) the key premises of all arguments ((including those left unstated as ‘taken for granted’)
Assignment of ‘Weights of Relative Importance’ w
Participants assign ‘weights of relative importance’ w to the deontics in list (a), such that 0 ≤ wi ≤ 1, and ∑wi = 1, for all i arguments.
Assignment of premise plausibility judgments prempl to all argument premises
Participants assign plausibility judgments to all argument premises, on a scale of -1 (totally implausible) via 0 –zero – (don’t know) to +1 (totally plausible)
Calculation of Argpl Argument plausibility
For each participant and argument, the ‘Argument plausibility’ Argpl is calculated from the premises plausibility judgments. E,g. Argplod = ∏ (premplj) for all j premises of the argument.
Calculation of Argument Weight Argw
From the argument plausibility judgment s and the weight of the deontic premise for that argument, the ‘weight of the respective argument Argw is calculated. E.g. Argwi = Argplod * wi.
Calculation of Plan plausibility Planpld
The Argument weights Argw of all arguments pro and con are aggregated into the deliberated plan plausibility score Planplod for each participant. E.g. Planpld = ∑(Argwi) for all i arguments.
Calculating group statistics of results
Statistics of the Plan plausibility judgment scores across the group (Mean, Median, Range, Min /Max) are calculated and discussed. Areas of emerging consensus are identified, as well as areas of disagreements of lack of adequate information. The interim judgments designated as ‘optional’ above can serve to illustrate the learning process participants go through.
Argument assessment team develops recommendations for decision or improvement of proposed plan
The argument assessment team reports its findings and analysis, makes recommendations to the entire group in a ‘Next Step?’ deliberation.
4 Assessment of plausibility-adjusted plan Quality
Assigning quality judgments
Because pro / con arguments usually refer to the deontic concerns (goals, objectives) in qualitative terms, they do not generally generate adequate information about the actual quality or ‘goodness’ that may be achieved by a plan proposal. A more fine-grain assessment is especially important for the comparison of several proposed plan alternatives. It should be obvious that all predictions about the future performance of plans will be subject to the plausibility qualifications examined in section 3 above. So a goodness or quality assessment may be grafted onto the respective steps of the argument plausibility assessment. The following steps describe one version of the resulting process.
Proposal presentation and first offhand quality judgment
(Optional step:) Upon presentation of a proposal, participants can offer a first overall offhand goodness or quality judgment PlanQoo, e.g. on a +3 / -3 scale, for future comparison with deliberated results.
Listing deontic claims (goals, concerns)
From the pro / con arguments compiled in the argument assessment process (section 3) the goals, concerns (deontic premises) are assembled. These represent ‘goodness evaluation aspects’ against which competing plans will be evaluated.
Adding other aspects not mentioned in arguments
Participants may want to add other ‘standard’ as well as situation-specific aspects that may not have been mentioned in the discussion. (There is no guarantee that all concerns that influence participants’ sense of quality of a plan will actually be brought up and made explicit in a discussion).
Determining criteria (measures of performance) for all aspects
For all aspects, ‘measures of performance’ will be determined that allow assessment about how well a plan will have met the goal or concern. These may be ‘objective’ criteria or more subjective distinctions. For some criteria, ‘criterion functions’ can show how a person’s ‘quality’ score depends on the corresponding criterion.
Example: plan proposals will usually be compared and evaluated according to their
expected ‘cost’; and usually ‘lower cost’ is considered ‘better’ (all else being equal)
than ‘higher cost’. But while participants may agree that ‘zero cost’ would be
best so as to deserve a +3 (couldn’t be better’) score, they can differ significantly
about what level of cost would be ‘acceptable’, and at what level the score should
become negative: Participant x would consider a much higher cost to be still
‘so/so’, or acceptable, than participant o.
-3 ——————————————————- ($∞ would be -3 ‘couldn’t be worse’)
$0 | | | | | | | | | > Cost criterion function.
“Weighting’ of aspects, subaspects etc.
The ‘weight’ assignments of aspects (deontics) should correspond to the weighting of deontic premises in the process of argument assessment. However, if more aspects have been added to the aspect list, the ‘weighting’ established in the argument assessment process must be revised: Aspects weights are on a zero to +1 scale, 0 ≤ w ≤ 1 and ∑wi = +1 for all i aspects. For complex plans, the aspect list may have several ‘levels’ and resemble an ‘aspect tree’. The weighing at each level should follow the same rule of 0 ≤ w ≤ 1 and ∑w=1.
Assigning quality judgment scores
Each participant will assign ‘quality’ or ‘goodness’ judgments, on a +3 to -3 scale (+3 meaning ‘could not possibly be better’, -3 ‘couldn’t possibly be worse’, with zero (0) meaning ‘so-so’ or ‘can’t decide’, not applicable) to all aspects / subaspects of the evaluation worksheet, for all competing plan proposals.
Combining quality with plausibility score for a ‘weighted plausibility-adjusted quality score Argqw
Each (partial) quality score q will be combined with the respective argument plausibility score Argpl from the process in section 3, resulting in a ‘weighted plausibility-adjusted quality score’ Argqplwi = Argpli * qi * wi .
Aggregating scores into Plan quality score PlanQ
The weighted partial scores can be aggregated into overall plan quality scores: e.g. :
PlanQ = ∑i (Argqplwi) for all n aspects. or
PlanQ = Min (Argqplw) or
PlanQ = ∏ (Argqpli +3)wi -3
(The appropriateness of these functions for a given case must be discussed!)
Group statistics: GArgqpl and GPlanQ
Like the statistics of the plausibility assessments, statistical analysis of these these scores can be calculated. Whether a resulting measure such as Mean (PlanQ) should be accepted as a ‘group judgment’ is questionable, but such measures can become helpful guides for any decisions the group will have to make. Again, calculation of interim results can provide information about the ‘learning process of team members, ‘weaknesses’ of plans that are responsible for specific poor judgment scores, and guide suggestions for plan improvements.
Team reports results back to main forum
A team report should be prepared for presentation back to the main discussion.
5 Sample procedural agreements
The proposed platform aims at facilitating problem-solving, planning, design, policy-making discussions that are expected to result in some form of decision or recommendation to adopt plans for action. To achieve decisions in groups, it is necessary to have some basic agreements as to how those decisions will be determined. Traditional decision modes such as voting are not appropriate for any large asynchronous online process with wide but unspecified participation (Parties affected by proposed plans may be located across traditional voting eligibility boundaries; who are ‘legitimate’ voters?). The proposed approach aims at examining how decisions might be based on the quality of content contributions to the discourse rather than the mere number of voters or supporters.
The following are proposed ‘default’ agreements; they should be confirmed (or adapted to circumstances) at the outset of a discourse. Later changes should be avoided as much as possible; ‘motions’ for such changes can be made as part of a ‘Next step’ pause in the discussion; they will be decided upon by a agreed upon majority of participants having ‘enlisted’ for the project, or agreements ‘currently’ in place.
Members of the Planning Discourse FB group (Group members) can propose ‘projects’ for discussion on the Main group’s ‘Bulletin Board’ Thread. Authors of group project proposals are assumed to moderate / facilitate the process for that project. Projects are approved for discussion if an appropriate number __ of group members ‘sign up for ‘participation’ in the project.
Project participants are assumed to have read and agreed to these agreements, and expressed willingness to engage in sustained participation. The moderator may choose to limit the number of project participants, to keep the work manageable.
Project discussion can be ‘started’ with a Problem Statement, a Plan Proposal, or a general question or issue. The project will be briefly described in the first thread. Another thread labeled ‘Project (or issue) ___ General comments’ will then be set up, for comment on the topic or issue with questions of explanation clarification, re-phrasing, answers, arguments and suggestions for decisions. Links or references should be accompanied by a brief statement of the answer or argument made or supported by the reference.
Participants and moderator can suggest candidate issues: potentially controversial questions about which divergent positions and opinions exist or are expected, that should be clarified or settled before a decision is made. These will be listed in the project introduction thread as Candidate Issues. There, participants can enter ‘Likes’ to indicate whether they consider it necessary to ‘raise’ the issue for a detailed discussion. Likely issue candidates are questions about which members have posted significantly different positions in the ‘General comments’ thread; such that the nature of the eventual plan would significantly change depending on which positions are adopted.
Issue Candidates receiving an agreed upon number of support (likes, or opposing comments, are accepted and labeled as ‘Raised’. Each ‘raised’ issue will then become the subject of a separate thread, where participants post comments (answers, arguments, questions) to that issue.
It will be helpful to clearly identify the type of issue or question, so that posts can be clearly stated (and evaluated) as answers or arguments: for example:
– Explanations, definitions, meaning and details of concepts to ‘Explanatory questions’;
– Statements of ‘facts’ (data, answers, relationship claims) to Factual questions;
– Suggestions for (cause-effect or means to ends) relationships, to Instrumental questions;
– Arguments to deontic (ought-) questions or claims such as ‘Plan A should be adopted’, for example:
‘Yes, because A will bring about B given conditions C , B ought to be pursued, and conditions C are present’).
‘Next step?’ motion
At any time after the discussion has produced some entries, participants or moderator can request a ‘Next Step?’ interruption of the discussion, for example when the flow of comments seems to have dried up and a decision or a more systematic treatment of analysis or evaluation is called for. The ‘Next step’ call should specify the type of next step requested. It will be decided by getting agreed-upon number of ‘likes’ of the total number of participants. A ‘failed’ next step motion will automatically activate the motion of continuing the discussion. Failing that motion or subsequent lack of new posts will end discussion of that issue or project.
Decisions (to adopt or reject a plan or proposition) are ‘settled’ by an agreed-upon decision criterion (e.g. vote percentage) total number of participants. The outcome of decisions of ‘next step?’ motions will be recorded in the Introduction thread as Results, whether they lead to an adoption, modification, rejection of the proposed measure or not.
As indicated before, traditional decision modes such as voting, with specified decision criteria such as percentages of ‘legitimate’ participants, are going to be inapplicable for large (global’) planning projects whose affected parties are not determined by e.g. citizenship or residency in defined geometric governance entitites. It is therefore necessary to explore other decision modes using different decision criteria, with the notion of criteria based on the assessed merit of discourse contributions being an obvious choice to replace or complement the ‘democratic’ one-person, one-vote’ principle, or the principle of decisions made by elected representatives (again, by voting.)
Participants are therefore encouraged to explore and adopt alternative decision modes. The assessment procedures in sections 3 and 4 have produced some ‘candidates’ for decision criteria, which cannot at this time be recommended as decisive alternatives to traditional tools, but might serve as guidance results for discussion:
– Group Plan plausibility score GPlanpl;
– Group Quality assessment score GPlanQ
– Group plausibility-adjusted quality score GPlnQpl;
The controversial aspect of all these ‘group scores is the method for deriving these from the respective individual scores.
These measures also provide the opportunity for measuring the degree of improvement achieved by a proposed plan over the ‘initial’ problem situation a plan is expected to remedy: leading to possible decision rules such as that rejecting plans that do not achieve adequate improvement for some participants (people being ‘worse off ‘after plan implementation) or selecting plans that achieve the greatest degree of improvement overall. This of course requires that the existing situation be included in the assessment, as the basis for comparison.
In the ‘basic’ version of the process, no special analysis, solution development, or evaluation procedures are provided, mainly because the FB platform does not easily accommodate the formatting needed. The goal of preparing decisions or recommendations based on contribution merit or assessed quality of solutions may make it necessary to include such tools – especially more systematic evaluation than just reviewing pro and con arguments. If such techniques are called for in a ‘Next step?’ motion, special technique teams must be formed to carry out the work involved and report the result back to the group, followed by a ‘next step’ consideration. The techniques of systematic argument assessment (see section 3) and evaluation of solution ‘goodness’ or ‘quality’ (section 4) are shown as essential tools to achieve decisions based on the merit of discourse contributions above.
Special techniques teams will have to be designated to work on these tasks ‘outside’ of the main discourse; they should be limited to small size, and will require somewhat more special engagement than the regular project participation.
Other special techniques, to be added from the literature or developed by actual project teams, will be added to the ‘manual’ of tools available for projects. The role of techniques for problem analysis, solution idea generation, as well as that of systems modeling and simulation (recognizing the fact that the premise of ‘conditions’ under which the cause-effect assumption of the factual-instrumental premise of planning arguments can be assumed to hold, really will be the assumed state of the entire system (model) of interrelated variables and context conditions; an aspect that has not been adequately dealt with in the literature nor in the practice of systems consulting to planning projects.)
6 Decision modes
For the smaller groups likely to be involved in ‘pilot’ applications of the proposed structured discourse ideas described, traditional decision modes such as ‘consensus’, ‘no objection’ to decision motion, or majority voting may well be acceptable because familiar tools. For large scale planning projects spanning many ordinary ‘jurisdictions’ (deriving the legitimacy of decisions from the number of legitimate ‘residents, these modes become meaningless. This calls for different decision modes and criteria: an urgent task that has not received sufficient attention. The following summary only mentions traditional modes for comparison without going into details of their respective merit or demerits, but explores potential decision criteria that are derived from the assessment processes of argument and proposal plausibility, or evaluation of proposal quality, above.
Proposals receiving an agreed-upon percentage of approval votes from the body of ‘legitimate’ voters. The approval percentages can range from simple majority, to specified plurality or supermajority such as 2/3 or 3/4 to full ‘consensus’ (which means that a lone dissenter has the equivalent of veto power.) Variations: voting by designated bodies of representatives, determined by elections, or by appointment based on qualifications of training, expertise, etc.
Decision based on meeting (minimum) qualification rules and regulations.
Plans for building projects will traditionally receive ‘approval’ upon review of whether they meet standard ‘regulations’ specified by law. Regulations describe ‘minimum’ expectations mandated by public safety concerns or zoning conventions but don’t address other ‘quality’ concerns. They will lead to ‘automatic’ rejection (e.g. of a building permit application) if only one regulation is not met.
Decision based on specified performance measures
Decision-making groups can decide to select plans based on assessed or calculated ‘performance’. Thus, real estate developers look for plan versions that promise a high return on investment ratio (over a specified) ‘planning horizon’. A well known approach for public projects is the ‘Benefit/Cost’ approach calculating the Benefit minus Cost (B-C) or Benefit-Cost ration B/C (and variations thereof).
Plan proposal plausibility
The argument assessment approach described in section 3 results in (individual) measures of proposal plausibility. For the individual, the resulting proposal plausibility could meaningfully serve as a decision guide: a proposal can be accepted if its plausibility exceeds a certain threshold – e.g. the ‘so-so’-value of ‘zero’ or the plausibility value of the existing situation or ‘do nothing’ option. For a set of competing proposals: select the one with the highest plausibility.
It is tempting but controversial to use statistical aggregation of these pl-measures as group decision criteria; for example, the Mean group plausibility value GPlanpld. For various reasons, (e.g. the issue of overriding minority concerns), this should be resisted. A better approach would be to develop a measure of improvement of pl-conditions for all parties compared to the existing condition, with the proviso that plans resulting in ‘negative improvement’ should be rejected (or modified until showing improvement for all affected parties).
Plausibility-adjusted ‘Quality’ assessment measures.
Similar considerations apply to the measures derived from the approach to evaluate plans for ‘goodness or ‘quality’ but adjust the implied performance claims with the plausibility assessments. The resulting group statistics, again, can guide(but should not in their pure form determine) decisions, especially efforts to modify proposals to achieve better results for all affected parties (the interim results pinpointing the specific areas of potential improvement.
7 Contribution merit rewards
The proposal to offer reward points for discourse contributions is strongly suggested for the eventual overall platform but one difficult to implement in the pilot versions (without resorting to additional work and accounting means ‘outside’ of the main discussion). Its potential ‘side benefits’ deserve some consideration even for the ‘pilot’ version.
Participants are awarded ‘basic contribution points’ for entries to the discussion, provided that they are ‘new’ (to the respective discussion) and no mere repetition of entries offering essentially the same content that have already been made. If the discussion later uses assessment methods such as the argument plausibility evaluation, these basic ‘neutral’ credits are then modified by the group’s plausibility or importance assessment results – for example, by simply multiplying the basic credit point (e.g. ‘1’) with the group’s pl-assessment of that claim.
The immediate benefits of this are:
– Such rewards will represent an incentive for participation,
– for speedy assembly of needed information (since delayed entries of the same content will not get credit).
– They help eliminate repetitious comments that often overwhelm many discussions on social media: the same content will only be ‘counted and presented once;
– The prospect of later plausibility or quality assessment by the group – that can turn the credit for an ill-considered, false or insufficiently supported claim into a negative value (by being multiplied by a negative pl-value) – will also discourage contributions of lacking or dubious merit. ‘Troll’ entries will not only occur but once, but will then receive appropriate negative appraisal, and thus discouraged;
– Sincere participants will be encouraged to provide adequate support for their claims.
Together with the increased discipline introduced by the assessment exercises, his can help improve the overall quality of discourse.
Credit point accounts built up in this fashion are of little value if they are not ‘fungible’, that is, have value beyond the participation in the discourse. This may be remedied
a) within the process: by considering their uses to adjust the ‘weight’ of participant’s ‘votes’ or other factors in determining decisions;
b) beyond the process: By using contribution merit accounts as additional signs of qualification for employment or public office. An idea for using such currencies as a means of controlling power has been suggested, acknowledging both that there are public positions calling for ‘fast’ decisions that can’t wait for the outcome of lengthy discussions, and that people are seeking power (‘empowerment’) almost as a kind of human need, but like most other needs we are asked to pay for meeting (in one way or other), introducing a requirement that power decisions will be ‘paid for’ with credit points. (One of the several issues for discussion.)
The old fellow in the corner of the Fog Island Tavern had been sitting there, quietly, for several hours. At first, the regulars at the bar had been looking at him, saying a few words signaling that he’d be welcome at the counter; they were curious: A new neighbor on the island, having bought a house from one of the just-weekend-owners who had given up on the demands of island life? Or just another visitor? But he hadn’t responded, just ordered another glass of wine, off-and-on scribbling in a little notebook in-between periods of merely looking around with a kind of vacant far-away stare. Thinking? Hmm.
But suddenly he came up to the bar, eyes blazing, arms held wide in a gesture of exasperation, calling out from ten feet away: “What are you doing!?”
“Huh? What are we doing?” One of the fellows asked. “Just sitting here shooting the breeze. What’s it to you?”
“I heard it!” He gasped. “And you guys just shrugged and went back to bitching about the weather and how bad things are and how corrupt the government is and how the president, or his predecessor are the worst president ever, and…”
“Heard what?” Vodçek asked, the tavern owner behind the counter. “Well, don’t you agree that things are not as they ought to be?”
“Heard what? Didn’t this gentleman here –” he pointed at Renfroe, who seemed taken aback for having said something significant enough to evoke such attention — “just tell you about this thirteen-point plan or agenda that could change everything? And pooh-poohed it as just another of the crazy schemes of this Abbe something he was ridiculing?”
“Well, I guess you haven’t met or heard about Abbé Boulah and his overactive imagination and inventiveness. But the story ol’ Renfroe here was relating, he had just heard it from Abbé Boulah, not sure who came up with it originally. What about it?” Bog-Hubert tried to calm both of them down.
“And you guys didn’t recognize it for the ray of hope it is, finally, and went right back to blah-blah about the weather and the mess we’re in?!”
“Well, yeah, I guess we did. Out here, weather is kind’a the first thing we worry about getting up in the morning, and we don’t have any big hopes about being able to change the course of history any more than the weather, you know what I mean? But what’s so important about that thirteen-point scheme?”
“It’s the way we should go about meeting all those crises everybody keeps talking about. But I guess the way it sounded was still too dry, not inspiring enough to get people to get off their lazy butts… I guess it didn’t tell you what you actually can do – even out here!”
“Oh, I guess that calls for some explanation, my friend. Why don’t you join us – Vodçek, what’s he drinking? Could you get him a glass, on me? Thanks — And try to enlighten us some?”
“Enlighten: I’m not sure I’m the one for that job. But – thanks for the wine – where do you get that great Zinfandel out here? – that pamphlet or whatever it was, don’t you see how it opens up a great opportunity? For you, for all of us, for the world?”
“Opportunity? How so? Opportunity for what?”
“Okay, good question. Let me backtrack a little. You realize, don’t you, that this country and many others, all of us, are not only facing all these big problems we got ourselves into, out of idealism and greed and over-eagerness and foolishness. But for the first time in history, we also have these terrific new tools — technology for communication, for collecting and making the history and experiences and wisdom and errors of all the people in the world accessible – to learn from it, — learn, you hear me? learn! — and to work together to develop better ways of living together on this planet?”
“If you put it that way…”
“Right. Most of the time, it isn’t put that way, but perceived and presented as tools for the old ‘survival of the fittest’ attitude, meaning the strongest, biggest, richest, the ones with the faster guns’ game, beating out all the weaker ones. Greatness of a nation, whatever than means, beyond the residents of a plot of earth surface within some arbitrary borders, seen as the ability to tell other nations what to do and not to do, and if they don’t, bomb-em back to the stone age… – Heavens, what a narrow kind of perspective!”
“So what should that perspective be, in your opinion? If greatness is what it’s about? Some of us just want to be left in peace and go fishing…”
“Well, start with that idea in your declaration of independence and in most modern constitutions, in one form or another: people’s right to life, liberty and pursuit of happiness. Is it enough for a ‘great’ community to make sure that all its members ‘have’ that right? Like: You ‘have’ the right to become the greatest race-car driver, the greatest opera singer or the funniest circus clown? Even just reputable amateur fishermen? But what do you do if there are no race tracks, no races, no operas being performed, no circus? And no teachers to help you get those skills? No fish in the ocean? Your ‘right’ doesn’t count for much then, eh?
“Hmm. I see. But…”
“What you need to acknowledge is this: For all your individual responsibility, there are some conditions for taking advantage of your ‘rights’ that don’t depend on the individual: they must be present in a person’s environment.”
“So how does that apply to a nation, a community?”
“I assume you’d say that a society, through its government, should make sure that a person can go about such pursuits in peace, free to do so, as long as it doesn’t interfere with other people’s right to go about their pursuits?”
“Sure Sound about right.”
“But wouldn’t you also say a society that can offer more appealing opportunities for such pursuits, more interesting, noble, challenging as well as enjoyable opportunities, would be better – even ‘greater’ if you prefer that word – than one that just declares that you have all kinds of rights that you can’t take advantage of because the conditions for pursuing them aren’t there?”
“I get it: you say that a great society is one that offers great opportunities – and the right as well as conditions enabling all its members to pursue them?”
“Yes. And the opportunity to create new opportunities, new and more interesting ways to live.”
“Okay. So what does that have to do with that thirteen-point statement Renfroe was talking about? Wasn’t it aimed at how we might deal with all the crises and challenges that are beginning to threaten humanity’s survival? What got you all excited about that?”
“Good question – getting back to that one. See, the traditional assumption about threats and challenges to a society was that its government should be set up to organize its ‘defenses’ — that is, it would maintain some institutions made up of people willing and able to use force against any ‘enemy’ threatening it. Military and police ‘forces’. Remember that notion: ‘enemy’: it was an assumption that an ‘enemy’ was some other society or group of people.”
“Right. Interior or exterior. Like it says in the pledge of allegiance.”
“Yes. I’ll come back to that enemy notion in a minute. Now, these institutions were organized, we have to assume with good reason, according to rigid hierarchical principles. The top guys, the generals, the commander-in-chief giving commands and the lower ranks carrying them out.”
“Of course: don’t you have to make sure that the regiments and platoons are all following a coherent defense plan (or attack, if they adhered to the idea that the best defense is an attack) and aren’t marching in the wrong direction ending up attacking each other?”
“Sure: it made sense to the people. If they had a say in the matter. So much so that the other governance institutions were organized according to similar hierarchical principles and command structures. Yes, yes, I know what you are going to say: we have elections that determine who the folks in our governance systems are going to be, to make sure they are ‘defending’ our interests and not their own. Which history teaches us is a real temptation if you give people too much power. Wasn’t that what you were going to say?”
“Something like that, yes.”
“Well. That pamphlet said something about the voting systems – that it didn’t exactly ensure that all of our interests and concerns would be ‘defended’, just those of the ‘majority’. So that seems to be one of the issues that we need to look into.”
“Are you questioning the idea of our democratic system? Do you have anything better up your sleeve?”
“Don’t get excited. You’re reading the papers about how it’s working, are you? Can we do better than that? I sure hope so. But we are getting ahead of things here. The crises and emergencies we are starting to worry about more these days: who’s the enemy?”
“Okay, are you going to try to defeat Nature with your drones and smart bombs and aircraft carriers? But isn’t it rather that Nature is starting to react against what WE are doing to it, out of ignorance and greed and foolishness? And what WE are doing to each other and ourselves? You’ve heard it as a joke, but the joke really is on us: the enemy is US. What we are beginning to discover is that the way we are doing things – in business, in governance, defense against crises and ‘enemies’ and in our private lives – doesn’t quite work the way it’s supposed to work anymore: we need to start thinking about doing all that differently.”
“Oh yeah: A ‘new system’, eh? We keep hearing that, yes. To tell you the truth: I’m beginning to get tired of all that talk: It seems that all they want is just power to do things ‘their’ way. Not for all of us…”
“I don’t blame you: I often feel the same way. Now, doesn’t it seem that WE – humanity — don’t have a really good idea about what that ‘new system’ should be? Do you, do WE know what works and what doesn’t work? I don’t. Look at all the different ideas about that out there: many of them are so different that people are beginning to fight each other over their preferred new system visions. We are all becoming ‘interior enemies’ to each other. So as far as I can see, there’s not much hope that we can come to meaningful agreements about that unified great new system – whether it is for a city, a nation, of the global human community.”
“You are becoming a bit of a depressing spoilsport yourself here, with all these dismal issues getting in the way of enjoying our drinks and conversation.”
“So sorry. But that isn’t my point at all: The ideas and points in that pamphlet: weren’t they actually beginning to provide some encouraging answers, if you think about it? But from my point there in the corner, it looked like you didn’t see that, or didn’t want to think about it – or knew things I don’t see why it wouldn’t work, and had some better ideas already.”
“So you think those thirteen points are some kind of solution? Come on…”
“I think that the first meaningful step is that they acknowledge that none of us have THE answer, THE solution. We don’t know enough. We need to examine different ideas, — not only the new ideas but older traditions in various human cultures: what did they know that we have forgotten? Human societies have tried many different ‘systems’: What went wrong, what worked? We tried a few major ones, they didn’t work too well, it seems. So we need experiments and analysis — all those ideas and initiatives at small scale that many people see as nuisance: we need to support them and get them to share their experience, for comparison and discussion, the results to be fed into a shared common discourse and evaluation framework.”
“I was a bit worried about that grand framework or platform: Sounded like that might just be another Big Brother kind of system?”
“Sure, if it were run as a traditional top-down hierarchical structure with insufficient controls of power. Power that would be likely to overrule legitimate concerns of how decisions would affect different people in the community; we have good reason to be suspicious of such a system especially if it gets to global scale. But didn’t that platform have some ideas for different ways of avoiding those problems? For one, it would only aim at a few overall agreements to ensure that all those small initiatives – and of course existing entities such as nations – wouldn’t get in each other’s way. And if it’s done right, with the new technology and media, it should be open to everybody’s input and participation. Isn’t that a totally new and glorious opportunity for humanity – one that we are just beginning to take advantage of?”
“Yes – and not all in very promising ways…”
“I think I see what you mean: the chaotic avalanche of opinions, repetitions, fake news, rumors and meaningless or malicious chatter on social media – it all looks like a new disaster more than a solution to you? Yes. But we haven’t worked out the needed procedures for the use of these tools in a planning and policy-making platform yet. A process that tries to ensure a better, transparent connection between the value and merit of people’s contributions to the discourse and the eventual decisions. That was what the proposal in that pamphlet was promising, wasn’t it? So shouldn’t that be something to talk about, discuss, evaluate, to try out, to see if it works?”
“Well, from the way Renfroe talked about it, I didn’t really get the idea that there were actual solutions worked out, that it was more than just wishful thinking. You agree, Vodçek?”
“No, Sophie, sorry. Coming to think about it, didn’t we actually discuss a number of what I’d call some missing pieces for that big platform, here in this lowly Tavern? Remember the stories about assessing the merit of planning arguments, about evaluation, about incentive points for contributions, and how they could be used for various purposes, even to control power with different, nonviolent tools?”
“Are you saying that those discussions had anything to do with that pamphlet and its platform proposals and issues? Is there a conspiracy afoot?”
“It looks that way. Where did you say Abbé Boulah got that pamphlet, Renfroe?”
“He didn’t really say, Bog-Hubert: now that I think about it. It could just be something he cooked up with his buddy up in town… So you think we’ve all been working on that stuff all along? And they just wrote it up?”
“Well, wherever you got it: It sure sounds like a great opportunity. Think about it: As a way to deal with all the problems, let’s use people’s need and desire to do their own thing, to make a difference in their lives, let them work on may different ideas, support them, preferably in places and ways that doesn’t put them in direct competition with the existing systems right away. Let’s use our technology to get them talking to each other in more productive ways, to learn, to evaluate the different approaches to find out what ideas we should adopt and which ones we shouldn’t. All the while contributing our insights to reach some needed global decisions that we can all support because we all were contributing to them and working them out? Is that something to support and work for? What are you guys doing with all the interesting ideas you’ve been working on?”
“So what do you think we ought to do?”
“At least keep talking about it, connect the different parts. To begin with.
“Let’s see that pamphlet again. Do you still have it, Renfroe?”
‘Here it is, a bit crumpled, sorry.”
The following notes are a response to various requests to join efforts to develop and implement a ‘new system’ or a new platform for assembling knowledge about the best practices and techniques for such a new system.
From the huge LinkedIn discussion of Systems Thinking World (STW) participants trying to come up with an answer to Ban Ki Moon’s 2011 Davos call for ‘revolutionary thinking and action to ensure an economic model for survival’, some things could be learned and summarized, briefly, that can serve as a kind of guideline or agenda for the needed efforts:
1. There are already countless initiatives for alternative ways to do things underway, or proposed.
2.To the extent these initiatives communicate with others and the public, they tend to advertise successes and articles of faith for their ideas, less on obstacles and errors.
3. There is widespread sentiment that ‘something should be done’, but no agreement about a common ‘global’ model, and considerable resistance against calls to join this or that cause. As a global community, we do not yet know enough about what works and what does not work, to embark on a cooperative global course or action or model.
4. Therefore, it seems that the many partial (i.e. ‘non-global’ or ‘local’) initiatives and experiments should be encouraged and supported rather than merged into one overall model. This should be accepted as a ‘global’ policy. To draw not only on human desire for cooperation but also on the human desire (of many among us) to ‘make a difference’ in our communities.
5. For such initiatives, support could take the form of devoting part of the usual humanitarian aid for recovery from natural or human-caused disasters to the establishment of ‘innovation zones’ in areas where ‘old’ infrastructure and governance systems have been destroyed. Support should be contingent upon honest reporting of successes and failure into a global forum for evaluation.
6. There is a need for discussion and negotiation of global agreements and decisions (conventions to permit the various initiatives but ensuring that they don’t get in each others’ way or endanger the whole).
7. Decisions should based on the merit of the best of available knowledge and information (much of which is ‘distributed’ and different according to local context conditions), rather than on majority voting which is not applicable to populations extending across conventional governance borders, and explicitly allows disregard of the concerns of the losing minority.
8. There is currently no coherent set of procedures for such discourse and negotiation that includes explicit determination of the merit of discourse contributions, though ideas and proposals have been made.
9. There would be a need for both bringing ‘existing’ (documented and past) knowledge and research as well as ad-hoc investigation to bear on such a better orchestrated discourse, through appropriate information systems structured according to appropriate models of planning and policy-making processes.
10. There is currently no platform for a truly cooperative and coherent platform to support such a discourse.
11. There are currently no sufficient incentives for many citizens to participate in such public discourse — overcoming the perceived ‘cost’ and effort of participating and the sense that their contributions ‘do not really count’.
12. There would be a great need for educating a global public in the practice of participation on a better orchestrated discourse.
13. There is currently no effective set of ‘sanctions’ to ensure adherence to agreements, other than ‘enforcement’ measures implying coercion violence, by ‘enforcement’ powers which human history tells us are vulnerable to the temptation to abuse that power, and that arguably exacerbate problems and conflicts rather than solving them to mutual satisfaction. New tools for the control of power are needed.
These insights together indicate at least a significant part of the immense agenda for a meaningful global effort to ensure a ‘model for survival’, which however may not be the ‘unified’ global model many envision. The specific technological innovation needs as well as the part of ‘education’ that aim at engendering the change in ‘awareness’ and ethics needed to support such a movement: (parts of item 4?) have been left out as already widely propagated.
The well-intended effort to develop a repository of human memory as an important support of the discourse is part of item 9 of that agenda. Given the many already existing repositories, the focus should be on the issue of how to channel their content on the specific aspects of the discourse, e.g. with information systems or search instruments organized by the discourse elements (issues) rather than knowledge domains.
There has been work on the concept as well as the missing parts of the overall discourse support system, item 10, specifically on items 7, 8, looking at aspects of item 11 and 13 that could be improved by ‘collateral’ information from item 7 (merit of arguments). Some thoughts on a discourse game as one possible tool for item 12 have been put forward. A main ‘systems thinking’ task in all this, is that of tying the various parts of the agenda into a mutually supporting whole network. The systems thinking efforts we currently see are not addressing the ‘argumentative’ aspect of the planning discourse; efforts have been made to bring the argumentative aspect into systems modeling and/ or vice versa. There is a danger in the well-intended temptation of bringing more AI tools to bear on the planning discourse (part of item 9) — the need to rely on ‘consistent’ information to reach valid inference seems to be somewhat at odds with the essence of the ‘contradictory’ pros and cons of planning arguments.
Work is needed on some of these aspects; different provisions should be tried out in smaller experiments; but the main and immediate need for even carrying the development work forward is that of development of the programming integrating the several functions of a fully supportive platform for the planning and policy-making discourse.
In the discourse about collective plans, the process of evaluation – making judgments about whether a plan is ‘good enough’ or which of several plans is the better, — differences of opinions occur, which can be resolved by mutual explanation of the basis of evaluation judgments. The discussion here is focused on the role of ‘criterion functions’ in this process. These functions – showing how ones subjective ‘goodness’ judgments depend on ‘objectively’ measurable criteria – make it possible to explain one’s basis of judgment in much more specific detail than is usually done even in the most cooperative group processes. Some key insights of the discussion are the following:
While such detailed explanation is possible and conceptually not overly challenging, including this process in actual decision-making procedures would add cumbersome provisions to a planning discourse already calling for more structure than many participants are used to and feel comfortable with. The issues of ‘aggregation’ – of individuals’ partial judgments into overall judgments, and especially of individual judgments into ‘group’ evaluation measures are potential sources of controversy.
It becomes clear that any overall ‘measures’ or judgments that can meaningfully guide decisions cannot be derived in ‘top-down’ fashion from general ‘meta values’ and ‘common good’ concepts but must be constructed ‘bottom-up’ from individual participants’ concerns and understanding of specific situations and context.
Familiar claims of planning decision makers ‘to act on behalf of others (clients, users), with adequate knowledge of those others’ concerns and basis of judgment, but not having gone to the trouble of doing this, are unfounded and should be viewed with reserve.
Examination of criterion functions make it obvious that the quest for and claim of having found ‘optimal’ solutions is unrealistic: no plan will achieve the ‘best possible’ scores on all evaluation aspects even for individuals, and different people will have very different but legitimate criterion functions.
Considering plans or policies whose effects will occur – and change – over time, adds another level of complexity. System simulation models can track the performance of variables (criteria) over time, but do not show associated ‘goodness’ judgments (obviously, since this would either be just one person’s assessment, of some aggregated measure of judgments that have not been included in the system modeler’s data.
The examination of how evaluation judgments for different plans could be tracked over time (as a function of the simulated variable tracks) suggests a different decision guide: the (time-discounted) degree of improvement of a plan over the current or predicted problem situation under the ‘do nothing’ option.
The discussion takes place in the hypothetical ‘Fog Island Tavern’.
– Hey Bog-Hubert – what kind of critters are you guys talking about? I couldn’t quite get it coming in, but it sounds like serious wildlife?
– Good morning Renfroe. Well, I guess you could call them critters, but not the kind you mean. Actually, we were talking about criterion functions. About how we can explain what we mean when we’re making judgments about, say, proposed plans. Calling them good, so-so, or bad, or anything in-between.
– Huh. Plans, as in what to do about saving the beaches where each storm washes away more of the sand?
– Yes, or about what to do about the climate change that makes the storms worse and the oceans rise.
– What, you guys can’t even come up with a plan for beach preservation on this little island, and now you want to talk about the oceans and global climate?
– Well, Renfroe, it looks like the problems of coming to some agreements about what to do are the same everywhere, just at a different scale.
– So where do your critters come in on that one?
– I guess we need to back track a little on that. It has to do with evaluation, say of different proposed plans, to decide which one is best, or whether any of them should be implemented. You could start by looking at them and then make an offhand judgment, say ‘good’; ‘not good’. If there are several proposals, you may want to use a more detailed scale, for example one with seven points ranging from ‘couldn’t be worse = – 3, to ‘couldn’t be better’: +3, with a midpoint of zero meaning ‘don’t know’ or ‘so-so’. In a group you’ll have to agree on some common scale. Now somebody asks you why you rate proposal X so high, and solution Y so low, since they came up with very different ratings from yours. So you may want to talk about the reasons, the basis of your judgments, maybe you each know something the other doesn’t know or see, that should be considered in making the decision. What do you do? How do you explain what makes a solution good or bad, in your view?
– Well, you could look at the various costs and benefits, and how well the plan will work for what it is meant to do?
– And how good it looks, if its’ a building or some thing we are looking at or living in?
– Yes, Sophie.
– And don’t we also have to worry about those ‘unexpected side-and-after-effects’ of plans, that people always talk about but keep forgetting?
– Good point. Next we list all those considerations or ‘aspects’ and make sure that we all mean the same thing when we name them. But we can only consider what people bring up in the discourse, so it’s important to make sure that is organized so as to let everybody put in their views. Now you can give each plan a ‘goodness’ judgment score – on the same scale — for each of those aspects. Let’s call those ‘partial’ judgments – all together they make up your ‘overall’, whole judgment for each plan. You’ll then have to explain how exactly all of those scores make up the overall judgment.
– And looking at the different aspects, you may want to reconsider the first overall, offhand judgment you made?
– Good point, Vodçek. Deliberating already. Learning. Excellent. But to get to the criterion functions: You realize how an explanation of a judgment the goodness score always consists of showing how the judgment relates to something else. That something else can be another judgment – look at how Sophie suggested that her overall ‘goodness’ judgment of, say, a building, should depend in part on the beauty of that building – which of course would be another judgment, and people may have different opinions about that. But the relationship would be that of some ‘degree of beauty’ about which she would have to make another ‘goodness’ judgment to explain how it contributes to the overall building goodness judgment.
– That’s not much on an explanation though, is it?
– Right. So you could ask her what, in her mind, makes a building beautiful. What would be you answer, Sophie?
– Well, if I got the sense that he just wants to annoy me with all these questions – because I can see how each answer will just lead to another one, and where will that end – I could just say that if he can’t see it he just doesn’t understand beauty and tell him to get lost. But if I think he really wants to learn what I see as beautiful, I might suggest that it has to do with, say, its proportions.
– Ah. Now we are getting closer to the criterion issue. Because proportions are really measurement relations: in a rectangle, the length of the short side to the length of the longer one. The relationship is now something we can ‘objectively’ measure. Quantitative. And many people are really adamant about making our decisions based on objective ‘facts’ and measures. So would it satisfy those folks to show them a graph that has the ‘objective’ measure on one axis – the horizontal one, say, and our judgment scale on the vertical one: If you are convinced that the most beautiful proportion is the ‘golden ratio’ – 1:1.618… the graph would touch the + 3 line at that 1.618… point, and go down from there in both directions. Like this, for example: Down to 1:1 (the proportion of the square) on one side, and down to -3 for infinitely long rectangles: 1:∞
Fig 1. A criterion function for proportion judgments
– Hey, didn’t we look at that proportion thing a while back? But then we looked at both sides on the 1:1 point – if the right side is for ‘vertical’ rectangles, the left one continues past the 1:1 point for horizontal ones.
– And if I remember correctly, didn’t somebody point out that there are many people who feel that the square, or the one based on the diagonal of the square, the √2 relationship, is the most beautiful proportion?
– You’re right. But that was in another book, a fat one, if I recall? So let’s not get too distracted by the details here. But perhaps we should just remember that there are many different forms of such functions: the one where ‘zero’ on the variable represents -3 on the judgment scale, which goes on to approach +3 at infinity, its opposite that starts with +3 at zero on the criterion scale and approaches -3 at infinity, the opposite of the golden ratio curve that goes from -3 at some value of our criterion and rises towards +3 on both sides.
– Can’t think of an example for that one though. Except perhaps weird ones like people’s appreciation for apartment levels going up towards the higher floors and +3 at the penthouse – but with a sudden drop to -3 at floor 13?
– Goes to show that people’s preferences can take strange contortions… But those are personal judgments. I guess they are entitled to hold those, privately. Now, what about collective decisions?
– Yes, Vodçek. That is the point where we left off when Renfroe came in. We can explain how our subjective goodness judgment relates to some objective measurement. And this is useful: I can ask somebody to make a decision on my behalf if I give him my criterion function to make a selection – even though I know that his criterion function likely has a different shape and the high +3 judgment score is in a different place. But the issue we started from was the idea that there should be measurements – expressing values – that everybody should agree on, so that collective decisions could be guided by those values and measurements. ‘Meta-values’?
– Yes, that notion seems to make perfect sense to many people – for example the feel that trying to stop climate change is so important for the survival of human civilization – that it is such a meta-value that everybody should agree on so that we can start taking more effective action. And that this is even an ethical, a moral duty. So they can’t understand why there are some people who don’t agree.
– Right. So we were trying to untangle the possible reasons why they don’t.
– Short of declaring them all just blindly indoctrinated by political or religious views or outright fraudulent misrepresentations, eh?
– Yes, let’s not go there. I guess there may have been some confusion because at first there was no distinction between the ‘meta-values – that were quite general and abstract – and the corresponding measures one would need to actually guide decisions: You can’t really argue against a concept like the Common Good as a guiding value – but when it comes to pin down just what that common good is, and how to get an ‘objective’ measure for it, history shows that there’s plenty of disagreement both about the ‘common’ part – my family, tribe, town, country, my religion, humanity, all life on the planet? And even more vicious: about the part what the ‘good’ might be.
– I agree; and the attempt to justify those different views have led to some pretty desperate contortions of moral guidelines for decisions to meet those good things: I remember the old ‘dulce et decorum est pro patria mori’ (‘sweet and decorous it is to die for one’s country’), or promising all kinds of heavenly rewards in the hereafter to those willing to fight and kill and die for religious ideas.
– Well, if your tribe or country or your faith is your ‘common’, and somebody is attacking it, what’s wrong with that?
– I guess it becomes questionable when these definitions lead to more of the good is ending up with some people – the fellows who are spouting these glorious quotes and values and then get to make the decisions ‘on behalf’ of everybody else, while many of the everybody else are doing the dying and sacrificing. If it becomes apparent that these value leaders and doers have actually been acting more on behalf of their own good, the trust in those values is eroded. No matter how they are justified: by philosophical theories, by divine revelations (mostly revealed only to some special prophets), by political theories, or scientific theories. Or systems thinking. Or holistic thinking and awareness.
– Even scientific and systemic investigations?
That’s the tragedy, right. You may argue that science and systems tools are our best available tools for guiding action, based on objective measurements and facts, and have all the evidence and replicable observations to support them: if they then are used by leaders, — governments or ‘movements’ — to postulate ‘meta values’ to guide actions ‘on behalf of’ others, they will run into the same trust issues as all the other attempts to do the same, — unless…
– Unless what?
Well: unless they can also offer guarantees that those leaders are not just acting on their own behalf. Even if Congress were full of scientists and systems thinkers: if they make laws to deprive people of health insurance while themselves enjoying the best insurance and health care, no matter what justification they offer for their actions, they would run into trust problems. So that would be one condition.
– One condition, Vodçek? Are there others?
– In theory, yes. Its’ actually part of the job of the legislature: isn’t it in the constitution, even, that they should make laws on behalf of their constituents. And the representative notion is, of course, that representatives should be part of the communities they represent and communicate with then so that they know what the community wants? And then go and vote for laws that realize those preferences.
– Which they should do even if they don’t agree with them? Even if they know better? Doesn’t the constitution also state that they should vote according to their own conscience?
– Right: there seems to be some contradiction there. And it’s leading to that constant tug-of-war between the principle of electing representatives whose judgment we trust — to vote in view of the common good – even if we don’t agree, — because we don’t have all the information? Or because we are suffering from doctrinaire blindness or stupidity, or ethical or moral depravity? And to the alternative of passing laws by referendum, regardless of what the representatives are saying.
– Well, there’s the practical issue: we can’t possibly make all laws by referendum, can we? And if we are too ignorant to give our representatives proper guidance about how to vote so they have to vote by their own better knowledge and information and conscience, should we be allowed to vote on laws?
– But we are allowed to vote for the representatives? Isn’t there an expectation that the representatives should provide enough information to their constituents to know and understand the best available basis of judgment for the needed actions and also be confident that the representatives’ basis of judgment is sound enough to let them vote according to their own judgment conscience if and when necessary?
– Right. Theory, perhaps; current practice of governance looks a bit different. But that’s where our question about the criterion functions come in, again: They are part of the process of not only making up our minds about what actions to take or to support, but also of explaining our basis of judgment to each other. In the extreme, so that we can trust somebody else to make judgments and take action on our behalf – because we have conveyed our mutual basis of judgment well enough, as well as made sure it does give adequate consideration to all available information and concerns.
– So what we are trying to clear up for ourselves is this question: Are there general or universal ‘meta-values’ that can give us adequate criteria to guide effective action — not only let leaders invoke those values without an way of checking whether they actually are served by the proposed actions? And how would those criteria / measures come to be identified and agreed upon?
– Even more specifically, whether those measures should be determined by objective measurement, and then used by some people who are able or entitled to initiate ‘effective action’ to not only do so, — on behalf of everybody else – but to claim that this is ethically and morally defensible and necessary.
– And to declare everybody who disagrees to be ethically misguided – really: to be ‘bad’ or ‘evil’ people.
– Do they come right out and say so?
– I think both sides are, in so many words, unfortunately. So the question of whether there are ‘meta-values’ with related performance measures that everybody should adopt and thus support the resulting actions, is an important one. The sticking part being, to support collective actions taken on our behalf, and perhaps compelling us to take certain everyday actions ourselves, in pursuit of those meta-values. Didn’t we say, a little while ago, that somebody can take action on my behalf if I have given him my criterion functions? – But now it looks like the suggestion is the other way around: that there are criterion functions people tell us we should adopt, to comply with the ethical demands of the Meta Values. So we are trying to understand what that really means.
– Okay: so, let us assume that we have persuaded the participants in the climate change debate to explain their basis of judgment to each other, as much as possible by use of criterion functions. Diagrams that explain how or subjective ‘goodness’ judgments g about proposed plans relate to some ‘objective’, measurable properties of climate change aspects. Take the example of the ‘evil’ CO2 that we are adding to the atmosphere. Assuming that there is some agreement about how much that matters – a different scientific question that also needs sorting out in many people’s minds. And assuming there’s some meaningful agreement about how and where those levels of CO2 will be measured.
– What do you mean – are agreements about CO2 needed? Isn’t that just a simple scientific fact?
– No, Sophie: It makes a difference whether you measure CO2 content in the atmosphere, and at what height, or in the oceans. All those things must be sorted out. Then: is the ‘amount’ or ‘percentage’ of CO2 a good choice of criterion for explaining our judgments about the quality of a plan to improve things?
+ Sure: Haven’t scientists found out, in may serious studies, that the amount of CO2, at the time when we began so see substantial human-based climate change, was some value ‘c*’? Whether you wish to use the actual measure of the amount of CO2 in the atmosphere or its percentage, does not really matter, at least for the sake of this question. Now, say a plan or policy P1 has been proposed to try to get things back in line, whatever that means. So a person tries to explain how her judgment score on some scale +U, to –U, say +3 to -3 depends on how close a proposed plan comes to that ‘goal’ of c*. Would you say that to get a ‘goodness score of +3 (meaning ‘couldn’t possibly get any better’, on a ‘goodness scale of +3 ‘couldn’t possibly get any better, to -3 meaning ‘couldn’t possibly get any worse’ with a midpoint of zero ‘’so-so’, do don’t know’), the plan would have to achieve a return to that value ‘c*’? So you’d draw up a criterion function with the top of the curve touching the +3 line at c*. But another person B thinks that a slightly higher level of CO2 would be OK given some measures in the plan to mitigate it faster. It looks like this:
Figure 3: Criterion functions of two persons, for a plan to return the CO2 value to a desirable CO2 level
It shows their different judgment basis regarding what that level c* should be, showing the CO2-measure on the x-axis and the judgment score on the y-axis. Any lower or higher than that would get a lower score.
– Okay; I see. And you are saying that in principle, every participant in the evaluation would be entitled to his or her own curve? Even one that doesn’t have the highest score at ‘c*’?
– Now why would you – or anybody – put the highest score anywhere else?
– Well, aren’t you guys saying that having spewed so much CO2 into the atmosphere since it was at that benign level ‘c*’ has done a lot of damage already? So to repair that damage – to get the glaciers to grow back, for example, or to cool down the oceans, – it would be necessary to reduce the CO2 to a lower level than ‘c*’ – at least for a while? If you could calculate that level, that’s where a person B might put the +3 score. And give that score to another plan P2 that would achieve that level. Does that make sense?
– Wait a minute: wouldn’t it be better to look at the effectiveness of a plan to reduce the amount of CO2 – at least, as you say, for a while, until the effects of increased CO2 level have been ‘repaired’?
– Good question, at least for showing that even the choice of criterion is a controversial issue. You could say that it might be even better to look at how close to the ideal CO2 level a plan can get with its reduction effectiveness, and show how that relates to what would happen if nothing is done? Which is always an alternative ‘plan’?
– Good. But the question is really about whether the criterion of ‘c*’ or ‘c•’ is an appropriate one to base you judgment upon: Both plans are claiming to reach those values – claims that should be assessed for their plausibility, don’t forget – but at different points in time. So which one is ‘better’?
– I guess we should say: the plan that gets there ‘sooner’ – all other aspects being equal, for the sake of the argument.
– Yes, but doesn’t that mean you really have a different criterion? Specifically: the criterion of ‘time for the plan to get to c* — or c•? Which really is a different criterion, so which one are you going to use?
– Does it matter whether we use different levels of desirable c’s as long as we all come up with a goodness judgment g, and we each have explained what that judgment depends upon?
– If the outcome is that your judgment will support P1 while –‘s score will prefer P2 as the better plan – all else being equal, as you say: the problem isn’t really solved yet, is it?
– Hey guys, aren’t you missing something essential here? Well, you did sort of stumble on it, – with your remark ‘at least for a while’.
– Huh? Explain, Vodçek. What’s missing?
– Time, of course. In your criterion functions so far, you seem to make an assumption that your plans P1 and P2 will somehow ‘achieve’ some level of CO2 one they got implemented, and that things would then stay that way? But come on, that’s not how things work, is it? Even a plan for this kind of issue would have to involve activities, policies, processes, all continuing over time. It can’t be a sudden magic spell to change things overnight. And then it would take time for the actual CO2 level to change back to whatever level you’d have in mind — if the plan works. But how long is that going to take? And is it going to stay at that level? Shouldn’t that be part of your systemic ‘due consideration’?
– You are right. So let me see – looks like we have to draw up a kind of three-dimensional criterion function, is that what you are implying?
– Right. If you are serious about this idea of ‘explaining how your subjective judgment relates to objective criteria’. Not everybody does…
– Okay, I see your point. So we draw the diagram like this: Time on the horizontal right-left axis, CO2 – level on the horizontal up-down axis y, and your judgment on the vertical axis z.
– And before you ask, I think Dexter would say simulation models to predict the track of the CO2 levels for each plan over time can and have been developed, given reliable data…
– But now, what’s your score for those plans? If the CO2 levels and judgments change all the time? By the way, wouldn’t you have to also include a simulated track for the ‘current’ state of affairs and its future track if nothing is done?
+ Right. So we have the time CO2 simulation with three tracks – like this?
– Okay, what about instead looking at the difference between the desired targets and what the plans are actually achieving, over time? It would require looking at the total measure of those differences over time, and I agree that it would also require an agreement about the time frame we are willing to look at. People keep talking about the world we are going to leave for our grandchildren, from a more systemic and holistic perspective – but don’t offer any specifics about how we might distinguish one plan from another, or even from just doing nothing?
– I like your point about looking at the difference, the degree of improvement we can expect from a plan. What would that look like in your diagram?
– Well, the measure would have to be one like the area of the judgment ‘surface’ between two alternatives? Because we agree that in order to reach some kind of meaningful overall measure, it will have to be made up of judgment’ measures, right? But I’m sure that at least for individual judgment systems, ways can be found to calculate that, just as there are equations that describe the simple line functions in the previous examples. But for the time assessment, it will have to include some feature of ‘discounting’ the judgments over time – like calculating the ‘present’ value of a series of income or cost payments over time. Work to do, eh? Because you can see in the diagram that if a plan ‘works’, the improvement judgment area will get wider and wider over time – but after since the probabilities / plausibility judgments will also get more and more uncertain for long future time periods, they will become less and less important factors in the final overall judgment.
– I see what you mean. Not because we don’t care about future generations, mind you – but simply because we just can’t be certain about our predictions about the future.
– Right. Meanwhile, the discourse may become more productive if we threw more of these kinds of diagrams into the fray? Like this one about the judgment surfaces – I agree it needs discussion?
– So you may have to look at the actual results that those changes in CO2 will bring about, over time? Like: levels of ocean rise expected until the remedy sets in – will it actually recede if the plans are any good? I haven’t heard anybody even mention that yet… And provisions for what to do about sea level change until it stops rising?
– Coming to think of that – have there been any plans put out there with that kind of details?
– I admit, I haven’t been following all the reports on that controversy – but I am not aware of any.
– Hey, here’s a test for promoters of a plan: ask them whether they are willing to put up down payments for new ocean front real estate that will emerge if their plan works as intended?
– Renfroe… Ah well, maybe you’ve got something there. Get Al to put down money for property on the beach in front of Mar-a-Lago?
– You guys are giving me a headache. How are we ever going to get moving on the problem if you keep analyzing things to death and wasting time with stupid pranks?
– Well, who was claiming and boasting about taking a more systemic and holistic look at these problems, and of making decisions based on objective facts? It may be useful to turn that big talk down a notch, and focus on the painful nitty-gritty aspects of how to make these decisions. So that people can agree on something specific instead of calling each other names, and resisting plans because of distrust – deserved or not – about what the promoters for plan P1 or P2 are really after? Like power? The next election? More profit for one industry rather than another? That lack of trust may be the real reason why people keep resisting plans to do something about problems. But can’t talk about them because those suspected motives or their lack of them aren’t being part of the discourse?
– Ah: the discourse. Yes. How to talk about all that without starting to call each other names or throwing rocks at each other and storefronts… What does that take? Where’s Abbé Boulah?
A tavern discussion looking at the idea of an artificial planning discourse participant from the perspectives of the argumentative model and the systems thinking perspectives, expanding both (or mutually patching up their shortcomings), and inadvertently stumbling upon potential improvements upon the concept of democracy.
Customers and patron of a fogged-in island tavern with nothing better to do,
awaiting news on progress on the development of a better planning discourse
begin an idly speculative exploration of the idea of an artificial planner:
would such a creature be a better planning discourse participant?
– Hey Bog-Hubert: Early up and testing Vodçeks latest incarnation of café cataluñia forte forte? The Fog Island Tavern mental alarm clock for the difficult-to-wakeup?
– Good morning, professor. Well, have you tried it? Or do you want to walk around in a fogged-in-morning daze for just a while longer?
– Whou-ahmm, sorry. Depends.
– Depends? On what?
– Whether this morning needs my full un-dazed attention yet.
– Makes sense. Okay. Let me ask you a question. I hear you’ve been up in town. Did you run into Abbé Boulah, by any chance? He’s been up there for a while, sorely neglecting his Fog Island Tavern duties here, ostensibly to help his buddy at the university with the work on his proposals for a better planning discourse system. Hey, Sophie: care to join us?
– Okay, good morning to you too. What’s this about a planning system?
– I’m not sure if it’s a ‘system’. I was asking the professor if he has heard whether Abbé Boulah and his buddy have made any progress on that. It’s more like a discourse platform than a ‘system’ – if by ‘system’ you mean something like an artificial planning machine – a robot planner.
– Oh, I’m relieved to hear that.
– Why, Sophie?
– Why? Having a machine make our plans for our future? That would be soo out of touch. Really. Just when we are just beginning to understand that WE have to take charge, to redesign the current ‘MeE’ system, from a new Awareness of the Whole, of our common place on the planet, in the universe, our very survival as a species? That WE have to get out from under that authoritarian, ME-centered linear machine systems thinking, to emerge into a sustainable, regenerative NEW SYSTEM?
– Wow. Sounds like we are in more trouble than I thought. So who’s doing that, how will we get to that New System?
– Hold on, my friends. Lets not get into that New System issue again – haven’t we settled that some time ago here – that we simply don’t know yet what it should be like, and should try to learn more about what works and what doesn’t, before starting another ambitious grand experiment with another flawed theory?
– Okay, Vodçek, good point. But coming to think about it – to get there, — I mean to a better system with a better theory — wouldn’t that require some smart planning? You can’t just rely on everybody coming to that great awareness Sophie is taking about, for everything just to fall into place? So wouldn’t it be interesting to just speculate a bit about what your, I mean Abbé Boulah’s buddy’s planning machine, would have to do to make decent plans?
– You mean the machine he doesn’t, or, according to Sophie, emphatically shouldn’t even think about developing?
– That’s the one.
– Glad we have that cleared up… Well, since we haven’t heard anything new about the latest scandals up in town yet, it might be an interesting way to pass the time.
– I hear no real objections, just an indecisive Hmm. And no, I don’t have any news from Abbé Boulah either – didn’t see him. He tends to stay out of public view. So it’s agreed. Where do we start?
– Well: how about at the beginning? What triggers a planning project? How does it start?
Initializing triggers for planning?
– Good idea, Sophie. Somebody having a problem – meaning something in the way things are, that are perceived as unsatisfactory, hurtful, ugly, whatever: not the way they ought to be?
– Or: somebody just has a bright idea for doing something new and interesting?
– Or there’s a routine habit or institutional obligation to make preparations for the future – to lay in provisions for a trip, or heating material for the winter?
– Right: there are many different things that could trigger a call for ‘doing something about it’ – a plan. So what would the machine do about that?
– You are assuming that somebody – a human being – is telling the machine to do something? Or are you saying that it could come up with a planning project on its own?
– It would have to be programmed to recognize a discrepancy between what IS and what OUGHT to be, about a problem or need, wouldn’t it? And some human would have had to tell him that. Because it’s never the machine (or the human planner working on behalf of people) hurting if there’s a problem; its only people who have problems.
– So it’s a Him already?
– Easy, Sophie. Okay: A She? You decide. Give her, him, it a name. So we can get on with it.
– Okay. I’d call it the APT – Abominable Planning Thing. And it’s an IT, a neuter.
– APT it is. Nicely ambiguous… For a moment I thought you meant Argumentative Planning Tool. Or Template.
– Let’s assume, for now, that somebody told it about a problem or a bright idea. So what would that APT do?
Ground rules, Principles?
Due consideration of all available information;
Whole system understanding guiding decisions
towards better (or at least not worse) outcomes
for all affected parties
– Wait: Shouldn’t we first find out some ground rules about how it’s going to work? For example, it wouldn’t do to just come up with some random idea and say ‘this is it’?
– Good point. You have any such ground rules in mind, professor?
– Sure. I think one principle is that it should try to gather and ‘duly consider’ ALL pertinent information that is available about the problem situation. Ideally. Don’t you agree, Sophie? Get the WHOLE picture? Wasn’t that part of the agenda you mentioned?
– Sounds good, professor. But is it enough to just ‘have’ all the information? Didn’t someone give a good description of the difference between ‘data’ (just givens, messages, numbers etc) and ‘information’ – the process of data changing someone’s stat of knowledge, insight, understanding?
– No, you are right. There must be adequate UNDERSTANDING – of what it means and how it all is related.
– I see a hot discussion coming up about what that really means: ‘understanding’… But go on.
– Well, next: wouldn’t we expect that there needs to be a process of developing or drawing a SOLUTION or a proposed PLAN – or several – from that understanding? Not just from the stupid data?
– Det er da svœrt så fordringfull du er idag, Sophie: Now you are getting astoundingly demanding here. Solutions based on understanding?
– Oh, quit your Norwegian bickering. I’ll do even more demanding: Mustn’t there be a way to CONNECT all that understanding, all the concerns, data, facts, arguments, with any proposed DECISION, especially the final one that leads to action, implementation. If we ever get to that?
– Are you considering that all the affected folks will expect that the decision should end up making things BETTER for them? Or at least not WORSE than before? Would that be one of your ground rules?
– Don’t get greedy here, Vodçek. The good old conservative way is to ask some poor slobs to make some heroic Sacrifices for the Common Good. “mourir pour des idées, d’accord, mais de mort lente…” as George Brassens complains. But you are right: ideally, that would be a good way to put the purpose of the effort.
– All right, we have some first principles or expectations. We’ll probably add some more of those along the way, but I’d say it’s enough for a start. So what would our APT gizmo do to get things moving?
– I’d say it would start to inquire and assemble information about the problem’s IS state, first. Where is the problem, who’s hurting and how, etc. What caused it? Are there any ideas for how to fix it? What would be the OUGHT part — of the problem as well as a bright idea as the starting point?
– Sounds good, Bog-Hubert. Get the data. I guess there will be cases where the process actually starts with somebody having a bright idea for a solution. But that’s a piece of data too, put it in the pile. Where would it get all that information?
– Many sources, I guess. First: from whoever is hurting or affected in any way.
– By the problem, Vodçek? Or the solutions?
– Uh, I guess both. But what if there aren’t any solutions proposed yet?
– It means that the APT will have to check and re-check that whenever someone proposes a solution — throughout the whole process, doesn’t it? It’s not enough to run a single first survey of citizen preferences, like they usually do to piously meet the mandate for ‘citizen participation’. Information gathering, research, re-research, analysis will accompany the whole process.
– Okay. It’s a machine, it won’t get tired of repeated tasks.
– Ever heard of devices overheating, eh? But to go on, there will be experts on the particular kind of problem. There’ll be documented research, case studies from similar events, the textbooks, newspapers, letters to the editor, petitions, the internet. The APT would have to go through everything. And I guess there might have to be some actual ‘observation’, data gathering, measurements.
– So now it has a bunch of stuff in its memory. Doesn’t it have to sort it somehow, so it can begin to do some real work on it?
– You don’t think gathering that information is work, Sophie?
– Sure, but just a bunch of megabytes of stuff… what would it do with it? Don’t tell me it can magically pull the solution from that pile of data!
– Right. Some seem to think they can… But you’ll have to admit that having all the information is part of the answer to our first expectation: to consider ALL available information. The WHOLE thing, remember? The venerable Systems Thinking idea?
– Okay. If you say so. So what to you mean by ‘consider’ – or ‘due consideration’? Just staring at the pile of data until understanding blossoms in your minds and the solution jumps out at you like the bikini-clad girl out of the convention cake? Or Aphrodite rising out of the data ocean?
– You are right. You need to make some distinctions, sort out things. What you have now, at best, are a bunch of concepts, vague, undefined ideas. The kind of ‘tags’ you use to google stuff.
– Yeah. Your argumentation buddy would say you’d have to ask for explanations of those tags – making sure it’s clear what they mean, right?
– Yes. Now he’d also make the distinction that some of the data are actual claims about the situation. Of different types: ‘fact’-claims about the current situation; ‘ought’ claims about what people feel the solution should be. Claims of ‘instrumental’ knowledge about what caused things to become what they are, and thus what will happen when we do this or that: connecting some action on a concept x with another concept ‘y’ – an effect. Useful when we are looking for x’s to achieve desired ‘y’s that we want – the ‘ought’ ideas – or avoid the proverbial ‘unexpected / undesirable’ side-and after-effect surprises of our grand plans: ‘How’ to do things.
– You’re getting there. But some of the information will also consist of several claims arranged into arguments. Like: “Yes, we should do ‘x’ (as part of the plan) because it will lead to ‘y’, and ‘y’ ought to be…” And counterarguments: “No, we shouldn’t do ‘x’ because x will cause ‘z’ which ought not to be.”
– Right. You’ve been listening to Abbé Boulah’s buddy’s argumentative stories, I can tell. Or even reading Rittel? Yes, there will be differences of opinion – not only about what ought to be, but about what we should do to get what we want, about what causes what, even about what Is the case. Is there an old sinkhole on the proposed construction site? And if so, where? That kind of issue. And different opinions about those, too. So the data pile will contain a lot of contradictory claims of all kinds. Which means, for one thing, that we, –even Spock’s relative APT — can’t draw any deductively valid conclusions from contradictory items in the data. ‘Ex contradictio sequitur quodlibet’, remember – from a contradiction you can conclude anything whatever. So APT can’t be a reliable ‘artificial intelligence’ or ‘expert system’ that gives you answers you can trust to be correct. We discussed that too once, didn’t we – there was an old conference paper from the 1990s about it. Remember?
– But don’t we argue about contradictory opinions all the time – and draw conclusions about them too?
– Sure. Living recklessly, eh? All the time, and especially in planning and policy-making. But it means that we can’t expect to draw ‘valid’ conclusions that are ‘true or false’, from our planning arguments. Just more or less plausible. Or ‘probable’ – for claims that are appropriately labeled that way.
Systems Thinking perspective
Versus Argumentative Model of Planning?
– Wait. What about the ‘Systems Thinking’ perspective — systems modeling and simulation? Isn’t that a better way to meet the expectation of ‘due consideration’ of the ‘whole system’? So should the APT develop a systems model from the information it collected?
– Glad you brought that up, Vodçek. Yes, it’s claimed to be the best available foundation for dealing with our challenges. So what would that mean for our APT? Is it going to have a split robopersonality between Systems and the Argumentative Model?
– Let’s look at both and see? There are several levels we can distinguish there. The main tenets of the systems approach have to do with the relationships between the different parts of a system – a system is a set of parts or entities, components, that are related in different ways – some say that ‘everything is connected / related to everything else’ – but a systems modeler will focus on the most significant relationships, and try to identify the ‘loops’ in that network of relationships. Those are the ones that will cause the system to behave in ways that can’t be predicted from the relationships between any of the individual pairs of entities in the network. Complexity; nonlinearity. Emergence.
– Wow. You’re throwing a lot of fancy words around there!
– Sorry, Renfroe; good morning, I didn’t see you come in. Doing okay?
– Yeah, thanks. Didn’t get hit by a nonlinearity, so far. This a dangerous place now, for that kind of thing?
– Not if you don’t put too much brandy in that café cataluñia Vodçek is brewing here.
– Hey, lets’ get back to your systems model. Can you explain it in less nonlinear terms?
– Sure, Sophie. Basically, you take all the significant concepts you’ve found, put them into a diagram, a map, and draw the relationships between them. For example, cause-effect relationships; meaning increasing ‘x’ will cause an increase in ‘y’. Many people think that fixing a system can best be done by identifying the causes that brought the state of affairs about that we now see as a problem. This will add a number or new variables to the diagram, to the ‘understanding’ of the problem.
– They also look for the presence of ‘loops’ in the diagram, don’t they? – Where cause-effect chains come back to previous variables.
– Right, Vodçek. This is an improvement over a simple listing of all the pro and con arguments, for example – they also talk about relationships x – y, but only one at a time, so you don’t easily see the whole network, and the loops, in the network. So if you are after ‘understanding the system’, seeing the network of relationships will be helpful. To get a sense of its complexity and nonlinearity.
– I think I understand: you understand a system when you recognize that it’s so loopy and complex and nonlinear that its behavior can’t be predicted so it can’t be understood?
– Renfroe… Professor, can you straighten him out?
– Sounds to me like he’s got it right on, Sophie. Going on: Of course, to be really helpful, the systems modeler will tell you that you should find a way to measure each concept, that is, find a variable – a property of the system that can be measures with precise units.
– What’s the purpose of that, other than making it look more scientific?
– Well, Renfroe, remember the starting point, the problem situation. Oh, wait, you weren’t here yet. Okay; say there’s a problem. We described it as a discrepancy between what somebody feels Is the case and what Ought to be. Somebody complains about it being too hot in here. Now just saying: ‘it’s too hot; it ought to be cooler’, is a starting point, but in order to become useful, you need to be able to say just what you mean by ‘cooler’. See, you are stating the Is/Ought problem in terms of the same variable ‘temperature’. So too even see the difference between Is and Ought, you have to point to the levels of each. 85 degrees F? Too hot. Better: cool it to 72. Different degrees or numbers on the temperature scale.
– Get it. So now we have numbers, math in the system. Great. Just what we need. This early in the morning, too.
– I was afraid of that too. It’s bound to get worse…nonlinear. So in the argumentative approach – the arguments don’t show that? Is that good or bad?
– Good question. Of course you can get to that level, if you bug them enough. Just keep asking more specific questions.
– Aren’t there issues where degrees of variables are not important, or where variables have only two values: Present or not present? Remember that the argumentative model came out of architectural and environmental design, where the main concerns were whether or not to provide some feature: ‘should the entrance to the building be from the east, yes or no?’ or ‘Should the building structure be of steel or concrete?’ Those ‘conceptual’ planning decisions could often be handled without getting into degrees of variables. The decision to go with steel could be reached just with the argument that steel would be faster and cheaper than concrete, even before knowing just by how much. The arguments and the decision were then mainly yes or no decisions.
– Good points, Vodçek. Fine-tuning, or what they call ‘parametric’ planning comes later, and could of course cause much bickering, but doesn’t usually change the nature of the main design that much. Just its quality and cost…
Simulation of systems behavior
– Right. And they also didn’t have to worry too much about the development of systems over time. A building, once finished, will usually stay that way for a good while. But for policies that would guide societal developments or economies, the variables people were concerned about will change considerably over time, so more prediction is called for, trying to beat complexity.
– I knew it, I knew it: time’s the culprit, the snake in the woodpile. I never could keep track of time…
– Renfroe… You just forget winding up your old alarm clock. Now, where were we? Okay: In order to use the model to make predictions about what will happen, you have to allocate each relationship step to some small time unit: x to y during the first time unit; y to z in the second, and so on. This will allow you to track the behavior of the variables of the system over time, give some initial setting, and make predictions about the likely effects of your plans. The APT computer can quickly calculate predictions for a variety of planning options.
– I’ve seen some such simulation predictions, yes. Amazing. But I’ve always wondered how they can make such precise forecasts – those fine crisp lines over several decades: how do they do that, when for example our meteorologists can only make forecasts of hurricane tracks of a few days only, tracks that get wider like a fat trumpet in just a few days? Are those guys pulling a fast one?
– Good point. The answer is that each simulation only shows the calculated result of one specific set of initial conditions and settings of relationships equations. If you make many forecasts with different numbers, and put them all on the same graph, you’d get the same kind of trumpet track. Or even a wild spaghetti plate of tracks.
– I am beginning to see why those ‘free market’ economists had such an advantage over people who wanted to gain some control of the economy. They just said: the market is unpredictable. It’s pointless to make big government plans and laws and regulations. Just get rid of all the regulations, let the free market play it out. It will control and adapt and balance itself by supply and demand and competition and creativity.
– Yeah, and if something goes wrong, blame it on the remaining regulations of big bad government. Diabolically smart and devious.
– But they do appreciate government research grants, don’t they? Wait. They get them from the companies that just want to get rid of some more regulations. Or from think tanks financed by those companies.
– Hey, this is irresponsibly interesting but way off our topic, wouldn’t you say?
– Right, Vodçek. Are you worried about some government regulation – say, about the fireworks involved in your café catastrofia? But okay. Back to the issue.
– So, to at least try to be less irresponsible, our APT thing would have systems models and be able to run simulations. A simulation, if I understand what you were saying, would show how the different variables in the system would change over time, for some assumed initial setting of those variables. That initial setting would be different from the ‘current’ situation, though, wouldn’t it? So where does the proposed solution in the systems model come from? Where are the arguments? Does the model diagram show what we want to achieve? Or just the ‘current state’?
Representation of plan proposals
and arguments in the systems model?
– Good questions, all. They touch on some critical problems with the systems perspective. Let’s take one at a time. You are right: the usual systems model does not show a picture of a proposed solution. To do that, I think we’ll have to expand a little upon our description of a plan: Would you agree that a plan involves some actions by some actors, using some resources acting upon specific variables in the system? Usually not just one variable but several. So a plan would be described by those variables, and the additional concepts of actions, actor, resources etc. Besides the usual sources of plans, — somebody’s ‘brilliant idea’, some result of a team brainstorming session, or just an adaptation of a precedent, a ‘tried and true’ known solution with a little new twist, — the systems modeler may have played around with his model and identified some ‘leverage points’ in the system – variables where modest and easy-to-do changes can bring about significant improvement elsewhere in the system: those are suggested starting points for solution ideas.
– So you are saying that the systems tinkerer should get with it and add all the additional solution description to the diagram?
– Yes. And that would raise some new questions. What are those resources needed for the solution? Where would they come from, are they available? What will they cost? And more: wouldn’t just getting all that together cause some new effects, consequences, that weren’t in the original data collection, and that some other people than those who originally voiced their concerns about the problem would now be worried about? So your data collection component will have to go back to do some more collecting. Each new solution idea will need its own new set of information.
– There goes your orderly systematic procedure all right. That may go on for quite some time, eh?
– Right. Back and forth, if you want to be thorough. ‘Parallel processing’. And it will generate more arguments that will have to be considered, with questions about how plausible the relationship links are, how plausible the concerns about the effects – the desirable / undesirable outcomes. More work. So it will often be shouted down with the usual cries of ‘analysis paralysis’.
Intelligent analysis of data:
Generating ‘new’ arguments?
– Coming to think of it: if our APT has stored all the different claims it has found – in the literature, the textbooks, previous cases, and in the ongoing discussions, would it be able to construct ‘new’ arguments from those? Arguments the actual participants haven’t thought about?
– Interesting idea, Bog-Hubert. – It’s not even too difficult. I actually heard our friend Dexter explain that recently. It would take the common argument patterns – like the ones we looked at – and put claim after claim into them, to see how they fit: all the if-then connections to a proposal claim would generate more arguments for and against the proposal. Start looking at an ‘x’ claim of the proposal. Then search for (‘google’) ‘x→ ?’: any ‘y’s in the data that have been cited as ‘caused by x’. If a ‘y’ you found was expressed somewhere else as ‘desirable or undesirable’ – as a deontic claim, — it makes an instant ‘new’ potential argument. Of course, whether it would work as a ‘pro’ or a ‘con’ argument in some participant’s mind would depend on how that participant feels about the various premises.
– What are you saying, professor? This doesn’t make sense. A ‘pro’ argument is a ‘pro’ argument, and ‘con’ argument is a ‘con’ argument. Now you’re saying it depends on the listener?
– Precisely. I know some people don’t like this. But consider an example. People are discussing a plan P; somebody A makes what he thinks is a ‘pro’ argument: “Let’s do P because P will produce Q; and Q is desirable, isn’t it?” Okay, for A it is a pro argument, no question. Positive plausibility, he assumes, for P→Q as well as for Q; so it would get positive plausibility pl for P. Now for curmudgeon B, who would also like to achieve Q but is adamant that P→Q won’t work, (getting a negative pl) that set of premises would produce a negative pl for P, wouldn’t it? Similarly, for his neighbor C, who would hate for Q to become true, but thinks that P→Q will do just that, that same set of premises also is a ‘con’ argument.
– So what you’re saying is that all the programs out there, that show ‘dialogue maps’ identifying all arguments as pro or con, as they were intended by their authors, are patently ignoring the real nature and effects of arguments?
– I know some people have been shocked – shocked — by these heretical opinions – they have been written up. But I haven’t seen any serious rebuttals; those companies, if they have heard of them have chosen to ignore them. Haven’t changed their evil ways though…
– So our devious APT could be programmed to produce new arguments. More arguments. Just what we need. The arguments can be added to the argument list, but I was going to ask you before: how would the deontic claims, the ‘oughts’, be shown in the model?
– You’d have to add another bubble to each variable bubble, right? Now, we have the variable itself, the value of each variable in the current IS condition, the value of the variable if it’s part of a plan intervention, and the desired value – hey: at what time?
– You had to put the finger on the sore spot, Vodçek. Bad boy. Not only does this make the diagram a lot less clean, simple, and legible. Harder to understand. And showing what somebody means by saying what the solution ought to achieve, when all the variables are changing over time, now becomes a real challenge. Can you realistically expect that a desired variable should stay ‘stable’ at one desired value all the time, after the solution is implemented? Or would people settle for something like: remaining within a range of acceptable values? Or, if a disturbance has occurred, return to a desired value after some reasonably short specified time?
– I see the problem here. Couldn’t the diagram at least show the central desired value, and then let people judge whether a given solution comes close enough to be acceptable?
– Remember that we might be talking about a large number of variables that represent measures of how well all the different concerns have been met by a proposed solution. But if you don’t mind complex diagrams, you could add anything to the systems model. Or you can use several diagrams. Understanding can require some work, not just sudden ‘aha!’ enlightenment.
Certainty about arguments and predictions
Truth, probability, plausibility and relative importance of claims
– And we haven’t even talked about the question of how sure we can be that a solution will actually achieve a desired result.
– I remember our argumentative friends at least claimed to have a way to calculate the plausibility of a plan proposal based on the plausibility of each argument and the weight of relative importance of each deontic, each ought concern. Would that help?
– Wait, Bog-hubert: how does that work, again? Can you give us the short explanation? I know you guys talked about that before, but…
– Okay, Sophie: The idea is this: a person would express how plausible she thinks each of the premises of an argument are. On some plausibility scale of, say +1 which means ‘totally plausible’, to -1 which means ‘totally implausible; with a midpoint zero meaning ‘don’t know, can’t tell’. These plausibility values together will then give you an ‘argument plausibility’ – on the same scale, either by multiplying them or taking the lowest score as the overall result. The weakest link in the chain, remember. Then: multiplying that plausibility with the weight of relative importance of the ought- premise in the argument, which is a value between zero and +1 such that all the weights of all the ‘oughts’ in all the arguments about the proposal will add up to +1. That will give you the ‘argument weight’ of each argument; and all the argument weights together will give you the proposal plausibility – again, on the same scale of +1 to -1, so you’d know what the score means. A value higher than zero means it’s somewhat plausible; a value lower than zero and close to -1 means it’ so implausible that it should not be implemented. But we aren’t saying that this plausibility could be used as the final decision measure.
– Yeah, I remember now. So that would have to be added to the systems model as well?
– Yes, of course – but I have never seen one that does that yet.
‘Goodness’ of solutions
not just plausibility?
– But is that all? I mean: ‘plausibility’ is fine. If there are several proposals to compare: is plausibility the appropriate measure? It doesn’t really tell me how good the plan outcome will be? Even comparing a proposed solution to the current situation: wouldn’t the current situation come up with a higher plausibility — simply because it’s already there?
– You’ve got a point there. Hmm. Let me think. You have just pointed out that both these illustrious approaches – the argumentative model, at last as we have discussed it so far, as well as the systems perspective, for all its glory, have both grievously sidestepped the question of what makes a solution, a systems intervention ‘good’ or bad’. The argument assessment work, because it was just focused on the plausibility of arguments; as the first necessary step that had not been looked at yet. And the systems modeling focusing on the intricacies of the model relations and simulation, leaving the decision and its preparatory evaluation, if any, to the ‘client.’ Fair enough; they are both meritorious efforts, but it leaves both approaches rather incomplete. Not really justifying the claims of being THE ultimate tools to crack the wicked problems of the world. It makes you wonder: why didn’t anybody call the various authors on this?
– But haven’t there long been methods, procedures for people to evaluate to the presumed ‘goodness’ of plans? Why wouldn’t they have been added to either approach?
– They have, just as separate, detached and not really integrated extra techniques. Added, cumbersome complications, because they represent additional effort and preparation, even for small groups. And never even envisaged for large public discussions.
– So would you say there are ways to add the ‘goodness’ evaluation into the mix? We’ve already brought systems and arguments closer together? You say there are already tools for doing that?
– Yes, there are. For example, as part of a ‘formal’ evaluation procedure, you can ask people to explain the basis of their ‘goodness’ judgment about a proposed solution by specifying a ‘criterion function’ that shows how that judgment depends on the values of a system variable. The graph of it looks like this: On one axis it would have positive (‘like’, ‘good’, desirable’) judgment values on the positive side, and ‘dislike’, ‘bad’, ‘undesirable ‘ values on the negative one, with a midpoint of ‘neither good nor bad’ or ‘can’t decide’. And the specific system variable on the other axis, for example that temperature scale from our example a while ago. So by drawing a line in the graph that touches the ‘best possible’ judgment score at the person’s most comfortable temperature, and curves down towards ‘so-so, and down to ‘very bad’ and ultimately ‘intolerable’, couldn’t get worse’, a person could ‘explain’ the ‘objective’, measurable basis of her subjective goodness.
– But that’s just one judgment out of many others she’d have to make about all the other system variables that have been declared ‘deontic’ targets? How would you get to an overall judgment about the whole plan proposal?
– There are ways to ‘aggregate’ all those partial judgments into an overall deliberated judgment. All worked out in the old papers describing the procedure. I can show you that if you want. But that’s not the real problem here – you don’t see it?
The problem of ‘aggregation’
of many different personal, subjective judgments
into group or collective decision guides
– Well, tell me this, professor: would our APTamajig have the APTitude to make all those judgments?
– Sorry, Bog-Hubert: No. Those judgments would be judgments of real persons. The APT machine would have to get those judgments from all the people involved.
– That’s just too complicated. Forget it.
– Well, commissioner, — you’ve been too quiet here all this time – remember: the expectation was to make the decision based on ‘due consideration’ of all concerns. Of everybody affected?
– Yes, of course. Everybody has the right to have his or her concerns considered.
– So wouldn’t ‘knowing and understanding the whole system’ include knowing how everybody affected feels about those concerns? Wasn’t that, in a sense, part of your oath of office, to serve all members of the public to the best of your knowledge and abilities? So now we have a way to express that, you don’t want to know about that because it’s ‘too complicated?
– Cut the poor commissioner some slack: the systems displays would get extremely crowded trying to show all that. And adding all that detail will not really convey much insight.
– It would, professor, if the way that it’s being sidestepped wasn’t actually a little more tricky, almost deceptive. Commissioner, you guys have some systems experts on your staff, don’t you? So where do they get those pristine performance track printouts of their simulation models?
– Ah. Huh. Well, that question never came up.
– But you are very concerned about public opinion, aren’t you? The polls, your user preference surveys?
– Oh, yeah: that’s a different department – the PR staff. Yes, they get the Big Data about public opinions. Doing a terrific job at it too, and we do pay close attention to that.
– But – judging just from the few incidents in which I have been contacted by folks with such surveys – those are just asking general questions, like ‘How important is it to attract new businesses to the city?’ Nobody has ever asked me to do anything like those criterion functions the professor was talking about. So if you’re not getting that: what’s the basis for your staff recommendations about which new plan you should vote for?
– Best current practice: we have those general criteria, like growth rate, local or regional product, the usual economic indicators.
– Well, isn’t that the big problem with those systems models? They have to assume some performance measure to make a recommendation. And that is usually one very general aggregate measure – like the quarterly profit for companies. Or your Gross National Product, for countries. The one all the critics now are attacking, for good reasons, I’d say, — but then they just suggest another big aggregate measure that nobody really can be against – like Gross National Happiness or similar well-intentioned measures. Sustainability. Systemicity. Whatever that means.
– Well, what’s wrong with those? Are you fixin’ to join the climate change denier crowd?
– No, Renfroe. The problem with those measures is that they assume that all issues have been settled, all arguments resolved. But the reality is that people still do have differences of opinions, there will still be costs as well as benefits for all plans, and those are all too often not fairly distributed. The big single measure, whatever it is, only hides the disagreements and the concerns of those who have to bear more of the costs. Getting shafted in the name of overall social benefits.
Alternative criteria to guide decisions?
– So what do you think should be done about that? And what about our poor APT? It sounds like most of the really important stuff is about judgments it isn’t allowed or able to make? Would even a professional planner named APT – ‘Jonathan Beaujardin APT, Ph.D M.WQ, IDC’ — with the same smarts as the machine, not be allowed to make such judgments?
– As a person, an affected and concerned citizen, he’d have the same right as everybody else to express his opinions, and bring them into the process. As a planner, no. Not claiming to judge ‘on behalf’ of citizens – unless they have explicitly directed him to do that, and told him how… But now the good Commissioner says he wouldn’t even need to understand his own basis of judgment, much less make it count in the decision?
– Gee. That really explains a lot.
– Putting it differently: Any machine – or any human planner, for that matter, however much they try to be ‘perfect’ – trying to make those judgments ‘on behalf’ of other people, is not only imperfect but wrong, unless it has somehow obtained knowledge about those feelings about good or bad of others, and has found an acceptable way of reconciling the differences into some overall common ‘goodness’ measure. Some people will argue that there isn’t any such thing: judgments about ‘good or ‘bad’ are individual, subjective judgments; they will differ, there’s no method by which those individual judgments can be aggregated into a ‘group’ judgment that wouldn’t end up taking sides, one way or the other.
– You are a miserable spoilsport, Bog-Hubert. Worse than Abbé Boulah! He probably would say that coming to know good and bad, or rather thinking that you can make meaningful judgments about good or bad IS the original SIN.
– I thought he’s been excommunicated, Vodçek? So does he have any business saying anything like that? Don’t put words in his mouth when he’s not here to spit them back at you. Still, even if Bog-Hubert is right: if that APT is a machine that can process all kinds of information faster and more accurate than humans, isn’t there anything it can do to actually help the planning process?
– Yes, Sophie, I can see a number of things that can be done, and might help.
– Let’s hear it.
– Okay. We were assuming that APT is a kind of half-breed argumentative-systems creature, except we have seen that it can’t make up either new claims nor plausibility nor goodness judgments on its own. It must get them from humans; only then can it use them for things like making new arguments. If it does that, — it may take some bribery to get everybody to make and give those judgments, mind you – it can of course store them, analyze them, and come up with all kinds of statistics about them.
One kind of information I’d find useful would be to find out exactly where people disagree, and how much, and for what reasons. I mean, people argue against a policy for different reasons – one because he doesn’t believe that the policy will be effective in achieving the desired goal – the deontic premise that he agrees with – and the other because she disagrees with the goal.
– I see: Some people disagree with the US health plan they call ‘Obamacare’ because they genuinely think it has some flaws that need correcting, and perhaps with good reasons. But others can’t even name any such flaws and just rail against it, calling it a disaster or a trainwreck etc. because, when you strip away all the reasons they can’t substantiate, simply because it’s Obama’s.
– Are you saying Obama should have called it Romneycare, since it was alleged to be very similar to what Romney did in Massachusetts when he was governor there? Might have gotten some GOP support?
– Let’s not get into that quarrgument here, guys. Not healthy. Stay with the topic. So our APT would be able to identify those differences, and other discourse features that might help decide what to do next – get more information, do some more discussion, another analysis, whatever. But so far, its systems alter ego hasn’t been able to show any of that in the systems model diagram, to make that part of holistic information visible to the other participants in the discourse.
– Wouldn’t that require that it become fully conscious of its own calculations, first?
– Interesting question, Sophie. Conscious. Hmm. Yes: my old car wouldn’t show me a lot of things on the dashboard that were potential problems – whether a tire was slowly going flat or the left rear turn indicator was out – so you could say it wasn’t aware enough, — even ‘conscious?’ — of those things to let me know. The Commissioner’s new car does some of that, I think. Of course my old one could be very much aware but just ornery enough to leave me in the dark about them; we’ll never know, eh?
– Who was complaining about running off the topic road here just a while ago?
– You’re right, Vodçek: sorry. The issue is whether and how the system could produce a useful display of those findings. I don’t think it’s a fundamental problem, just work to do. My guess is that all that would need several different maps or diagrams.
Discourse –based criteria guiding collective decisions?
– So let’s assume that not only all those judgments could be gathered, stored, analyzed and the results displayed in a useful manner. All those individual judgments, the many plausibility and judgment scores and the resulting overall plan plausibility and ‘goodness’ judgments. What’s still open is this: how should those determine or at least guide the overall group’s decision? In a way that makes it visible that all aspects, all concerns were ‘duly considered’, and ending up in a result that does not make some participants feel that their concerns were neglected or ignored, and that the result is – if not ‘the very best we could come up with’ then at least somewhat better than the current situation and not worse for anybody?
– Your list of aspects there already throws out a number of familiar decision-making procedures, my friend. Leaving the decision to authority, which is what the systems folks have cowardly done, working for some corporate client, (who also determines the overall ‘common good’ priorities for a project, that will be understood to rank higher than any individual concerns) – that’s out. Not even pretending to be transparent or connected to the concerns expressed in the elaborate process. Even traditional voting, that has been accepted as the most ‘democratic’ method, for all its flaws. Out. And don’t even mention ‘consensus’ or the facile ‘no objection?‘ version. What could our APT possibly produce that can replace those tools? Do we have any candidate tools?
– If you already concede that ‘optimal’ solutions are unrealistic and we have to make do with ‘not worse – would it make sense to examine possible adaptations to one of the familiar techniques?
– It may come to that if we don’t find anything better – but I’d say let’s look at the possibilities for alternatives in the ideas we just discussed, first? I don’t feel like going through the pros and cons about our current tools. It’s been done.
– Okay, professor: Could our APT develop a performance measure made up of the final scores of the measures we have developed? Say, the overall goodness score modified by the overall plausibility score a plan proposal achieved?
– Sounds promising.
– Hold your horses, folks. It sounds good for individual judgment scores – may even tell a person whether she ought to vote yes or no on a plan – but how would you concoct a group measure from all that – especially in the kind of public asynchronous discourse we have in mind? Where we don’t even know what segment of the whole population is represented by the participants in the discourse and its cumbersome exercises, and how they relate to the whole public populations for the issue at hand?
– Hmm. You got some more of that café catawhatnot, Vodçek?
– Sure – question got you flummoxed?
– Well, looks like we’ll have to think for a while. Think it might help?
– What an extraordinary concept!
– Light your Fundador already, Vodçek, and quit being obnoxious!
– Okay, you guys. Lets examine the options. The idea you mentioned, Bog-Hubert, was to combine the goodness score and the plausibility score for a plan. We could do that for any number of competing plan alternatives, too.
– It was actually an idea I got from Abbé Boulah some time ago. At the time I just didn’t get its significance.
– Abbé Boulah? Let’s drink to his health. So we have the individual scores: the problem is to get some kind of group score from them. The mean – the average – of those scores is one; we discussed the problems with the mean many times here, didn’t we? It obscures the way the scores are distributed on the scale: you get the same result from a bunch of scores tightly grouped around that average as you’d get from two groups of extreme scores at opposite ends of the scale. Can’t see the differences of opinion.
– That can be somewhat improved upon if you calculate the variance – it measures the extent of disagreement among the scores. So if you get two alternatives with the same mean, the one with the lower variance will be the less controversial one. The range is a crude version of the same idea – just take the difference between the highest and the lowest score; the better solution is the one with a smaller range.
– What if there’s only one proposal?
– Well, hmm; I guess you’d have to look at the scores and decide if it’s good enough.
– Let’s go back to what we tried to do – the criteria for the whole effort: wasn’t there something about making sure that nobody ends up in worse shape in the end?
– Brilliant, Sophie – I see what you are suggesting. Look at the lowest scores in the result and check whether they are lower or higher than, than …
– Than what, Bog-Hubert?
– Let me think, let me think. If we had a score for the assessment of the initial condition for everybody (or for the outcome that would occur if the problem isn’t taken care of) then an acceptable solution would simply have to show a higher score than that initial assessment, for everybody. Right? The higher the difference, even something like the average, the better.
– Unusual idea. But if we don’t have the initial score?
– I guess we’d have to set some target threshold for any lowest score – no lower than zero (not good, not bad) or at least a + 0.5 on a +2/-2 goodness scale, for the worst-off participant score? That would be one way to take care of the worst-off affected folks. The better-off people couldn’t complain, because they are doing better, according to their own judgment. And we’d have made sure that the worst-off outcomes aren’t all that bad.
– You’re talking as if ‘we’ or that APT thing is already set up and doing all that. The old Norwegian farmer’s rule says: Don’t sell the hide before the bear is shot! It isn’t that easy though, is it? Wouldn’t we need a whole new department, office, or institution to run those processes for all the plans in a society?
– You have a point there, Vodçek. A new branch of government? Well now that you open that Pandora’s box: yes, there’s something missing in the balance.
– What in three twisters name are you talking about, Bog-Hubert?
– Well, Sophie. We’ve been talking about the pros and cons of plans. In government, I mean the legislative branch that makes the laws, that’s what the parties do, right? Now look at the judicial branch. There, too, they are arguing – prosecutor versus defense attorney – like the parties in the House and Senate. But then there’s a judge and the jury: they are looking at the pros and cons of both sides, and they make the decision. Where is that jury or judge ‘institution’ in the legislature? Both ‘chambers’ are made up of parties, who too often look like they are concerned about gaining or keeping their power, their majority, their seats, more than the quality of their laws. Where’s the jury? The judge? And to top that off: even the Executive is decided by the party, in a roundabout process that looks perfectly designed to blow the thinking cap off every citizen. A spectacle! Plenty of circenses but not enough panem. Worse than old Rome…
– Calm down, Bog-Hubert. Aren’t they going to the judiciary to resolve quarrels about their laws, though?
– Yes, good point. But you realize that the courts can only make decisions based on whether a law complies with the Constitution or prior laws – issues of fact, of legality. Not about the quality, the goodness of the law. What’s missing is just what Vodçek said: another entity that looks at the quality and goodness of the proposed plans and policies, and makes the decisions.
– What would the basis of judgment of such an entity be?
– Well, didn’t we just draw up some possibilities? The concerns are those that have been discussed, by all parties. The criteria that are drawn from all the contributions of the discourse. The party ‘in power’ would only use the criteria of its own arguments, wouldn’t it? Just like they do now… Of course the idea will have to be discussed, thought through, refined. But I say that’s the key missing element in the so-called ‘democratic’ system.
– Abbé Boulah would be proud of you, Bog-Hubert. Perhaps a little concerned, too? Though I’m still not sure how it all would work, for example considering that the humans in the entity or ‘goodness panel’ are also citizens, and thus likely ‘party’. But that applies to the judge and jury system in the judicial as well. Work to do.
– And whatever decision they come up with, that worst-off guy could still complain that it isn’t fair, though?
– Better that 49% of the population peeved and feeling taken advantage of? Commissioner: what do you say?
– Hmmm. That one guy might be easier to buy off than the 49%, yes. But I’m not sure I’d get enough financing for my re-election campaign with these ideas. The money doesn’t come from the worst-off folks, you know…
– Houston, we have a problem …