Risk Academy, a Nexortium programmeRisk Science and MethodsDepartment of Decision, Behaviour and Communication

Turning expert knowledge into a reviewable distribution

Expert judgement and elicitation

Where data are thin, risk still has to be quantified, and expert judgement is the method of record.

risksacademy.comrisk-sciencediscipline

Expert judgement and elicitation, drawn as uncertainty bands: 0 primary courses open, 0 in preparation, 0 approved for authoring and 0 also taught here, across 9 subtopics. Courses: none yet.L1L2L3L420
Expert judgement and elicitation at a glance. Drawn as uncertainty bands.
  • Open, 0
  • In preparation, 0
  • Subtopics, 9
Course codes from the curriculum; study levels L1 to L4.
Twin builder and simulatorThe central Apennines: L'Aquila, Amatrice and Norcia4 twin generators, 8 layers, 4 instruments
courses open now
0
in preparation
0
subtopics in its scope
9
reference earthquakes, M6.2 to M6.6
3

Twin figures for the central Apennines: L'Aquila, Amatrice and Norcia, counted from its layers at their stated dates.

Twin builder and simulator.

For Expert judgement and elicitation: the faculty's twin of L'Aquila on the planet map, the globe and in 3D. Pick a generator, switch layers, run the instruments; every layer prints its provider and date.

The central Apennines: L'Aquila, Amatrice and Norcia: a flat plan of the faculty twin. Terrain 24 to 2,805 m; 3 reference earthquakes, M6.2 to M6.6; Earthquakes M4.5 and above, past week (live): live, loads in the twin; USGS ShakeMap intensity contours: live, loads in the twin. Contours every 500 metres from the elevation grid; reference earthquakes as marks.
The central Apennines: L'Aquila, Amatrice and Norcia, Italy. Flat plan of the same data: relief, the three reference epicentres with magnitude and depth, and the numbers below; the sampler's figure shows one precomputed field with its parameters. The 3D twin opens on devices with WebGL once its data and library have been checked.
  • Terrain 24 to 2,805 m
  • 3 reference earthquakes, M6.2 to M6.6
  • Earthquakes M4.5 and above, past week (live): live, loads in the twin
  • USGS ShakeMap intensity contours: live, loads in the twin
Credits and dates per layer are listed under the stage. Relief in the twin is exaggerated ×1.5 for legibility.

Drag to move, right drag or Shift with a drag to turn and tilt, Ctrl with the wheel to zoom. Keyboard: arrows move, Shift with arrows turn and tilt, + and - zoom, 0 resets, V steps through the views, Escape clears.

Flat plan of the same data: relief, the three reference epicentres with magnitude and depth, and the numbers below; the sampler's figure shows one precomputed field with its parameters. The 3D twin opens on devices with WebGL once its data and library have been checked.

The map loads from this site as it nears the view (MapLibre 6.9.1, checked by hash).

The discipline in brief.

The discipline teaches structured protocols for eliciting it: the Classical Model, which weights experts by their calibration on seed questions, the IDEA and Delphi protocols, and SHELF for behavioural aggregation, with the heuristics and biases (anchoring, availability, overconfidence) each protocol is designed to counter. It treats documentation as part of the method, so that a panel's distribution can be audited like any other model input, as the IPCC and catastrophe modellers require. A graduate can design an elicitation, score experts on seed questions and combine their judgements into a distribution with its basis on record.

This area covers how uncertain quantities are estimated from experts when data are thin: structured elicitation protocols, the calibration and weighting of experts, and the aggregation of their judgements into a distribution. It is taught in the department of Decision, Behaviour and Communication, Faculty of Risk Science and Methods, through courses still to be authored.

What the discipline covers.

9 subtopics, taught across its courses and labs.

Courses
0 open, 0 in preparation
Levels
None yet
Labs
Named when the courses are authored
  • Structured expert judgement protocols
  • The Classical Model and performance-based weighting
  • IDEA and Delphi protocols
  • SHELF and behavioural aggregation
  • Seed questions and expert calibration
  • Heuristics and biases in judgement
  • Eliciting probability distributions
  • Documenting and reviewing an elicitation
  • Expert judgement in catastrophe and climate assessment

The faculty hub.

News and research as they are published, per discipline, with the faculty's other tools.

The newest research, preprints, news and humanitarian reports for Expert judgement and elicitation, each with its source and date, load here. Open the research and news hub

No course yet.

No course has this as its primary discipline yet. It is listed so the gap stays visible.

Courses also taught here and the connected disciplines teach the methods it will build on.

What you can earn here.

  1. Course achievements

    One for each of the 0 courses with this primary discipline, when you pass its assessed activities; 0 can be earned now.

  2. Department: Decision, Behaviour and Communication

    Earn two discipline achievements in the Department of Decision, Behaviour and Communication. In preparation.

Achievements record learning completed here; they do not certify competence. How recognition works.

No ecosystem page yet.

No ecosystem page covers this subject yet. A page has been requested; no loosely related page is cited in its place.

The two Foundry systems where it is practised.

  • Nexus FoundryDSS systemExpert estimates enter decisions as stated distributionsDecisions room
  • Nexus systemPanels of experts deliberate and decide in councilCouncil room

Nexus Foundry system pages describe what each system and its rooms are designed to do; they are not a service on offer, and studying here gives no access to them.

Terms used on this page.

Expert judgement and elicitation

Prepare with a related course.

Open courses in connected disciplines teach the methods this discipline will build on.

Skip to toolbar