GLOBAL KNOWLEDGE ARK

Engineering & Technology · Systems Engineering, Integration & Validation

Trade studies, uncertainty and multidisciplinary decisions

A compact pickup station fits the entrance neatly, while a larger version is easier to maintain. Choosing the smallest enclosure alone could create a worse service. A trade study makes the consequential differences and the decision-maker’s priorities visible.

Use the design and measurement chapters for requirement wording, comparisons and evidence. This chapter introduces its systems vocabulary directly; later reliability, control and economics work develops specialised models. NASA guidance supplies general process concepts, not universally applicable industry or certification rules.

Back to the chapter

After reading, you can

Compare multidisciplinary alternatives using explicit feasibility conditions, value assumptions and sensitivity checks.

01

Separate eligibility from preference

State the decision, alternatives, intended service and authority responsible for choosing. An option that fails a required access or performance condition needs resolution before its attractive features can compensate for anything. Keep binding constraints separate from preference scores, and use comparable boundaries and operating assumptions.

A multidisciplinary comparison may involve service, space, maintainability, energy, cost and delivery. Obtain definitions and evidence from the relevant disciplines. A claimed benefit should identify what is supplied, measured, estimated or unknown. Adding a numerical score does not convert an uncertain judgment into a physical measurement.

02

Use a small value model transparently

Our original exercise assumes both options meet every eligibility condition. On a common constructed 0 to 10 value scale, A receives 9 for service and 5 for support; B receives 7 and 8. These invented scores represent declared preferences, not observations or actual products. Assume the two criteria are suitable for a linear weighted combination.

Let service weight w range from 0 to 1 and support weight be 1−w. A scores 9 w+5(1−w)=5+4 w; B scores 7 w+8(1−w)=8−w. At w=.60 they tie at 7.4. Above that weight A leads, while below it B leads. The figure reveals dependence on the priorities rather than hiding them behind a single final number.

A preference model can reverse a rankingOriginal constructed value scores on a shared 0 to 10 scale. A scores 9 for service and 5 for support; B scores 7 and 8. Lines 5+4 w and 8−w intersect at service weight .60 and score 7.4. Rankings reverse across that weight.Original value model · scores supplied, not measured properties5678900.20.40.60.81Service weight w · A solid / B dashedTie at w=0.60; ranking depends on the declared prioritiesValue score
Using supplied comparable value scores, A(w)=9 w+5(1−w)=5+4 w; B(w)=7 w+8(1−w)=8−w. Equality occurs at 5 w=3, orw=.60. A is preferred above.60 and B below.60 within this two-criterion model. No probability or objective universal ranking is implied.
03

Ask what could change the decision

Sensitivity analysis changes an input and examines the result. It can target weights, costs, performance estimates or operating conditions. Scenario ranges need a stated basis and are not automatically probabilities. If a small plausible change reverses the recommendation, further evidence may be valuable; a large numerical lead can still be misleading when the criteria omit a decisive concern.

Check relationships between criteria. Counting both short repair time and the same benefit again as reduced service interruption can overweight one effect. A design change can also alter several quantities together. Preserve the alternatives, rejected constraints, evidence gaps and rationale so that the decision can be revisited when a dependency or stakeholder priority changes.

04

One enclosure change moves several quantities

Use the original weighted-score example as a reminder that stated preferences matter. Now examine a different, constructed station-enclosure choice before assigning any preference score. C is a compact passive enclosure; F adds a fan and a larger service panel. Treat all electrical input as internal heat for this simple account, including F’s extra 6 W. The supplied effective thermal resistance Rθ measures the steady temperature rise per watt leaving the assembly. Thus the reference temperature T is ambient temperature plus P×Rθ. A temperature difference of 1 K is numerically a rise of 1°C. The resistances below are assumptions about complete candidate assemblies, not values inferred merely from the presence of a fan.

The coupling is visible: F consumes more energy and has more planned service events, yet its lower assumed thermal resistance more than offsets the extra heat. The larger service panel also changes footprint and access time. At 30°C ambient, C’s nominal temperature is 30+40×0.60=54°C; its supplied resistance range gives 50–58°C. F’s nominal value is 30+46×0.35=46.1°C, with range 43.8–50.7°C. Over a constant 10 h operating period, their energies are 400 and 460 Wh. A lower temperature does not imply a lower electricity demand.

Impose three teaching constraints: reference temperature at most 55°C over the supplied steady ranges, energy at most 500 Wh per 10 h period, and footprint at most 0.50 m². These are stipulated model requirements, not safety or touch-temperature limits. F meets all three within the supplied bounds. C crosses the temperature limit at its upper bound, so a good maintenance score cannot make it eligible. The steady lumped model omits startup transients and local hot spots; testing the assembled heat path would be necessary before using its resistance range as evidence.

Original enclosure assumptions. Ranges are sensitivity inputs, with no probability or confidence level assigned.
QuantityC: compact/passiveF: enlarged/ventilated
Input power, all charged to heat40 W46 W
Footprint0.35 m²0.45 m²
Effective Rθ: range; nominal0.50–0.70; 0.60 K/W0.30–0.45; 0.35 K/W
Planned service events per month24
Time per planned event: range; nominal30–70; 50 min15–25; 20 min
Coupled enclosure temperature rangesAt ambient 30 degrees Celsius, compact C has a model temperature range 50 to 58 degrees Celsius, crossing the 55 degree model limit at thermal resistance 0.625 kelvin per watt. F ranges 43.8 to 50.7 and stays below the limit.Cooling eligibility depends on a bounded physical estimateOriginal steady model: T = 30°C + P × Rθ; a 55°C model limit40455055600.250.350.450.550.650.7555°C limitC: 40 W, Rθ 0.50–0.70F: 46 W, Rθ 0.30–0.45C threshold 0.625Effective Rθ (K/W); line segments show supplied rangesT (°C); nominal points: C = 54°C (circle), F = 46.1°C (square).
Constructed steady model: C uses P=40 W, Rθ=0.50–0.70 K/W, T=50–58°C; nominal Rθ=0.60 gives 54°C. F uses 46 W, Rθ=0.30–0.45, T=43.8–50.7°C; nominal 0.35 gives 46.1°C. C meets the 55°C model limit only when Rθ≤0.625. Segments show supplied sensitivity ranges, not confidence intervals. No real assembly or safety qualification is claimed.
05

Separate an uncertain estimate from a changed preference

Suppose new assembly evidence could narrow C’s upper thermal resistance to 0.62 K/W. Its worst model temperature would then be 30+40×0.62=54.8°C, making it eligible under these constraints. The decisive threshold is Rθ≤(55−30)/40=0.625 K/W. A measurement that merely repeats the nominal value without bounding the relevant conditions would not resolve the eligibility question. Prioritise evidence about that upper bound before spending effort refining a preference score for an ineligible option.

For eligible candidates, declare this decision rule: choose fewer planned maintenance minutes per month, breaking a tie with lower operating energy. This is a stated priority, not a probability. Monthly planned time is events multiplied by time per event: C has 60–140 min, nominal 100; F has 60–100 min, nominal 80. The nominal values favour F. If representative C tasks instead take 35 min while F tasks take 20, C needs 70 min versus F’s 80 and wins; if C tasks take 55, its 110 min loses. The break-even relation is 2τC=4τF, or τC=2τF. With τF=20 min, the threshold is 40 min per C event.

The decision rule stayed fixed while uncertain physical/task estimates changed the result. This differs from the earlier example where changing the service weight changed a preference. Keep each architecture’s power paired with its own thermal-resistance range, and obtain representative access-task observations if both remain feasible. Do not credit the same reduction in maintenance time twice as independent “availability” and “repair” benefits. The supplied ranges support conditional scenario reasoning; they do not imply how frequently any point occurs.

Find the break-even priority

At w=.80, A=5+4(.80)=8.2 and B=8−.80=7.2. At w=.40, A=6.6 and B=7.6. Solving 5+4 w=8−w gives w=.60. The arithmetic supports conditional rankings under the supplied scale and combination rule.

If the support score for A is poorly known, the apparent crossover is itself uncertain. Before commissioning a study, identify which observation could change the actual decision: for example, a representative maintenance task might clarify a key estimate. It would not establish every other property of the station or determine how much the stakeholders should value support.

In the coupled enclosure case, the original C range fails the 55°C model constraint because 30+40×0.70=58°C, while F’s upper value is 30+46×0.45=50.7°C. If suitable evidence narrows C to at most 0.62 K/W, both meet the supplied thermal, energy and footprint limits. The fixed maintenance criterion then compares 2τC against 4τF; at 35 and 20 min, C takes 70 versus 80 min per month. That conditional choice depends first on the thermal bound being supported.

Try the reasoning

  1. Can a high preference score cancel failure of a binding requirement?

    Show the answer and reasoning

    Not within a comparison that treats that requirement as an eligibility condition. Resolve the failure or the requirement through the responsible process.

  2. Does w=.80 mean an 80% chance that service will matter?

    Show the answer and reasoning

    No. It is a preference weight in the stated value model, not a probability.

  3. Why examine double-counting among criteria?

    Show the answer and reasoning

    Duplicated representation of one benefit can distort the declared priorities and ranking.

  4. Ambient temperature rises to 32°C. Under the original ranges, what thermal evidence would C need, and does F remain eligible in this steady model?

    Show the answer and reasoning

    C needs Rθ≤(55−32)/40=0.575 K/W. Its nominal 0.60 would give 56°C and does not meet that condition. F’s worst value is 32+46×0.45=52.7°C, so it remains within the stipulated 55°C model limit. This is an environment/physical-bound change, not a reason to change a preference weight; the other supplied constraints must still be checked.

  5. Keep ambient 30°C and assume supported evidence bounds C at 0.62 K/W. If the 10 h energy cap becomes 430 Wh, which option can meet all three supplied constraints?

    Show the answer and reasoning

    C uses 40×10=400 Wh, has worst model temperature 54.8°C and footprint 0.35 m², so it meets these constraints under the stated bound. F uses 460 Wh and fails the new energy cap even though its temperature is lower. C is the only eligible candidate in this pair; a maintenance preference cannot compensate for F’s binding energy failure.

  6. With both candidates thermally eligible, F tasks take 20 min each, while C tasks might take 35 or 55 min. What observation would discriminate the maintenance decision, and why is a new weighting survey not the first need?

    Show the answer and reasoning

    F requires 4×20=80 min per month. C requires either 2×35=70 or 2×55=110. Under the already declared criterion, the choice flips at C time 40 min per event. Representative planned-task timing for the actual C access layout is discriminating evidence. The uncertainty concerns the task estimate; a weighting survey changes preferences without resolving it.

What to carry forward

Make constraints, evidence, priorities and uncertainty explicit, and use sensitivity to show what the recommendation depends on.

References

Teaching resources and research supporting this lesson’s explanations and examples.

  1. Systems Engineering Handbook §6.8: Decision AnalysisNASAReference guidenasa.govRead source
  2. Framework for Cyber-Physical Systems, Volume 1: Overview, SP1500-201 (2017)Cyber-Physical Systems Public Working Group; published by NISTReference guide · PDFnvlpubs.nist.govRead source
  3. 4.42J Fundamentals of Energy in Buildings: Heat TransferLeon R. Glicksman / MIT OpenCourseWareCourse notes · PDFocw.mit.eduRead source