Home / Pillars / Pillar 6
Pillar 6

How We Evaluate (Methodology)

A conservative approach to evaluation that prioritizes failure behavior, human factors, and ethical consequence over outcome.

Scope and Limits

Methodology exists to preserve judgment. It does not exist to create certainty, accelerate purchasing, or turn field risk into a checklist.

We evaluate in context. When context changes, conclusions may change. When uncertainty is material, we state it.

What We Measure

  • Failure behavior (how it fails, how it announces failure, and whether it creates cascading risk).
  • Human factors (simplicity under stress, error tolerance, and maintenance burden).
  • Durability and repairability over novelty.
  • Ethical margin (whether capability encourages marginal decisions).
  • Accountability (traceable claims, documentation, and transparent limits).

How We Evaluate

We prefer slow observation over single-event impressions. We look for repeatable patterns, not anecdotes.

  • Define the intended environment and constraints before measuring outcomes.
  • Identify plausible failure modes and how they present in the field.
  • Track maintenance requirements and the cost of neglect.
  • Record what changed judgment, and what did not.
  • Publish limits alongside findings.

What Approval Means

Approval is contextual, scarce, and revocable. It is not a general recommendation. It does not transfer across use cases.

When approval is not justified, we say so. Non-approval is normal.

Independence and Conflicts

Commercial incentives distort judgment. We do not publish sponsored content or affiliate-driven recommendations. Material connections are disclosed. When a conflict is meaningful, we recuse or publish with explicit limits.