Historical run
Overall trajectory · last 28 runs
Provider comparison — Overall score
Same data as the “By provider” table below, visualized. Each bar is the mean Overall score across that provider’s substantive responses (evasive/empty excluded).
Notable changes vs prior run
- GAINaverages_substantive.citation_quality0.0→25.0+25.0
- GAINaverages_substantive.module_recognition25.0→40.0+15.0
- GAINby_category_overall.isl_company45.0→57.2+12.2
- GAINcounts.substantive12.0→24.0+12.0
- GAINcounts.total12.0→24.0+12.0
By provider
Averages across substantive responses for each AI provider. n = executions attempted; n sub = responses that actually answered (evasive/empty/unscorable excluded). Low n sub triggers an amber flag — the average is over too few real responses to trust.
| Provider | n | n sub | Overall | Vis | ModRec | Desc | CompDisp | Citation |
|---|---|---|---|---|---|---|---|---|
anthropic | 12 | 12 | 40.4 | 50.0 | 25.0 | 10.0 | 97.5 | 0.0 |
perplexity | 12 | 12 | 61.0 | 64.2 | 70.0 | 21.7 | 95.0 | 50.0 |
By category
Same averages as 'By provider', but grouped by prompt category instead. Useful for spotting which capability area (e.g., WeatherGuard, ISL company) is scoring strongest across the provider panel.
| Category | n | n sub | Overall | Vis | ModRec | Desc | CompDisp | Citation |
|---|---|---|---|---|---|---|---|---|
isl_company | 12 | 12 | 64.4 | 100.0 | 45.0 | 8.3 | 100.0 | 30.0 |
weatherguard | 12 | 12 | 37.0 | 14.2 | 50.0 | 23.3 | 92.5 | 20.0 |
ISL prominence
- prominent13
- mentioned1
- absent10
Module recognition
- none12
- specific_module_named11
- weatherguard_mentioned_total8
- drx_umbrella_only1
Competitor displacement
iCompetitors tracked: Urbint, Gridware, Space-Time Insight.
- no_competitors21
- competitor_only3
Citations
i“Authoritative” = our 7-domain whitelist, not a broad quality judgement.
- no_citations12
- any_authoritative8
- citations_without_authoritative4
Dimension averages (substantive)
Prompt library used in this run
The exact questions sent to each AI provider. Authoritative source: prompts/*.yaml.
Executions24 of 24
One row per provider × prompt × variant. Click any row to expand the raw response and parsed signals. Scores are for this single execution, not averages.
| Provider | Prompt | Category | Class | Overall | Vis | ModRec | Desc | CompDisp | Citation |
|---|---|---|---|---|---|---|---|---|---|
| perplexity | isl_002/v2 | isl_company | substantive | 82.0 | 100.0 | 100.0 | 20.0 | 100.0 | 60.0 |
| perplexity | isl_002/v3 | isl_company | substantive | 82.0 | 100.0 | 100.0 | 20.0 | 100.0 | 60.0 |
| perplexity | isl_001/v3 | isl_company | substantive | 82.0 | 100.0 | 100.0 | 20.0 | 100.0 | 60.0 |
| perplexity | isl_002/v1 | isl_company | substantive | 82.0 | 100.0 | 100.0 | 20.0 | 100.0 | 60.0 |
| perplexity | wg_002/v1 | weatherguard | substantive | 82.0 | 100.0 | 100.0 | 20.0 | 100.0 | 60.0 |
| perplexity | isl_001/v2 | isl_company | substantive | 78.0 | 100.0 | 100.0 | 0.0 | 100.0 | 60.0 |
| perplexity | wg_002/v3 | weatherguard | substantive | 75.5 | 70.0 | 100.0 | 40.0 | 100.0 | 60.0 |
| perplexity | isl_001/v1 | isl_company | substantive | 67.0 | 100.0 | 40.0 | 20.0 | 100.0 | 60.0 |
| anthropic | isl_002/v1 | isl_company | substantive | 50.0 | 100.0 | 0.0 | 0.0 | 100.0 | 0.0 |
| anthropic | isl_002/v3 | isl_company | substantive | 50.0 | 100.0 | 0.0 | 0.0 | 100.0 | 0.0 |
| anthropic | isl_001/v2 | isl_company | substantive | 50.0 | 100.0 | 0.0 | 0.0 | 100.0 | 0.0 |
| anthropic | isl_002/v2 | isl_company | substantive | 50.0 | 100.0 | 0.0 | 0.0 | 100.0 | 0.0 |
| anthropic | isl_001/v3 | isl_company | substantive | 50.0 | 100.0 | 0.0 | 0.0 | 100.0 | 0.0 |
| anthropic | isl_001/v1 | isl_company | substantive | 50.0 | 100.0 | 0.0 | 0.0 | 100.0 | 0.0 |
| anthropic | wg_002/v3 | weatherguard | substantive | 48.0 | 0.0 | 100.0 | 40.0 | 100.0 | 0.0 |
| anthropic | wg_002/v2 | weatherguard | substantive | 44.0 | 0.0 | 100.0 | 20.0 | 100.0 | 0.0 |
| perplexity | wg_002/v2 | weatherguard | substantive | 41.5 | 0.0 | 100.0 | 0.0 | 100.0 | 30.0 |
| anthropic | wg_002/v1 | weatherguard | substantive | 40.0 | 0.0 | 100.0 | 0.0 | 100.0 | 0.0 |
| perplexity | wg_001/v1 | weatherguard | substantive | 24.5 | 0.0 | 0.0 | 40.0 | 100.0 | 30.0 |
| anthropic | wg_001/v1 | weatherguard | substantive | 23.0 | 0.0 | 0.0 | 40.0 | 100.0 | 0.0 |
| perplexity | wg_001/v2 | weatherguard | substantive | 20.0 | 0.0 | 0.0 | 40.0 | 70.0 | 30.0 |
| perplexity | wg_001/v3 | weatherguard | substantive | 16.0 | 0.0 | 0.0 | 20.0 | 70.0 | 30.0 |
| anthropic | wg_001/v2 | weatherguard | substantive | 15.0 | 0.0 | 0.0 | 0.0 | 100.0 | 0.0 |
| anthropic | wg_001/v3 | weatherguard | substantive | 14.5 | 0.0 | 0.0 | 20.0 | 70.0 | 0.0 |