Latest run
Run summary
Overall trajectory · last 9 runs
20260421T190515Z_8222becompleted_with_errors•Apr 21, 2026, 07:05 PM UTC•41/48 executions · 7 failed•rubric v2
perplexity / sonaropenai / gpt-4o-minianthropic / claude-sonnet-4-6gemini / gemini-2.5-flash
Overall
41.8+4.5
weighted across dimensions
Visibility
54.6-0.9
ISL present & prominent
Module rec
33.2+10.9
WG/FG specifically named
Accuracy
15.1+4.0
rubric descriptor match
Provider comparison
Substantive-only averages per provider
Notable changes vs prior run
- GAINcounts.substantive9.0→41.0+32.0
- GAINcounts.total9.0→41.0+32.0
- GAINcompetitor_displacement.no_competitors9.0→39.0+30.0
- MISScitations.no_citations9.0→29.0+20.0
- MISSmodule_recognition.none7.0→25.0+18.0
By provider
| Provider | n | Overall | Visibility | Accuracy | Module | Competitor | Citation |
|---|---|---|---|---|---|---|---|
| anthropic | 12 | 35.8 | 50.0 | 11.7 | 25.0 | 97.5 | 0.0 |
| gemini | 5 | 39.2 | 60.0 | 16.0 | 20.0 | 100.0 | 0.0 |
| openai | 12 | 35.4 | 50.0 | 8.3 | 25.0 | 100.0 | 0.0 |
| perplexity | 12 | 55.1 | 61.7 | 25.0 | 55.0 | 97.5 | 50.0 |
By category
| Category | n | Overall | Visibility | Accuracy | Module | Competitor | Citation |
|---|---|---|---|---|---|---|---|
| isl_company | 21 | 51.5 | 98.6 | 4.8 | 17.1 | 100.0 | 17.1 |
| weatherguard | 20 | 31.6 | 8.5 | 26.0 | 50.0 | 97.0 | 12.0 |
ISL prominence
- prominent21
- mentioned1
- unclear1
- absent18
Module recognition
- none25
- specific_module_named12
- weatherguard_mentioned_total12
- drx_umbrella_only4
Competitor displacement
- no_competitors39
- competitor_only2
Citations
- no_citations29
- any_authoritative8
- citations_without_authoritative4
Dimension averages (substantive)
Visibility54.6
Accuracy15.1
Module recognition33.2
Competitor overlap98.5
Citation quality14.6
Executions41 of 41
| Provider | Prompt | Category | Class | Overall | Vis | Acc | ModRec | Citation |
|---|---|---|---|---|---|---|---|---|
| perplexity | isl_002/v1 | isl_company | substantive | 80.0 | 100.0 | 20.0 | 100.0 | 60.0 |
| perplexity | wg_002/v1 | weatherguard | substantive | 80.0 | 100.0 | 20.0 | 100.0 | 60.0 |
| perplexity | isl_002/v3 | isl_company | substantive | 80.0 | 100.0 | 20.0 | 100.0 | 60.0 |
| perplexity | wg_002/v3 | weatherguard | substantive | 77.5 | 70.0 | 60.0 | 100.0 | 60.0 |
| perplexity | isl_002/v2 | isl_company | substantive | 65.0 | 100.0 | 20.0 | 40.0 | 60.0 |
| perplexity | isl_001/v3 | isl_company | substantive | 65.0 | 100.0 | 20.0 | 40.0 | 60.0 |
| perplexity | isl_001/v2 | isl_company | substantive | 61.0 | 100.0 | 0.0 | 40.0 | 60.0 |
| perplexity | isl_001/v1 | isl_company | substantive | 54.5 | 70.0 | 20.0 | 40.0 | 60.0 |
| gemini | wg_002/v2 | weatherguard | substantive | 47.0 | 0.0 | 60.0 | 100.0 | 0.0 |
| openai | isl_002/v1 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| gemini | isl_002/v3 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| openai | isl_001/v3 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| anthropic | isl_002/v2 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| openai | isl_001/v2 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| openai | isl_001/v1 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| anthropic | isl_002/v3 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| anthropic | isl_002/v1 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| openai | isl_002/v3 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| anthropic | isl_001/v3 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| anthropic | isl_001/v2 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| anthropic | isl_001/v1 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| gemini | isl_001/v3 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| gemini | isl_002/v2 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| openai | isl_002/v2 | isl_company | substantive | 45.0 | 100.0 | 0.0 | 0.0 | 0.0 |
| openai | wg_002/v3 | weatherguard | substantive | 43.0 | 0.0 | 40.0 | 100.0 | 0.0 |
| anthropic | wg_002/v3 | weatherguard | substantive | 43.0 | 0.0 | 40.0 | 100.0 | 0.0 |
| anthropic | wg_002/v2 | weatherguard | substantive | 39.0 | 0.0 | 20.0 | 100.0 | 0.0 |
| perplexity | wg_002/v2 | weatherguard | substantive | 38.0 | 0.0 | 0.0 | 100.0 | 30.0 |
| openai | wg_002/v1 | weatherguard | substantive | 35.0 | 0.0 | 0.0 | 100.0 | 0.0 |
| openai | wg_002/v2 | weatherguard | substantive | 35.0 | 0.0 | 0.0 | 100.0 | 0.0 |
| anthropic | wg_002/v1 | weatherguard | substantive | 35.0 | 0.0 | 0.0 | 100.0 | 0.0 |
| perplexity | wg_001/v1 | weatherguard | substantive | 29.0 | 0.0 | 80.0 | 0.0 | 30.0 |
| openai | wg_001/v1 | weatherguard | substantive | 18.0 | 0.0 | 40.0 | 0.0 | 0.0 |
| perplexity | wg_001/v2 | weatherguard | substantive | 17.0 | 0.0 | 20.0 | 0.0 | 30.0 |
| anthropic | wg_001/v1 | weatherguard | substantive | 15.0 | 0.0 | 40.0 | 0.0 | 0.0 |
| anthropic | wg_001/v2 | weatherguard | substantive | 14.0 | 0.0 | 20.0 | 0.0 | 0.0 |
| openai | wg_001/v3 | weatherguard | substantive | 14.0 | 0.0 | 20.0 | 0.0 | 0.0 |
| gemini | wg_001/v3 | weatherguard | substantive | 14.0 | 0.0 | 20.0 | 0.0 | 0.0 |
| anthropic | wg_001/v3 | weatherguard | substantive | 14.0 | 0.0 | 20.0 | 0.0 | 0.0 |
| perplexity | wg_001/v3 | weatherguard | substantive | 14.0 | 0.0 | 20.0 | 0.0 | 30.0 |
| openai | wg_001/v2 | weatherguard | substantive | 10.0 | 0.0 | 0.0 | 0.0 | 0.0 |