Overall trajectory · last 67 runs

20261019T120003Z_c6ff5fcompleted_with_errors•Oct 19, 2026, 12:00 PM UTC•198/240 executions · 42 failed•rubric v3
perplexity / sonaropenai / gpt-4o-minianthropic / claude-sonnet-4-6gemini / gemini-2.5-flash
Overall
i
29.7-0.3
weighted mean across 5 dimensions
Visibility
i
14.5-1.9
first-mention position of ISL
Module recognition
i
29.8+1.1
WG/FG named = 100, DRx only = 40
Descriptor match
i
7.8-0.3
rubric vocabulary match, not factual accuracy
Overall mix35Visibility·25Module recognition·20Descriptor match·15Competitor displacement·5Citation quality
Incomplete provider results. anthropic: 18 of 60 executions succeeded (Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits.). These scores cover a partial prompt sample and are not directly comparable with complete providers.

Provider comparison — Overall score

Same data as the “By provider” table below, visualized. Each bar is the mean Overall score across that provider’s substantive responses (evasive/empty excluded).

Partial providers (amber): anthropic 18/60 executions succeeded — averages cover a partial prompt sample and are not directly comparable.

Notable changes vs prior run

  • GAINcitations.no_citations180.0→138.0-42.0
  • MISScounts.substantive240.0→198.0-42.0
  • MISScounts.total240.0→198.0-42.0
  • MISScompetitor_displacement.no_competitors234.0→196.0-38.0
  • GAINisl_prominence.absent200.0→169.0-31.0

By provider

Averages across substantive responses for each AI provider. n = executions that returned a response (failed calls are excluded); n sub = responses that actually answered (evasive/empty/unscorable excluded). PARTIAL marks a provider whose calls failed this run — its averages cover only part of the prompt set. Low n sub triggers an amber flag — the average is over too few real responses to trust.

Providernn subOverallVisModRecDescCompDispCitation
anthropicpartial 18/60
181824.20.033.36.796.70.0
gemini
606026.110.025.07.0100.00.0
openai
606026.810.028.35.9100.00.0
perplexity
606037.827.835.011.0100.042.5

By category

Same averages as 'By provider', but grouped by prompt category instead. Useful for spotting which capability area (e.g., WeatherGuard, ISL company) is scoring strongest across the provider panel.

Categorynn subOverallVisModRecDescCompDispCitation
ev_prophet
484826.510.429.20.0100.011.2
fireguard
424228.54.030.920.098.610.7
isl_company
181857.7100.022.25.6100.020.0
reliability_optimization
363623.60.027.85.0100.014.2
sos
363622.82.825.00.0100.011.7
weatherguard
181838.916.750.024.2100.015.0

ISL prominence

  • prominent28
  • mentioned1
  • absent169

Module recognition

  • none139
  • specific_module_named59
  • fireguard_mentioned_total13
  • weatherguard_mentioned_total11

Competitor displacement

i

Competitors tracked: Urbint, Gridware, Space-Time Insight.

  • no_competitors196
  • competitor_only2

Citations

i

“Authoritative” = our 7-domain whitelist, not a broad quality judgement.

  • no_citations138
  • citations_without_authoritative35
  • any_authoritative25

Dimension averages (substantive)

Visibility14.5
Descriptor match7.8
Module recognition29.8
Competitor displacement99.7
Citation quality12.9

Prompt library used in this run

The exact questions sent to each AI provider. Authoritative source: prompts/*.yaml.

20 prompts · 60 variants
ev_prophet
fireguard
isl_company
reliability_optimization
sos
weatherguard

Executions198 of 198

One row per provider × prompt × variant. Click any row to expand the raw response and parsed signals. Scores are for this single execution, not averages.

ProviderPromptCategoryClassOverallVisModRecDescCompDispCitation
perplexitywg_002/v3weatherguardsubstantive90.0100.0100.060.0100.060.0
perplexityisl_002/v1isl_companysubstantive86.0100.0100.040.0100.060.0
perplexityfg_002/v1fireguardsubstantive82.0100.0100.020.0100.060.0
perplexityisl_001/v3isl_companysubstantive82.0100.0100.020.0100.060.0
perplexityisl_001/v2isl_companysubstantive82.0100.0100.020.0100.060.0
perplexityisl_002/v2isl_companysubstantive82.0100.0100.020.0100.060.0
perplexitywg_002/v1weatherguardsubstantive82.0100.0100.020.0100.060.0
perplexitysos_002/v2sossubstantive78.0100.0100.00.0100.060.0
perplexityevp_003/v3ev_prophetsubstantive78.0100.0100.00.0100.060.0
perplexityevp_001/v1ev_prophetsubstantive78.0100.0100.00.0100.060.0
perplexitywg_002/v2weatherguardsubstantive78.0100.0100.00.0100.060.0
perplexityevp_002/v1ev_prophetsubstantive78.0100.0100.00.0100.060.0
perplexityevp_002/v3ev_prophetsubstantive76.5100.0100.00.0100.030.0
perplexityevp_002/v2ev_prophetsubstantive76.5100.0100.00.0100.030.0
perplexityfg_002/v2fireguardsubstantive70.070.0100.020.0100.030.0
perplexityisl_001/v1isl_companysubstantive53.0100.00.00.0100.060.0
perplexityisl_002/v3isl_companysubstantive53.0100.00.00.0100.060.0
geminiisl_001/v2isl_companysubstantive50.0100.00.00.0100.00.0
geminiisl_002/v3isl_companysubstantive50.0100.00.00.0100.00.0
geminiisl_001/v1isl_companysubstantive50.0100.00.00.0100.00.0
openaiisl_002/v2isl_companysubstantive50.0100.00.00.0100.00.0
geminiisl_002/v2isl_companysubstantive50.0100.00.00.0100.00.0
geminiisl_001/v3isl_companysubstantive50.0100.00.00.0100.00.0
openaiisl_001/v2isl_companysubstantive50.0100.00.00.0100.00.0
openaiisl_001/v1isl_companysubstantive50.0100.00.00.0100.00.0
openaiisl_002/v1isl_companysubstantive50.0100.00.00.0100.00.0
openaiisl_001/v3isl_companysubstantive50.0100.00.00.0100.00.0
geminiisl_002/v1isl_companysubstantive50.0100.00.00.0100.00.0
openaiisl_002/v3isl_companysubstantive50.0100.00.00.0100.00.0
geminiwg_002/v3weatherguardsubstantive48.00.0100.040.0100.00.0
openaiwg_002/v3weatherguardsubstantive48.00.0100.040.0100.00.0
perplexityrel_002/v1reliability_optimizationsubstantive47.00.0100.020.0100.060.0
perplexityfg_002/v3fireguardsubstantive45.50.0100.020.0100.030.0
geminirel_002/v2reliability_optimizationsubstantive44.00.0100.020.0100.00.0
geminifg_002/v2fireguardsubstantive44.00.0100.020.0100.00.0
openaifg_002/v1fireguardsubstantive44.00.0100.020.0100.00.0
openaifg_002/v3fireguardsubstantive44.00.0100.020.0100.00.0
geminifg_002/v3fireguardsubstantive44.00.0100.020.0100.00.0
anthropicfg_002/v2fireguardsubstantive44.00.0100.020.0100.00.0
geminifg_002/v1fireguardsubstantive44.00.0100.020.0100.00.0
anthropicfg_002/v3fireguardsubstantive44.00.0100.020.0100.00.0
geminiwg_002/v1weatherguardsubstantive44.00.0100.020.0100.00.0
openaifg_004/v3fireguardsubstantive44.00.0100.020.0100.00.0
openaifg_002/v2fireguardsubstantive44.00.0100.020.0100.00.0
perplexityrel_002/v2reliability_optimizationsubstantive43.00.0100.00.0100.060.0
perplexitysos_002/v1sossubstantive43.00.0100.00.0100.060.0
perplexityrel_002/v3reliability_optimizationsubstantive41.50.0100.00.0100.030.0
perplexitysos_002/v3sossubstantive41.50.0100.00.0100.030.0
openairel_004/v2reliability_optimizationsubstantive40.00.0100.00.0100.00.0
geminievp_002/v3ev_prophetsubstantive40.00.0100.00.0100.00.0
geminisos_002/v1sossubstantive40.00.0100.00.0100.00.0
openaisos_002/v3sossubstantive40.00.0100.00.0100.00.0
openairel_002/v3reliability_optimizationsubstantive40.00.0100.00.0100.00.0
anthropicevp_002/v1ev_prophetsubstantive40.00.0100.00.0100.00.0
openaievp_002/v2ev_prophetsubstantive40.00.0100.00.0100.00.0
geminievp_002/v2ev_prophetsubstantive40.00.0100.00.0100.00.0
geminiwg_002/v2weatherguardsubstantive40.00.0100.00.0100.00.0
openaiwg_002/v1weatherguardsubstantive40.00.0100.00.0100.00.0
geminirel_002/v1reliability_optimizationsubstantive40.00.0100.00.0100.00.0
openaisos_002/v1sossubstantive40.00.0100.00.0100.00.0
openairel_002/v2reliability_optimizationsubstantive40.00.0100.00.0100.00.0
openaiwg_002/v2weatherguardsubstantive40.00.0100.00.0100.00.0
geminisos_002/v2sossubstantive40.00.0100.00.0100.00.0
openairel_002/v1reliability_optimizationsubstantive40.00.0100.00.0100.00.0
geminirel_002/v3reliability_optimizationsubstantive40.00.0100.00.0100.00.0
openaievp_002/v1ev_prophetsubstantive40.00.0100.00.0100.00.0
openaisos_002/v2sossubstantive40.00.0100.00.0100.00.0
openaievp_002/v3ev_prophetsubstantive40.00.0100.00.0100.00.0
geminisos_002/v3sossubstantive40.00.0100.00.0100.00.0
anthropicevp_002/v3ev_prophetsubstantive40.00.0100.00.0100.00.0
geminievp_002/v1ev_prophetsubstantive40.00.0100.00.0100.00.0
anthropicevp_002/v2ev_prophetsubstantive40.00.0100.00.0100.00.0
anthropicfg_002/v1fireguardsubstantive39.50.0100.020.070.00.0
perplexityrel_001/v3reliability_optimizationsubstantive26.00.00.040.0100.060.0
perplexityfg_004/v3fireguardsubstantive26.00.00.040.0100.060.0
perplexityfg_004/v1fireguardsubstantive24.50.00.040.0100.030.0
perplexitywg_001/v2weatherguardsubstantive24.50.00.040.0100.030.0
perplexitywg_001/v3weatherguardsubstantive24.50.00.040.0100.030.0
perplexitywg_001/v1weatherguardsubstantive24.50.00.040.0100.030.0
geminiwg_001/v1weatherguardsubstantive23.00.00.040.0100.00.0
geminirel_001/v1reliability_optimizationsubstantive23.00.00.040.0100.00.0
perplexityfg_003/v2fireguardsubstantive22.00.00.020.0100.060.0
perplexityrel_001/v1reliability_optimizationsubstantive20.50.00.020.0100.030.0
perplexityfg_003/v3fireguardsubstantive20.50.00.020.0100.030.0
perplexityfg_004/v2fireguardsubstantive20.50.00.020.0100.030.0
perplexityfg_003/v1fireguardsubstantive20.50.00.020.0100.030.0
perplexityfg_001/v1fireguardsubstantive20.50.00.020.0100.030.0
perplexityfg_001/v3fireguardsubstantive20.50.00.020.0100.030.0
perplexityfg_001/v2fireguardsubstantive20.50.00.020.0100.030.0
openaifg_003/v2fireguardsubstantive19.00.00.020.0100.00.0
geminifg_001/v1fireguardsubstantive19.00.00.020.0100.00.0
geminiwg_001/v3weatherguardsubstantive19.00.00.020.0100.00.0
geminifg_003/v3fireguardsubstantive19.00.00.020.0100.00.0
geminifg_004/v1fireguardsubstantive19.00.00.020.0100.00.0
geminiwg_001/v2weatherguardsubstantive19.00.00.020.0100.00.0
geminifg_003/v1fireguardsubstantive19.00.00.020.0100.00.0
geminifg_004/v3fireguardsubstantive19.00.00.020.0100.00.0
openaiwg_001/v2weatherguardsubstantive19.00.00.020.0100.00.0
openaifg_001/v1fireguardsubstantive19.00.00.020.0100.00.0
geminifg_001/v2fireguardsubstantive19.00.00.020.0100.00.0
openaifg_001/v3fireguardsubstantive19.00.00.020.0100.00.0
geminifg_001/v3fireguardsubstantive19.00.00.020.0100.00.0
openairel_001/v1reliability_optimizationsubstantive19.00.00.020.0100.00.0
geminifg_004/v2fireguardsubstantive19.00.00.020.0100.00.0
openaifg_003/v1fireguardsubstantive19.00.00.020.0100.00.0
openaifg_001/v2fireguardsubstantive19.00.00.020.0100.00.0
openaiwg_001/v3weatherguardsubstantive19.00.00.020.0100.00.0
openaifg_004/v1fireguardsubstantive19.00.00.020.0100.00.0
openairel_003/v3reliability_optimizationsubstantive19.00.00.020.0100.00.0
openaifg_003/v3fireguardsubstantive19.00.00.020.0100.00.0
anthropicfg_001/v2fireguardsubstantive19.00.00.020.0100.00.0
anthropicfg_001/v3fireguardsubstantive19.00.00.020.0100.00.0
perplexityrel_003/v1reliability_optimizationsubstantive18.00.00.00.0100.060.0
openaiwg_001/v1weatherguardsubstantive18.00.00.015.0100.00.0
perplexityevp_004/v3ev_prophetsubstantive18.00.00.00.0100.060.0
perplexityevp_003/v2ev_prophetsubstantive18.00.00.00.0100.060.0
perplexityrel_004/v1reliability_optimizationsubstantive18.00.00.00.0100.060.0
perplexityevp_001/v3ev_prophetsubstantive18.00.00.00.0100.060.0
perplexitysos_001/v1sossubstantive16.50.00.00.0100.030.0
perplexitysos_003/v2sossubstantive16.50.00.00.0100.030.0
perplexityevp_003/v1ev_prophetsubstantive16.50.00.00.0100.030.0
perplexityrel_001/v2reliability_optimizationsubstantive16.50.00.00.0100.030.0
perplexitysos_004/v2sossubstantive16.50.00.00.0100.030.0
perplexitysos_003/v1sossubstantive16.50.00.00.0100.030.0
perplexityevp_004/v1ev_prophetsubstantive16.50.00.00.0100.030.0
perplexitysos_003/v3sossubstantive16.50.00.00.0100.030.0
perplexitysos_001/v2sossubstantive16.50.00.00.0100.030.0
perplexitysos_001/v3sossubstantive16.50.00.00.0100.030.0
perplexityrel_003/v2reliability_optimizationsubstantive16.50.00.00.0100.030.0
perplexityevp_001/v2ev_prophetsubstantive16.50.00.00.0100.030.0
perplexityevp_004/v2ev_prophetsubstantive16.50.00.00.0100.030.0
perplexitysos_004/v1sossubstantive16.50.00.00.0100.030.0
perplexitysos_004/v3sossubstantive16.50.00.00.0100.030.0
perplexityrel_004/v2reliability_optimizationsubstantive16.50.00.00.0100.030.0
perplexityrel_004/v3reliability_optimizationsubstantive16.50.00.00.0100.030.0
perplexityrel_003/v3reliability_optimizationsubstantive16.50.00.00.0100.030.0
geminievp_003/v2ev_prophetsubstantive15.00.00.00.0100.00.0
geminievp_003/v3ev_prophetsubstantive15.00.00.00.0100.00.0
geminirel_001/v3reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminievp_003/v1ev_prophetsubstantive15.00.00.00.0100.00.0
geminisos_004/v2sossubstantive15.00.00.00.0100.00.0
anthropicevp_004/v2ev_prophetsubstantive15.00.00.00.0100.00.0
geminisos_004/v3sossubstantive15.00.00.00.0100.00.0
openaievp_003/v1ev_prophetsubstantive15.00.00.00.0100.00.0
openaisos_003/v3sossubstantive15.00.00.00.0100.00.0
openaievp_004/v2ev_prophetsubstantive15.00.00.00.0100.00.0
geminisos_003/v3sossubstantive15.00.00.00.0100.00.0
geminisos_003/v2sossubstantive15.00.00.00.0100.00.0
geminievp_004/v3ev_prophetsubstantive15.00.00.00.0100.00.0
geminirel_003/v3reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminirel_003/v1reliability_optimizationsubstantive15.00.00.00.0100.00.0
anthropicevp_001/v3ev_prophetsubstantive15.00.00.00.0100.00.0
geminifg_003/v2fireguardsubstantive15.00.00.00.0100.00.0
openaisos_001/v3sossubstantive15.00.00.00.0100.00.0
geminirel_004/v3reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminirel_001/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminirel_004/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminisos_001/v1sossubstantive15.00.00.00.0100.00.0
anthropicevp_003/v2ev_prophetsubstantive15.00.00.00.0100.00.0
openairel_003/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
openaievp_003/v2ev_prophetsubstantive15.00.00.00.0100.00.0
geminisos_004/v1sossubstantive15.00.00.00.0100.00.0
geminievp_001/v1ev_prophetsubstantive15.00.00.00.0100.00.0
anthropicevp_004/v1ev_prophetsubstantive15.00.00.00.0100.00.0
openaisos_004/v1sossubstantive15.00.00.00.0100.00.0
openairel_003/v1reliability_optimizationsubstantive15.00.00.00.0100.00.0
openaifg_004/v2fireguardsubstantive15.00.00.00.0100.00.0
anthropicevp_003/v1ev_prophetsubstantive15.00.00.00.0100.00.0
openaievp_001/v2ev_prophetsubstantive15.00.00.00.0100.00.0
geminievp_001/v3ev_prophetsubstantive15.00.00.00.0100.00.0
anthropicevp_004/v3ev_prophetsubstantive15.00.00.00.0100.00.0
openaievp_003/v3ev_prophetsubstantive15.00.00.00.0100.00.0
openairel_001/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
anthropicevp_001/v1ev_prophetsubstantive15.00.00.00.0100.00.0
anthropicevp_001/v2ev_prophetsubstantive15.00.00.00.0100.00.0
openairel_001/v3reliability_optimizationsubstantive15.00.00.00.0100.00.0
openaisos_003/v2sossubstantive15.00.00.00.0100.00.0
geminirel_004/v1reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminirel_003/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
openaievp_004/v1ev_prophetsubstantive15.00.00.00.0100.00.0
geminievp_001/v2ev_prophetsubstantive15.00.00.00.0100.00.0
openairel_004/v1reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminievp_004/v2ev_prophetsubstantive15.00.00.00.0100.00.0
openaievp_001/v3ev_prophetsubstantive15.00.00.00.0100.00.0
geminisos_003/v1sossubstantive15.00.00.00.0100.00.0
openaievp_001/v1ev_prophetsubstantive15.00.00.00.0100.00.0
anthropicevp_003/v3ev_prophetsubstantive15.00.00.00.0100.00.0
geminisos_001/v2sossubstantive15.00.00.00.0100.00.0
openaisos_003/v1sossubstantive15.00.00.00.0100.00.0
openaisos_004/v3sossubstantive15.00.00.00.0100.00.0
geminievp_004/v1ev_prophetsubstantive15.00.00.00.0100.00.0
openaievp_004/v3ev_prophetsubstantive15.00.00.00.0100.00.0
geminisos_001/v3sossubstantive15.00.00.00.0100.00.0
openairel_004/v3reliability_optimizationsubstantive15.00.00.00.0100.00.0
openaisos_004/v2sossubstantive15.00.00.00.0100.00.0
openaisos_001/v1sossubstantive15.00.00.00.0100.00.0
openaisos_001/v2sossubstantive15.00.00.00.0100.00.0
anthropicfg_001/v1fireguardsubstantive14.50.00.020.070.00.0