Overall trajectory · last 28 runs

20260605T162027Z_769d69completedJun 5, 2026, 04:20 PM UTC240/240 executionsrubric v3
perplexity / sonaropenai / gpt-4o-minianthropic / claude-sonnet-4-6gemini / gemini-2.5-flash
Overall
i
28.2+0.2
weighted mean across 5 dimensions
Visibility
i
12.3+0.6
first-mention position of ISL
Module recognition
i
27.2+0.1
WG/FG named = 100, DRx only = 40
Descriptor match
i
8.2-0.1
rubric vocabulary match, not factual accuracy
Overall mix35Visibility·25Module recognition·20Descriptor match·15Competitor displacement·5Citation quality

Provider comparison — Overall score

Same data as the “By provider” table below, visualized. Each bar is the mean Overall score across that provider’s substantive responses (evasive/empty excluded).

Notable changes vs prior run

  • GAINcounts.with_ambiguous_parser_flags10.05.0-5.0
  • MISScitations.no_citations176.0180.0+4.0
  • GAINcompetitor_displacement.no_competitors233.0237.0+4.0
  • GAINcounts.substantive236.0240.0+4.0
  • GAINcounts.total236.0240.0+4.0

By provider

Averages across substantive responses for each AI provider. n = executions attempted; n sub = responses that actually answered (evasive/empty/unscorable excluded). Low n sub triggers an amber flag — the average is over too few real responses to trust.

Providernn subOverallVisModRecDescCompDispCitation
anthropic
606026.110.025.08.398.00.0
gemini
606026.310.025.07.7100.00.0
openai
606025.910.025.05.7100.00.0
perplexity
606034.519.033.711.0100.044.5

By category

Same averages as 'By provider', but grouped by prompt category instead. Useful for spotting which capability area (e.g., WeatherGuard, ISL company) is scoring strongest across the provider panel.

Categorynn subOverallVisModRecDescCompDispCitation
ev_prophet
484822.52.125.00.4100.08.8
fireguard
484825.50.025.020.097.511.9
isl_company
242455.998.817.55.8100.015.0
reliability_optimization
484825.04.227.15.8100.011.2
sos
484823.13.525.00.0100.011.9
weatherguard
242434.14.250.023.3100.08.8

ISL prominence

  • prominent28
  • mentioned1
  • unclear1
  • absent210

Module recognition

  • none173
  • specific_module_named64
  • weatherguard_mentioned_total15
  • fireguard_mentioned_total12
  • drx_umbrella_only3

Competitor displacement

i

Competitors tracked: Urbint, Gridware, Space-Time Insight.

  • no_competitors237
  • competitor_only3

Citations

i

“Authoritative” = our 7-domain whitelist, not a broad quality judgement.

  • no_citations180
  • citations_without_authoritative31
  • any_authoritative29

Dimension averages (substantive)

Visibility12.2
Descriptor match8.2
Module recognition27.2
Competitor displacement99.5
Citation quality11.1

Prompt library used in this run

The exact questions sent to each AI provider. Authoritative source: prompts/*.yaml.

20 prompts · 60 variants
ev_prophet
fireguard
isl_company
reliability_optimization
sos
weatherguard

Executions240 of 240

One row per provider × prompt × variant. Click any row to expand the raw response and parsed signals. Scores are for this single execution, not averages.

ProviderPromptCategoryClassOverallVisModRecDescCompDispCitation
perplexityrel_002/v2reliability_optimizationsubstantive86.0100.0100.040.0100.060.0
perplexitywg_002/v3weatherguardsubstantive86.0100.0100.040.0100.060.0
perplexityisl_002/v2isl_companysubstantive82.0100.0100.020.0100.060.0
perplexityisl_002/v1isl_companysubstantive82.0100.0100.020.0100.060.0
perplexitysos_002/v2sossubstantive78.0100.0100.00.0100.060.0
perplexityrel_004/v2reliability_optimizationsubstantive78.0100.0100.00.0100.060.0
perplexityisl_002/v3isl_companysubstantive78.0100.0100.00.0100.060.0
perplexityevp_002/v1ev_prophetsubstantive78.0100.0100.00.0100.060.0
perplexitysos_002/v1sossubstantive67.570.0100.00.0100.060.0
perplexityisl_001/v1isl_companysubstantive67.0100.040.020.0100.060.0
perplexityisl_001/v2isl_companysubstantive67.0100.040.020.0100.060.0
geminiisl_002/v1isl_companysubstantive58.0100.00.040.0100.00.0
perplexityisl_001/v3isl_companysubstantive56.570.040.020.0100.060.0
openaiisl_001/v1isl_companysubstantive50.0100.00.00.0100.00.0
anthropicisl_002/v3isl_companysubstantive50.0100.00.00.0100.00.0
anthropicisl_002/v1isl_companysubstantive50.0100.00.00.0100.00.0
anthropicisl_001/v3isl_companysubstantive50.0100.00.00.0100.00.0
openaiisl_002/v3isl_companysubstantive50.0100.00.00.0100.00.0
openaiisl_002/v2isl_companysubstantive50.0100.00.00.0100.00.0
geminiisl_002/v2isl_companysubstantive50.0100.00.00.0100.00.0
anthropicisl_002/v2isl_companysubstantive50.0100.00.00.0100.00.0
geminiisl_002/v3isl_companysubstantive50.0100.00.00.0100.00.0
openaiisl_002/v1isl_companysubstantive50.0100.00.00.0100.00.0
geminiisl_001/v3isl_companysubstantive50.0100.00.00.0100.00.0
geminiisl_001/v1isl_companysubstantive50.0100.00.00.0100.00.0
anthropicisl_001/v2isl_companysubstantive50.0100.00.00.0100.00.0
anthropicisl_001/v1isl_companysubstantive50.0100.00.00.0100.00.0
openaiisl_001/v2isl_companysubstantive50.0100.00.00.0100.00.0
geminiisl_001/v2isl_companysubstantive50.0100.00.00.0100.00.0
openaiisl_001/v3isl_companysubstantive50.0100.00.00.0100.00.0
openaiwg_002/v3weatherguardsubstantive48.00.0100.040.0100.00.0
geminiwg_002/v3weatherguardsubstantive48.00.0100.040.0100.00.0
anthropicwg_002/v3weatherguardsubstantive48.00.0100.040.0100.00.0
perplexityfg_002/v3fireguardsubstantive47.00.0100.020.0100.060.0
perplexityfg_002/v1fireguardsubstantive45.50.0100.020.0100.030.0
perplexityfg_002/v2fireguardsubstantive45.50.0100.020.0100.030.0
openaifg_002/v2fireguardsubstantive44.00.0100.020.0100.00.0
geminifg_002/v2fireguardsubstantive44.00.0100.020.0100.00.0
anthropicfg_002/v1fireguardsubstantive44.00.0100.020.0100.00.0
geminifg_002/v3fireguardsubstantive44.00.0100.020.0100.00.0
geminifg_002/v1fireguardsubstantive44.00.0100.020.0100.00.0
anthropicfg_002/v3fireguardsubstantive44.00.0100.020.0100.00.0
anthropicrel_002/v2reliability_optimizationsubstantive44.00.0100.020.0100.00.0
openaifg_002/v3fireguardsubstantive44.00.0100.020.0100.00.0
anthropicfg_002/v2fireguardsubstantive44.00.0100.020.0100.00.0
geminiwg_002/v2weatherguardsubstantive44.00.0100.020.0100.00.0
perplexityrel_002/v1reliability_optimizationsubstantive43.00.0100.00.0100.060.0
perplexityevp_002/v3ev_prophetsubstantive41.50.0100.00.0100.030.0
perplexitywg_002/v2weatherguardsubstantive41.50.0100.00.0100.030.0
perplexityevp_002/v2ev_prophetsubstantive41.50.0100.00.0100.030.0
perplexitysos_002/v3sossubstantive41.50.0100.00.0100.030.0
perplexityrel_002/v3reliability_optimizationsubstantive41.50.0100.00.0100.030.0
perplexitywg_002/v1weatherguardsubstantive41.50.0100.00.0100.030.0
openairel_002/v2reliability_optimizationsubstantive40.00.0100.00.0100.00.0
openaisos_002/v2sossubstantive40.00.0100.00.0100.00.0
anthropicrel_002/v3reliability_optimizationsubstantive40.00.0100.00.0100.00.0
anthropicwg_002/v2weatherguardsubstantive40.00.0100.00.0100.00.0
openaiwg_002/v2weatherguardsubstantive40.00.0100.00.0100.00.0
geminirel_002/v1reliability_optimizationsubstantive40.00.0100.00.0100.00.0
openaisos_002/v3sossubstantive40.00.0100.00.0100.00.0
openaifg_002/v1fireguardsubstantive40.00.0100.00.0100.00.0
openaievp_002/v3ev_prophetsubstantive40.00.0100.00.0100.00.0
anthropicrel_002/v1reliability_optimizationsubstantive40.00.0100.00.0100.00.0
geminisos_002/v3sossubstantive40.00.0100.00.0100.00.0
geminirel_002/v2reliability_optimizationsubstantive40.00.0100.00.0100.00.0
anthropicsos_002/v2sossubstantive40.00.0100.00.0100.00.0
geminievp_002/v1ev_prophetsubstantive40.00.0100.00.0100.00.0
geminisos_002/v2sossubstantive40.00.0100.00.0100.00.0
anthropicwg_002/v1weatherguardsubstantive40.00.0100.00.0100.00.0
geminisos_002/v1sossubstantive40.00.0100.00.0100.00.0
openaiwg_002/v1weatherguardsubstantive40.00.0100.00.0100.00.0
geminiwg_002/v1weatherguardsubstantive40.00.0100.00.0100.00.0
openaisos_002/v1sossubstantive40.00.0100.00.0100.00.0
anthropicsos_002/v3sossubstantive40.00.0100.00.0100.00.0
anthropicevp_002/v1ev_prophetsubstantive40.00.0100.00.0100.00.0
geminirel_002/v3reliability_optimizationsubstantive40.00.0100.00.0100.00.0
openairel_002/v1reliability_optimizationsubstantive40.00.0100.00.0100.00.0
geminievp_002/v2ev_prophetsubstantive40.00.0100.00.0100.00.0
openaievp_002/v1ev_prophetsubstantive40.00.0100.00.0100.00.0
anthropicevp_002/v3ev_prophetsubstantive40.00.0100.00.0100.00.0
anthropicsos_002/v1sossubstantive40.00.0100.00.0100.00.0
openairel_002/v3reliability_optimizationsubstantive40.00.0100.00.0100.00.0
openaievp_002/v2ev_prophetsubstantive40.00.0100.00.0100.00.0
anthropicevp_002/v2ev_prophetsubstantive40.00.0100.00.0100.00.0
geminievp_002/v3ev_prophetsubstantive40.00.0100.00.0100.00.0
geminiwg_001/v1weatherguardsubstantive27.00.00.060.0100.00.0
perplexityfg_001/v1fireguardsubstantive26.00.00.040.0100.060.0
perplexitywg_001/v1weatherguardsubstantive24.50.00.040.0100.030.0
perplexitywg_001/v3weatherguardsubstantive24.50.00.040.0100.030.0
perplexitywg_001/v2weatherguardsubstantive24.50.00.040.0100.030.0
perplexityfg_003/v1fireguardsubstantive24.50.00.040.0100.030.0
anthropicwg_001/v1weatherguardsubstantive23.00.00.040.0100.00.0
openaiwg_001/v1weatherguardsubstantive23.00.00.040.0100.00.0
perplexityfg_004/v1fireguardsubstantive22.00.00.020.0100.060.0
perplexityfg_001/v3fireguardsubstantive22.00.00.020.0100.060.0
perplexityfg_003/v2fireguardsubstantive22.00.00.020.0100.060.0
perplexityrel_001/v1reliability_optimizationsubstantive22.00.00.020.0100.060.0
perplexityfg_001/v2fireguardsubstantive22.00.00.020.0100.060.0
perplexityrel_003/v1reliability_optimizationsubstantive22.00.00.020.0100.060.0
perplexityfg_004/v3fireguardsubstantive22.00.00.020.0100.060.0
perplexityrel_001/v3reliability_optimizationsubstantive20.50.00.020.0100.030.0
perplexityfg_003/v3fireguardsubstantive20.50.00.020.0100.030.0
perplexityrel_003/v2reliability_optimizationsubstantive20.50.00.020.0100.030.0
perplexityfg_004/v2fireguardsubstantive20.50.00.020.0100.030.0
openaifg_004/v1fireguardsubstantive19.00.00.020.0100.00.0
anthropicrel_001/v1reliability_optimizationsubstantive19.00.00.020.0100.00.0
openaifg_003/v1fireguardsubstantive19.00.00.020.0100.00.0
anthropicfg_001/v3fireguardsubstantive19.00.00.020.0100.00.0
geminifg_003/v2fireguardsubstantive19.00.00.020.0100.00.0
openaiwg_001/v3weatherguardsubstantive19.00.00.020.0100.00.0
openaiwg_001/v2weatherguardsubstantive19.00.00.020.0100.00.0
geminifg_001/v1fireguardsubstantive19.00.00.020.0100.00.0
geminiwg_001/v2weatherguardsubstantive19.00.00.020.0100.00.0
openaifg_001/v2fireguardsubstantive19.00.00.020.0100.00.0
anthropicrel_004/v1reliability_optimizationsubstantive19.00.00.020.0100.00.0
openaifg_001/v1fireguardsubstantive19.00.00.020.0100.00.0
anthropicfg_003/v3fireguardsubstantive19.00.00.020.0100.00.0
geminifg_003/v3fireguardsubstantive19.00.00.020.0100.00.0
anthropicevp_004/v1ev_prophetsubstantive19.00.00.020.0100.00.0
anthropicfg_004/v2fireguardsubstantive19.00.00.020.0100.00.0
anthropicrel_004/v3reliability_optimizationsubstantive19.00.00.020.0100.00.0
anthropicfg_003/v1fireguardsubstantive19.00.00.020.0100.00.0
anthropicfg_003/v2fireguardsubstantive19.00.00.020.0100.00.0
geminiwg_001/v3weatherguardsubstantive19.00.00.020.0100.00.0
anthropicwg_001/v2weatherguardsubstantive19.00.00.020.0100.00.0
anthropicrel_003/v3reliability_optimizationsubstantive19.00.00.020.0100.00.0
openairel_001/v1reliability_optimizationsubstantive19.00.00.020.0100.00.0
geminifg_001/v2fireguardsubstantive19.00.00.020.0100.00.0
geminifg_003/v1fireguardsubstantive19.00.00.020.0100.00.0
openaifg_001/v3fireguardsubstantive19.00.00.020.0100.00.0
openaifg_003/v2fireguardsubstantive19.00.00.020.0100.00.0
anthropicfg_004/v3fireguardsubstantive19.00.00.020.0100.00.0
geminirel_001/v1reliability_optimizationsubstantive19.00.00.020.0100.00.0
anthropicwg_001/v3weatherguardsubstantive19.00.00.020.0100.00.0
geminifg_001/v3fireguardsubstantive19.00.00.020.0100.00.0
geminifg_004/v2fireguardsubstantive19.00.00.020.0100.00.0
geminifg_004/v3fireguardsubstantive19.00.00.020.0100.00.0
openaifg_004/v3fireguardsubstantive19.00.00.020.0100.00.0
openaifg_003/v3fireguardsubstantive19.00.00.020.0100.00.0
geminifg_004/v1fireguardsubstantive19.00.00.020.0100.00.0
anthropicrel_001/v3reliability_optimizationsubstantive19.00.00.020.0100.00.0
perplexitysos_003/v1sossubstantive18.00.00.00.0100.060.0
perplexitysos_004/v2sossubstantive18.00.00.00.0100.060.0
perplexityrel_004/v1reliability_optimizationsubstantive18.00.00.00.0100.060.0
perplexityevp_003/v1ev_prophetsubstantive18.00.00.00.0100.060.0
perplexitysos_001/v3sossubstantive18.00.00.00.0100.060.0
perplexitysos_004/v1sossubstantive18.00.00.00.0100.060.0
perplexitysos_001/v1sossubstantive18.00.00.00.0100.060.0
perplexityrel_004/v3reliability_optimizationsubstantive16.50.00.00.0100.030.0
perplexitysos_001/v2sossubstantive16.50.00.00.0100.030.0
perplexityrel_003/v3reliability_optimizationsubstantive16.50.00.00.0100.030.0
perplexitysos_003/v2sossubstantive16.50.00.00.0100.030.0
perplexityevp_004/v2ev_prophetsubstantive16.50.00.00.0100.030.0
perplexityevp_003/v3ev_prophetsubstantive16.50.00.00.0100.030.0
perplexityevp_001/v2ev_prophetsubstantive16.50.00.00.0100.030.0
perplexityevp_004/v1ev_prophetsubstantive16.50.00.00.0100.030.0
perplexitysos_003/v3sossubstantive16.50.00.00.0100.030.0
perplexityevp_004/v3ev_prophetsubstantive16.50.00.00.0100.030.0
perplexityevp_001/v1ev_prophetsubstantive16.50.00.00.0100.030.0
perplexitysos_004/v3sossubstantive16.50.00.00.0100.030.0
perplexityevp_001/v3ev_prophetsubstantive16.50.00.00.0100.030.0
perplexityrel_001/v2reliability_optimizationsubstantive16.50.00.00.0100.030.0
perplexityevp_003/v2ev_prophetsubstantive16.50.00.00.0100.030.0
openaisos_001/v3sossubstantive15.00.00.00.0100.00.0
geminievp_004/v3ev_prophetsubstantive15.00.00.00.0100.00.0
geminievp_003/v1ev_prophetsubstantive15.00.00.00.0100.00.0
geminievp_001/v2ev_prophetsubstantive15.00.00.00.0100.00.0
geminirel_001/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminirel_004/v3reliability_optimizationsubstantive15.00.00.00.0100.00.0
openaievp_003/v1ev_prophetsubstantive15.00.00.00.0100.00.0
openaisos_003/v2sossubstantive15.00.00.00.0100.00.0
openairel_001/v3reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminievp_001/v3ev_prophetsubstantive15.00.00.00.0100.00.0
openairel_004/v3reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminisos_003/v3sossubstantive15.00.00.00.0100.00.0
anthropicsos_003/v1sossubstantive15.00.00.00.0100.00.0
anthropicrel_004/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
openaifg_004/v2fireguardsubstantive15.00.00.00.0100.00.0
openaisos_001/v1sossubstantive15.00.00.00.0100.00.0
geminievp_004/v2ev_prophetsubstantive15.00.00.00.0100.00.0
anthropicevp_001/v2ev_prophetsubstantive15.00.00.00.0100.00.0
openairel_003/v3reliability_optimizationsubstantive15.00.00.00.0100.00.0
openaievp_003/v3ev_prophetsubstantive15.00.00.00.0100.00.0
anthropicrel_003/v1reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminievp_003/v2ev_prophetsubstantive15.00.00.00.0100.00.0
openairel_003/v1reliability_optimizationsubstantive15.00.00.00.0100.00.0
anthropicevp_003/v1ev_prophetsubstantive15.00.00.00.0100.00.0
anthropicsos_004/v2sossubstantive15.00.00.00.0100.00.0
geminisos_001/v1sossubstantive15.00.00.00.0100.00.0
geminisos_004/v2sossubstantive15.00.00.00.0100.00.0
anthropicsos_001/v3sossubstantive15.00.00.00.0100.00.0
openaisos_004/v2sossubstantive15.00.00.00.0100.00.0
openairel_003/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
anthropicsos_003/v2sossubstantive15.00.00.00.0100.00.0
openaievp_004/v3ev_prophetsubstantive15.00.00.00.0100.00.0
openairel_004/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
anthropicevp_001/v1ev_prophetsubstantive15.00.00.00.0100.00.0
geminirel_004/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminisos_001/v3sossubstantive15.00.00.00.0100.00.0
geminisos_004/v1sossubstantive15.00.00.00.0100.00.0
anthropicrel_003/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminisos_004/v3sossubstantive15.00.00.00.0100.00.0
geminirel_003/v1reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminirel_001/v3reliability_optimizationsubstantive15.00.00.00.0100.00.0
geminirel_003/v3reliability_optimizationsubstantive15.00.00.00.0100.00.0
openaievp_004/v1ev_prophetsubstantive15.00.00.00.0100.00.0
anthropicrel_001/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
anthropicsos_004/v3sossubstantive15.00.00.00.0100.00.0
openairel_004/v1reliability_optimizationsubstantive15.00.00.00.0100.00.0
anthropicevp_003/v3ev_prophetsubstantive15.00.00.00.0100.00.0
openaisos_001/v2sossubstantive15.00.00.00.0100.00.0
geminievp_001/v1ev_prophetsubstantive15.00.00.00.0100.00.0
openaisos_004/v1sossubstantive15.00.00.00.0100.00.0
anthropicevp_004/v2ev_prophetsubstantive15.00.00.00.0100.00.0
openaievp_004/v2ev_prophetsubstantive15.00.00.00.0100.00.0
openaisos_003/v3sossubstantive15.00.00.00.0100.00.0
openaievp_001/v1ev_prophetsubstantive15.00.00.00.0100.00.0
openaisos_003/v1sossubstantive15.00.00.00.0100.00.0
openaisos_004/v3sossubstantive15.00.00.00.0100.00.0
anthropicsos_001/v1sossubstantive15.00.00.00.0100.00.0
geminirel_004/v1reliability_optimizationsubstantive15.00.00.00.0100.00.0
anthropicevp_001/v3ev_prophetsubstantive15.00.00.00.0100.00.0
openaievp_001/v3ev_prophetsubstantive15.00.00.00.0100.00.0
geminisos_001/v2sossubstantive15.00.00.00.0100.00.0
openairel_001/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
anthropicsos_001/v2sossubstantive15.00.00.00.0100.00.0
anthropicevp_003/v2ev_prophetsubstantive15.00.00.00.0100.00.0
geminievp_004/v1ev_prophetsubstantive15.00.00.00.0100.00.0
geminisos_003/v1sossubstantive15.00.00.00.0100.00.0
anthropicsos_004/v1sossubstantive15.00.00.00.0100.00.0
geminievp_003/v3ev_prophetsubstantive15.00.00.00.0100.00.0
anthropicevp_004/v3ev_prophetsubstantive15.00.00.00.0100.00.0
anthropicsos_003/v3sossubstantive15.00.00.00.0100.00.0
openaievp_003/v2ev_prophetsubstantive15.00.00.00.0100.00.0
geminisos_003/v2sossubstantive15.00.00.00.0100.00.0
openaievp_001/v2ev_prophetsubstantive15.00.00.00.0100.00.0
geminirel_003/v2reliability_optimizationsubstantive15.00.00.00.0100.00.0
anthropicfg_004/v1fireguardsubstantive14.50.00.020.070.00.0
anthropicfg_001/v1fireguardsubstantive14.50.00.020.070.00.0
anthropicfg_001/v2fireguardsubstantive10.00.00.020.040.00.0