hedwigaihedwigaihedwigai
Blogjev against hedwigai ask on 92 questions
We asked 92 yes-or-no questions about public companies two ways: straight to jev, a decision model, and through hedwigai ask, which looks the answer up before it decides. Every answer was checked against SEC records.
| hedwigai ask | jev | |
|---|---|---|
| Right | 88 | 73 |
| Wrong | 2 | 19 |
| Unsure | 2 | 0 |
| Right, of those answered | 98% | 79% |
| Time, a new question | 1.07 s | 525 ms |
| Time, a question seen before | 466 ms | 525 ms |
| Work, a new question | 1.3 small-model + 1.8 jev calls, 2.2 lookups | 1 jev call |
| Work, a question seen before | nothing (kept) | 1 jev call |
| Shows where the answer came from | yes | no |
Use hedwigai ask fromClaude CodeClaude DesktopCursorCodexAny MCP clientAdd hedwigai to your MCP client
Claude Code
Claude Desktop
Cursor'%3e%3c/path%3e%3cdefs%3e%3clinearGradient%20gradientUnits='userSpaceOnUse'%20id='lobe-icons-codex-_R_0_'%20x1='12'%20x2='12'%20y1='3'%20y2='21'%3e%3cstop%20stop-color='%23B1A7FF'%3e%3c/stop%3e%3cstop%20offset='.5'%20stop-color='%237A9DFF'%3e%3c/stop%3e%3cstop%20offset='1'%20stop-color='%233941FF'%3e%3c/stop%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e)
Codex
Any MCP clientWhere each one wins
jev does well when the words alone are enough. ask wins wherever the answer depends on a number, because it looks the number up instead of guessing. Looking up takes time: on a new question jev answers first; on a question asked before, ask does.
rightwrongsaid unsure
A made-up company
10 questions
ask
10 of 10 right ✓
jev
9 of 10 right
The name and the ticker belong to different companies
10 questions
ask
9 of 10 right
jev
10 of 10 right ✓
A real company, but the wrong stock exchange named
9 questions
ask
9 of 9 right ✓
jev
7 of 9 right
A biotech, and clearly big enough
15 questions
ask
13 of 15 right ✓
jev
8 of 15 right
A biotech, but clearly too small
15 questions
ask
15 of 15 right ✓
jev
14 of 15 right
A biotech, and within 6% of the size asked about
10 questions
ask
9 of 10 right ✓
jev
3 of 10 right
Not a biotech at all
23 questions
ask
23 of 23 right ✓
jev
22 of 23 right
All 92 questions
ask
88 right · 2 wrong
jev
73 right · 19 wrong
Time to answer
Median wait, shorter is better
asknew question
1.07 s
askasked before
466 ms ✓
jev
525 ms
Fine print
- "Biotech" means SEC industry codes 2833 to 2836 or 8731, which counts specialty drug makers in; most of ask's misses are about that line.
- One kind of question, one account, 92 questions, measured on 6 and 7 October 2026.
- Times are medians from a laptop over the internet; on the server a new question took 612 ms and a repeat 1 ms.
- New-question times were measured with SEC data already loaded, so a brand new account's first questions are slower.