Document APIs vs vision LLMs: which is better at resume extraction?
Best document API: LlamaParse Extract Agentic Plus, 87.2 F1. Best vision LLM: Claude Opus 4.8, 85.5. The typical API scores 84.7 at $23 per 1,000 pages; the typical vision LLM 83.5 at $3.91.
The two groups
| Document APIs | Vision LLMs | |
|---|---|---|
| Models | 7 | 11 |
| Best | LlamaParse Extract Agentic Plus (87.2) | Claude Opus 4.8 (85.5) |
| Median F1 | 84.7 | 83.5 |
| Median cost per 1,000 pages | $23 | $3.91 |
| Median time per resume | 43 s | 43 s |
Where each group wins
Where the two groups differ most.
| Kind of resume | # of resumes | APIs | LLMs | Gap |
|---|---|---|---|---|
| Scanned & rotated (source) | 19 | 90.4 | 71.6 | +18.8 |
| Rotated & warped pages (distractors) | 21 | 89.6 | 73.2 | +16.4 |
| Hidden text & prompt injections (distractors) | 14 | 90.1 | 77.5 | +12.5 |
| Image only (reading the page) | 28 | 76.4 | 65.4 | +11.0 |
| Typos kept on purpose (distractors) | 37 | 88.0 | 80.4 | +7.6 |
| Two-column sidebar (layout) | 54 | 83.0 | 77.2 | +5.8 |
| Sidebar or grid (reading the page) | 82 | 84.4 | 80.4 | +3.9 |
| Accented text (extraction challenges) | 13 | 87.8 | 83.9 | +3.9 |
| Long (length) | 62 | 76.7 | 73.4 | +3.3 |
| Resume-builder templates (source) | 10 | 80.6 | 83.7 | −3.1 |
| Wording traps (distractors) | 16 | 85.0 | 81.9 | +3.0 |
| Busy page (noise) | 18 | 82.8 | 79.8 | +2.9 |
Every system
| Model | Type | F1 | Per 1,000 pages | Median time |
|---|---|---|---|---|
| LlamaParse Extract Agentic Plus | Document API | 87.2 | $54 | 70 s |
| Reducto Deep Extract | Document API | 85.6 | $40 | 65 s |
| LlamaParse Extract Agentic | Document API | 85.5 | $23 | 55 s |
| Extend Max Context | Document API | 84.7 | $50 | 43 s |
| LlamaParse Extract Cost-Effective | Document API | 83.5 | $8.18 | 29 s |
| Reducto Extract | Document API | 81.7 | $20 | 16 s |
| Extend Extract | Document API | 81.0 | $12 | 31 s |
| Claude Opus 4.8 | Vision LLM | 85.5 | $90 | 31 s |
| Gemini 3.5 Flash | Vision LLM | 85.5 | $35 | 43 s |
| GPT-5.6 | Vision LLM | 84.7 | $74 | 38 s |
| Qwen 3.8 Flash | Vision LLM | 84.1 | $2.98 | 122 s |
| Qwen 3.8 27B | Vision LLM | 83.8 | $9.59 | 36 s |
| GPT-5.5 | Vision LLM | 83.5 | $87 | 48 s |
| Qwen 3.5 35B | Vision LLM | 77.9 | $3.91 | 78 s |
| Qwen 3.5 9B | Vision LLM | 76.0 | $1.31 | 138 s |
| Gemma 4 26B | Vision LLM | 62.8 | $0.56 | 29 s |
| GPT-5.4 Nano | Vision LLM | 61.9 | $2.76 | 20 s |
| GLM 5.3 Flash | Vision LLM | 59.2 | $0.80 | 46 s |
Popular comparisons
- LlamaParse Extract Agentic Plus vs Reducto Deep Extract
- Extend Max Context vs Reducto Deep Extract
- Extend Max Context vs LlamaParse Extract Agentic Plus
- Claude Opus 4.8 vs GPT-5.6
- Gemini 3.5 Flash vs GPT-5.6
- Claude Opus 4.8 vs Gemini 3.5 Flash
- LlamaParse Extract Agentic vs LlamaParse Extract Agentic Plus
- Reducto Deep Extract vs Reducto Extract
- Gemma 4 26B vs Qwen 3.8 27B