Claude Opus 4.8 vs Qwen 3.8 27B: which is better at resume extraction?
Claude Opus 4.8 leads Qwen 3.8 27B by 1.7 points (85.5 vs 83.8 F1). Cost per 1,000 pages: $90 vs $9.59. Median time per resume: 31 s vs 36 s.
Claude Opus 4.8 wins on 149 of 300 resumes, Qwen 3.8 27B on 105, 46 tied.
85.51
Claude Opus 4.8
A · Vision LLM
83.77
Qwen 3.8 27B
B · Vision LLM
Claude Opus 4.8 is ahead by 1.74 points on these 300 resumes.
- Many entries 83A 83.7 · B 81.6+2.0
- Long bullet lists 101A 83.1 · B 80.8+2.4
- Split across pages 85A 84.6 · B 81.8+2.8
- Big skills list 60A 84.8 · B 82.9+2.0
- Custom sections 105A 83.4 · B 81.0+2.4
- Combined headings 37A 85.1 · B 83.7+1.5
- Promotions 88A 85.5 · B 83.2+2.2
- Partial dates 138A 84.5 · B 83.6+0.9
- Overlapping jobs 69A 83.5 · B 82.4+1.1
- Accented text 13A 85.6 · B 84.9+0.6
Side by side
| Claude Opus 4.8 | Qwen 3.8 27B | |
|---|---|---|
| Type | Vision LLM | Vision LLM |
| Maker | Anthropic | Alibaba |
| Rank | 4 of 18 | 9 of 18 |
| F1 | 85.5 | 83.8 |
| Precision | 86.8 | 85.4 |
| Recall | 87.5 | 85.5 |
| Cost per 1,000 pages | $90 | $9.59 |
| Median time per resume | 31 s | 36 s |
| Resumes won | 149 | 105 |
Where each one wins
Where the two differ most.
| Kind of resume | # of resumes | Claude Opus 4.8 | Qwen 3.8 27B | Gap |
|---|---|---|---|---|
| Scanned & rotated (source) | 19 | 87.5 | 78.4 | +9.1 |
| Rotated & warped pages (distractors) | 21 | 87.4 | 78.7 | +8.6 |
| Hidden text & prompt injections (distractors) | 14 | 90.8 | 82.4 | +8.4 |
| Image only (reading the page) | 28 | 77.0 | 70.5 | +6.5 |
| Content as images (distractors) | 8 | 83.6 | 89.5 | −5.8 |
| Wording traps (distractors) | 16 | 81.9 | 87.6 | −5.6 |
| Long (length) | 62 | 78.4 | 73.4 | +5.0 |
| Distractor layouts (source) | 18 | 82.8 | 87.6 | −4.9 |
| Two-column sidebar (layout) | 54 | 81.9 | 78.4 | +3.5 |
| Handwritten (reading the page) | 9 | 54.7 | 51.6 | +3.1 |
| Split across pages (extraction challenges) | 85 | 84.6 | 81.8 | +2.8 |
| Expert-built (Canva / LaTeX) (source) | 32 | 86.1 | 83.4 | +2.7 |
| Section | Resumes | Claude Opus 4.8 | Qwen 3.8 27B | Gap |
|---|---|---|---|---|
| Contact details | 300 | 93.7 | 93.2 | +0.6 |
| Experience | 300 | 88.2 | 86.2 | +2.1 |
| Education | 297 | 90.2 | 87.2 | +3.0 |
| Summary | 290 | 89.7 | 81.7 | +7.9 |
| Certifications | 239 | 85.4 | 82.7 | +2.6 |
| Awards | 106 | 72.9 | 78.4 | −5.5 |
| Skills | 283 | 95.2 | 92.7 | +2.5 |
| Languages | 167 | 85.8 | 85.4 | +0.5 |
| Custom sections | 218 | 51.6 | 51.2 | +0.4 |
| Interests | 63 | 93.7 | 94.6 | −0.9 |
| Volunteering | 78 | 84.6 | 84.7 | −0.1 |
| Profiles | 35 | 61.4 | 72.5 | −11.1 |
| Projects | 78 | 82.1 | 85.5 | −3.4 |
| Publications | 52 | 81.8 | 77.2 | +4.5 |
Published resumes they disagree on most
Open one to see both outputs field by field.
| Resume | Claude Opus 4.8 | Qwen 3.8 27B | Gap |
|---|---|---|---|
| Deputy Head of Mission: Rotated scan with hidden identity text | 85.9 | 65.6 | +20.3 |
| Senior Manufacturing Engineer: Third-person prose, no bullets | 93.0 | 79.6 | +13.4 |
| Head of Events & Public Space Operations: Table grid with emoji bullets | 74.8 | 88.1 | −13.3 |
| Senior Controls Engineer: Five custom sections | 86.6 | 73.5 | +13.2 |
Which to pick
Claude Opus 4.8 is more accurate. Qwen 3.8 27B costs 89% less for 1.7 fewer points.
Claude Opus 4.8 does better on scanned & rotated, rotated & warped pages and hidden text & prompt injections. Qwen 3.8 27B does better on content as images, wording traps and distractor layouts.
Claude Opus 4.8 against every other model
- Claude Opus 4.8 vs LlamaParse Extract Agentic Plus
- Claude Opus 4.8 vs LlamaParse Extract Agentic
- Claude Opus 4.8 vs LlamaParse Extract Cost-Effective
- Claude Opus 4.8 vs Reducto Deep Extract
- Claude Opus 4.8 vs Reducto Extract
- Claude Opus 4.8 vs Extend Max Context
- Claude Opus 4.8 vs Extend Extract
- Claude Opus 4.8 vs GPT-5.6
- Claude Opus 4.8 vs GPT-5.5
- Claude Opus 4.8 vs GPT-5.4 Nano
- Claude Opus 4.8 vs Gemini 3.5 Flash
- Claude Opus 4.8 vs Gemma 4 26B
- Claude Opus 4.8 vs Qwen 3.8 Flash
- Claude Opus 4.8 vs Qwen 3.5 35B
- Claude Opus 4.8 vs Qwen 3.5 9B
- Claude Opus 4.8 vs GLM 5.3 Flash
Qwen 3.8 27B against every other model
- Qwen 3.8 27B vs LlamaParse Extract Agentic Plus
- Qwen 3.8 27B vs LlamaParse Extract Agentic
- Qwen 3.8 27B vs LlamaParse Extract Cost-Effective
- Qwen 3.8 27B vs Reducto Deep Extract
- Qwen 3.8 27B vs Reducto Extract
- Qwen 3.8 27B vs Extend Max Context
- Qwen 3.8 27B vs Extend Extract
- Qwen 3.8 27B vs GPT-5.6
- Qwen 3.8 27B vs GPT-5.5
- Qwen 3.8 27B vs GPT-5.4 Nano
- Qwen 3.8 27B vs Gemini 3.5 Flash
- Qwen 3.8 27B vs Gemma 4 26B
- Qwen 3.8 27B vs Qwen 3.8 Flash
- Qwen 3.8 27B vs Qwen 3.5 35B
- Qwen 3.8 27B vs Qwen 3.5 9B
- Qwen 3.8 27B vs GLM 5.3 Flash
Popular comparisons
- LlamaParse Extract Agentic Plus vs Reducto Deep Extract
- Extend Max Context vs Reducto Deep Extract
- Extend Max Context vs LlamaParse Extract Agentic Plus
- Claude Opus 4.8 vs GPT-5.6
- Gemini 3.5 Flash vs GPT-5.6
- Claude Opus 4.8 vs Gemini 3.5 Flash
- LlamaParse Extract Agentic vs LlamaParse Extract Agentic Plus
- Reducto Deep Extract vs Reducto Extract
- Gemma 4 26B vs Qwen 3.8 27B
- Document APIs vs vision LLMs