Skip to content
vs

Claude Opus 4.8 vs Gemma 4 26B: which is better at resume extraction?

Claude Opus 4.8 leads Gemma 4 26B by 22.7 points (85.5 vs 62.8 F1). Cost per 1,000 pages: $90 vs $0.56. Median time per resume: 31 s vs 29 s.

Claude Opus 4.8 wins on 274 of 300 resumes, Gemma 4 26B on 23, 3 tied.

85.51

Claude Opus 4.8

A · Vision LLM

+22.68A − B, points of F1

62.82

Gemma 4 26B

B · Vision LLM

A better on 274level on 3B better on 23

Claude Opus 4.8 is ahead by 22.68 points on these 300 resumes.

  • Many entries 83A 83.7 · B 58.0+25.6
  • Long bullet lists 101A 83.1 · B 57.4+25.7
  • Split across pages 85A 84.6 · B 60.0+24.6
  • Big skills list 60A 84.8 · B 61.9+22.9
  • Custom sections 105A 83.4 · B 58.9+24.5
  • Combined headings 37A 85.1 · B 60.9+24.3
  • Promotions 88A 85.5 · B 59.5+26.0
  • Partial dates 138A 84.5 · B 62.9+21.6
  • Overlapping jobs 69A 83.5 · B 57.5+26.0
  • Accented text 13A 85.6 · B 59.3+26.3

Side by side

Claude Opus 4.8 vs Gemma 4 26B
Claude Opus 4.8Gemma 4 26B
TypeVision LLMVision LLM
MakerAnthropicGoogle
Rank4 of 1816 of 18
F185.562.8
Precision86.869.1
Recall87.566.2
Cost per 1,000 pages$90$0.56
Median time per resume31 s29 s
Resumes won27423

Claude Opus 4.8 in detailGemma 4 26B in detail

Where each one wins

Where the two differ most.

Claude Opus 4.8 vs Gemma 4 26B by kind of resume
Kind of resume# of resumesClaude Opus 4.8Gemma 4 26BGap
Scanned & rotated (source)1987.540.7+46.8
Rotated & warped pages (distractors)2187.443.4+43.9
Hidden text & prompt injections (distractors)1490.848.6+42.3
Typos kept on purpose (distractors)3785.251.3+34.0
Image only (reading the page)2877.045.1+31.9
Resume-builder templates (source)1085.458.6+26.8
Two-column sidebar (layout)5481.955.1+26.7
Accented text (extraction challenges)1385.659.3+26.3
Overlapping jobs (extraction challenges)6983.557.5+26.0
Promotions (extraction challenges)8885.559.5+26.0
Long bullet lists (extraction challenges)10183.157.4+25.7
Many entries (extraction challenges)8383.758.0+25.6
Claude Opus 4.8 vs Gemma 4 26B by section
SectionResumesClaude Opus 4.8Gemma 4 26BGap
Contact details30093.784.6+9.2
Experience30088.256.0+32.3
Education29790.268.0+22.2
Summary29089.735.5+54.1
Certifications23985.463.0+22.4
Awards10672.955.7+17.2
Skills28395.281.9+13.3
Languages16785.880.9+4.9
Custom sections21851.632.3+19.4
Interests6393.771.8+21.8
Volunteering7884.659.4+25.2
Profiles3561.457.2+4.2
Projects7882.155.0+27.1
Publications5281.854.5+27.2

Published resumes they disagree on most

Open one to see both outputs field by field.

Which to pick

Claude Opus 4.8 is more accurate. Gemma 4 26B costs 99% less for 22.7 fewer points.

Claude Opus 4.8 does better on scanned & rotated, rotated & warped pages and hidden text & prompt injections.

Claude Opus 4.8 against every other model

Gemma 4 26B against every other model

Popular comparisons

Frequently asked questions (FAQs)

Which is better for resume extraction, Claude Opus 4.8 or Gemma 4 26B?

Claude Opus 4.8: 85.5 F1 against 62.8.

Which is cheaper, Claude Opus 4.8 or Gemma 4 26B?

Gemma 4 26B: $0.56 per 1,000 pages against $90.

Where does each one do better?

Claude Opus 4.8: scanned & rotated, rotated & warped pages and hidden text & prompt injections.