Skip to content
vs

Gemma 4 26B vs Qwen 3.5 9B: which is better at resume extraction?

Qwen 3.5 9B leads Gemma 4 26B by 13.2 points (76.0 vs 62.8 F1). Cost per 1,000 pages: $0.56 vs $1.31. Median time per resume: 29 s vs 138 s.

Gemma 4 26B wins on 61 of 299 resumes, Qwen 3.5 9B on 236, 2 tied.

62.98

Gemma 4 26B

A · Vision LLM

−13.05A − B, points of F1

76.03

Qwen 3.5 9B

B · Vision LLM

A better on 61level on 2B better on 236

Qwen 3.5 9B is ahead by 13.05 points on these 299 resumes.

  • Many entries 82A 58.6 · B 73.9−15.3
  • Long bullet lists 100A 57.9 · B 73.2−15.3
  • Split across pages 84A 60.5 · B 73.4−12.9
  • Big skills list 59A 62.8 · B 76.3−13.6
  • Custom sections 104A 59.4 · B 73.0−13.7
  • Combined headings 37A 60.9 · B 72.2−11.3
  • Promotions 88A 59.5 · B 74.8−15.3
  • Partial dates 138A 62.9 · B 75.6−12.7
  • Overlapping jobs 69A 57.5 · B 72.2−14.7
  • Accented text 13A 59.3 · B 83.7−24.5

Side by side

Gemma 4 26B vs Qwen 3.5 9B
Gemma 4 26BQwen 3.5 9B
TypeVision LLMVision LLM
MakerGoogleAlibaba
Rank16 of 1815 of 18
F162.876.0
Precision69.178.9
Recall66.280.3
Cost per 1,000 pages$0.56$1.31
Median time per resume29 s138 s
Resumes won61236

Gemma 4 26B in detailQwen 3.5 9B in detail

Where each one wins

Where the two differ most.

Gemma 4 26B vs Qwen 3.5 9B by kind of resume
Kind of resume# of resumesGemma 4 26BQwen 3.5 9BGap
Accented text (extraction challenges)1359.383.7−24.5
Scanned & rotated (source)1940.764.5−23.8
Rotated & warped pages (distractors)2143.466.5−23.1
Hidden text & prompt injections (distractors)1448.670.2−21.6
Typos kept on purpose (distractors)3751.372.2−21.0
Content as images (distractors)865.685.9−20.3
Resume-builder templates (source)1058.678.5−19.8
Distractor layouts (source)1862.480.4−18.0
Wording traps (distractors)1660.677.7−17.1
Image only (reading the page)2845.161.2−16.1
Long bullet lists (extraction challenges)10057.973.2−15.3
Many entries (extraction challenges)8258.673.9−15.3
Gemma 4 26B vs Qwen 3.5 9B by section
SectionResumesGemma 4 26BQwen 3.5 9BGap
Contact details29984.692.6−7.9
Experience29956.177.2−21.0
Education29668.280.8−12.6
Summary28935.677.9−42.3
Certifications24363.274.7−11.5
Awards10956.255.2+1.0
Skills28981.983.2−1.3
Languages17180.980.0+0.9
Custom sections22232.436.4−4.0
Interests6672.984.3−11.4
Volunteering7859.480.2−20.8
Profiles3658.851.3+7.5
Projects8255.675.5−19.9
Publications5354.576.3−21.8

Published resumes they disagree on most

Open one to see both outputs field by field.

Which to pick

Qwen 3.5 9B is more accurate. Gemma 4 26B costs 58% less for 13.2 fewer points.

Qwen 3.5 9B does better on accented text, scanned & rotated and rotated & warped pages.

Gemma 4 26B against every other model

Qwen 3.5 9B against every other model

Popular comparisons

Frequently asked questions (FAQs)

Which is better for resume extraction, Gemma 4 26B or Qwen 3.5 9B?

Qwen 3.5 9B: 76.0 F1 against 62.8.

Which is cheaper, Gemma 4 26B or Qwen 3.5 9B?

Gemma 4 26B: $0.56 per 1,000 pages against $1.31.

Where does each one do better?

Qwen 3.5 9B: accented text, scanned & rotated and rotated & warped pages.