Skip to content
vs

Gemma 4 26B vs Qwen 3.5 35B: which is better at resume extraction?

Qwen 3.5 35B leads Gemma 4 26B by 15.1 points (77.9 vs 62.8 F1). Cost per 1,000 pages: $0.56 vs $3.91. Median time per resume: 29 s vs 78 s.

Gemma 4 26B wins on 54 of 300 resumes, Qwen 3.5 35B on 243, 3 tied.

62.82

Gemma 4 26B

A · Vision LLM

−15.13A − B, points of F1

77.95

Qwen 3.5 35B

B · Vision LLM

A better on 54level on 3B better on 243

Qwen 3.5 35B is ahead by 15.13 points on these 300 resumes.

  • Many entries 83A 58.0 · B 78.9−20.9
  • Long bullet lists 101A 57.4 · B 76.3−18.9
  • Split across pages 85A 60.0 · B 76.5−16.5
  • Big skills list 60A 61.9 · B 76.6−14.7
  • Custom sections 105A 58.9 · B 77.0−18.1
  • Combined headings 37A 60.9 · B 74.6−13.7
  • Promotions 88A 59.5 · B 76.7−17.2
  • Partial dates 138A 62.9 · B 78.9−16.0
  • Overlapping jobs 69A 57.5 · B 76.2−18.7
  • Accented text 13A 59.3 · B 80.4−21.2

Side by side

Gemma 4 26B vs Qwen 3.5 35B
Gemma 4 26BQwen 3.5 35B
TypeVision LLMVision LLM
MakerGoogleAlibaba
Rank16 of 1814 of 18
F162.877.9
Precision69.178.8
Recall66.283.7
Cost per 1,000 pages$0.56$3.91
Median time per resume29 s78 s
Resumes won54243

Gemma 4 26B in detailQwen 3.5 35B in detail

Where each one wins

Where the two differ most.

Gemma 4 26B vs Qwen 3.5 35B by kind of resume
Kind of resume# of resumesGemma 4 26BQwen 3.5 35BGap
Scanned & rotated (source)1940.775.3−34.6
Rotated & warped pages (distractors)2143.476.5−33.1
Hidden text & prompt injections (distractors)1448.679.2−30.6
Typos kept on purpose (distractors)3751.380.4−29.1
Content as images (distractors)865.690.3−24.7
Image only (reading the page)2845.169.7−24.6
Wording traps (distractors)1660.684.8−24.2
Distractor layouts (source)1862.485.7−23.3
Accented text (extraction challenges)1359.380.4−21.2
Many entries (extraction challenges)8358.078.9−20.9
Resume-builder templates (source)1058.679.1−20.5
References (noise)5562.581.8−19.2
Gemma 4 26B vs Qwen 3.5 35B by section
SectionResumesGemma 4 26BQwen 3.5 35BGap
Contact details30084.692.1−7.5
Experience30056.079.3−23.3
Education29768.081.8−13.8
Summary29035.580.4−44.9
Certifications24463.079.1−16.1
Awards11055.761.9−6.2
Skills29081.987.8−5.9
Languages17180.979.4+1.5
Custom sections22332.340.2−7.9
Interests6771.889.7−17.9
Volunteering7859.483.1−23.7
Profiles3757.265.8−8.6
Projects8355.076.7−21.8
Publications5354.575.0−20.5

Published resumes they disagree on most

Open one to see both outputs field by field.

Which to pick

Qwen 3.5 35B is more accurate. Gemma 4 26B costs 86% less for 15.1 fewer points.

Qwen 3.5 35B does better on scanned & rotated, rotated & warped pages and hidden text & prompt injections.

Gemma 4 26B against every other model

Qwen 3.5 35B against every other model

Popular comparisons

Frequently asked questions (FAQs)

Which is better for resume extraction, Gemma 4 26B or Qwen 3.5 35B?

Qwen 3.5 35B: 77.9 F1 against 62.8.

Which is cheaper, Gemma 4 26B or Qwen 3.5 35B?

Gemma 4 26B: $0.56 per 1,000 pages against $3.91.

Where does each one do better?

Qwen 3.5 35B: scanned & rotated, rotated & warped pages and hidden text & prompt injections.