Skip to content
vs

Gemini 3.5 Flash vs Gemma 4 26B: which is better at resume extraction?

Gemini 3.5 Flash leads Gemma 4 26B by 22.6 points (85.5 vs 62.8 F1). Cost per 1,000 pages: $35 vs $0.56. Median time per resume: 43 s vs 29 s.

Gemini 3.5 Flash wins on 277 of 300 resumes, Gemma 4 26B on 18, 5 tied.

85.45

Gemini 3.5 Flash

A · Vision LLM

+22.63A − B, points of F1

62.82

Gemma 4 26B

B · Vision LLM

A better on 277level on 5B better on 18

Gemini 3.5 Flash is ahead by 22.63 points on these 300 resumes.

  • Many entries 83A 84.3 · B 58.0+26.2
  • Long bullet lists 101A 83.9 · B 57.4+26.4
  • Split across pages 85A 84.6 · B 60.0+24.6
  • Big skills list 60A 86.0 · B 61.9+24.1
  • Custom sections 105A 83.6 · B 58.9+24.7
  • Combined headings 37A 84.2 · B 60.9+23.4
  • Promotions 88A 87.3 · B 59.5+27.9
  • Partial dates 138A 84.9 · B 62.9+22.0
  • Overlapping jobs 69A 86.4 · B 57.5+29.0
  • Accented text 13A 86.4 · B 59.3+27.1

Side by side

Gemini 3.5 Flash vs Gemma 4 26B
Gemini 3.5 FlashGemma 4 26B
TypeVision LLMVision LLM
MakerGoogleGoogle
Rank5 of 1816 of 18
F185.562.8
Precision86.969.1
Recall87.966.2
Cost per 1,000 pages$35$0.56
Median time per resume43 s29 s
Resumes won27718

Gemini 3.5 Flash in detailGemma 4 26B in detail

Where each one wins

Where the two differ most.

Gemini 3.5 Flash vs Gemma 4 26B by kind of resume
Kind of resume# of resumesGemini 3.5 FlashGemma 4 26BGap
Scanned & rotated (source)1987.240.7+46.5
Rotated & warped pages (distractors)2187.443.4+44.0
Hidden text & prompt injections (distractors)1486.748.6+38.1
Typos kept on purpose (distractors)3784.451.3+33.1
Image only (reading the page)2875.145.1+30.0
Overlapping jobs (extraction challenges)6986.457.5+29.0
Two-column sidebar (layout)5483.455.1+28.3
References (noise)5590.762.5+28.2
Promotions (extraction challenges)8887.359.5+27.9
Resume-builder templates (source)1086.458.6+27.7
Accented text (extraction challenges)1386.459.3+27.1
Long bullet lists (extraction challenges)10183.957.4+26.4
Gemini 3.5 Flash vs Gemma 4 26B by section
SectionResumesGemini 3.5 FlashGemma 4 26BGap
Contact details30095.384.6+10.7
Experience30086.556.0+30.5
Education29791.568.0+23.5
Summary29089.335.5+53.8
Certifications24584.063.0+21.0
Awards9280.355.7+24.6
Skills28993.581.9+11.6
Languages17084.380.9+3.4
Custom sections21650.132.3+17.8
Interests6394.271.8+22.3
Volunteering7983.759.4+24.4
Profiles3564.857.2+7.6
Projects8080.455.0+25.4
Publications5283.454.5+28.9

Published resumes they disagree on most

Open one to see both outputs field by field.

Which to pick

Gemini 3.5 Flash is more accurate. Gemma 4 26B costs 98% less for 22.6 fewer points.

Gemini 3.5 Flash does better on scanned & rotated, rotated & warped pages and hidden text & prompt injections.

Gemini 3.5 Flash against every other model

Gemma 4 26B against every other model

Popular comparisons

Frequently asked questions (FAQs)

Which is better for resume extraction, Gemini 3.5 Flash or Gemma 4 26B?

Gemini 3.5 Flash: 85.5 F1 against 62.8.

Which is cheaper, Gemini 3.5 Flash or Gemma 4 26B?

Gemma 4 26B: $0.56 per 1,000 pages against $35.

Where does each one do better?

Gemini 3.5 Flash: scanned & rotated, rotated & warped pages and hidden text & prompt injections.