Skip to content

Google · Vision LLM

Gemma 4 26B on ResumeBench: 62.8 F1, rank 16 of 18

Gemma 4 26B ranks 16th of 18 on ResumeBench: 62.8 F1, $0.56 per 1,000 pages, 29 seconds per resume. It is 24.3 points behind LlamaParse Extract Agentic Plus.

9th of 11 vision LLMs. Strongest on handwritten (−1.2 points), expert-built (canva / latex) (−13.4 points) and table grid (−14.2 points). Weakest on scanned & rotated (−42.2 points), rotated & warped pages (−39.5 points) and hidden text & prompt injections (−36.0 points).

Rank
16/18
F1
62.8
Precision
69.1
Recall
66.2
Perfect resumes
4/300
Per 1,000 pages
$0.56
Median per resume
29 s

Averaged over 300 resumes. Dates (scored separately): 82.5. 90% finish within 76 s.

Where Gemma 4 26B wins and loses

F1 by kind of resume, against the median system.

Reading the page

Gemma 4 26B by reading the page
Kind of resume# of resumesF1MedianGapRank
Handwritten950.351.5−1.214th
Image only2845.171.4−26.217th
Sidebar or grid8260.481.9−21.517th
Photo4566.984.0−17.216th

Distractors

Gemma 4 26B by distractors
Kind of resume# of resumesF1MedianGapRank
Rotated & warped pages2143.482.9−39.517th
Hidden text & prompt injections1448.684.5−36.016th
Content as images865.688.2−22.616th
Wording traps1660.684.5−23.917th
Typos kept on purpose3751.383.7−32.416th

Extraction challenges

Gemma 4 26B by extraction challenges
Kind of resume# of resumesF1MedianGapRank
Many entries8358.081.9−23.817th
Long bullet lists10157.481.4−24.017th
Split across pages8560.082.2−22.217th
Big skills list6061.983.6−21.718th
Custom sections10558.980.8−21.917th
Combined headings3760.982.7−21.818th
Promotions8859.583.5−24.016th
Partial dates13862.983.4−20.516th
Overlapping jobs6957.581.7−24.317th
Accented text1359.385.5−26.216th

Noise

Gemma 4 26B by noise
Kind of resume# of resumesF1MedianGapRank
Repeated header6764.085.2−21.218th
References5562.585.2−22.617th
Busy page1861.580.1−18.617th

Source

Gemma 4 26B by source
Kind of resume# of resumesF1MedianGapRank
Everyday resumes21264.585.1−20.718th
Expert-built (Canva / LaTeX)3270.283.6−13.416th
Resume-builder templates1058.681.2−22.617th
Scanned & rotated1940.782.9−42.217th
Distractor layouts1862.485.3−23.016th

Layout

Gemma 4 26B by layout
Kind of resume# of resumesF1MedianGapRank
Single column19563.184.0−20.917th
Two-column2369.386.8−17.517th
Two-column sidebar5455.180.0−24.917th
Three-column2067.084.8−17.817th
Table grid879.894.1−14.217th

Length

Gemma 4 26B by length
Kind of resume# of resumesF1MedianGapRank
Short14865.887.1−21.317th
Medium9063.284.7−21.516th
Long6255.174.6−19.618th

By section of the resume

F1 by resume section, against the median system.

Gemma 4 26B by resume section
SectionResumesF1MedianGap
Contact details30084.693.5−9.0
Experience30056.086.3−30.4
Education29768.089.4−21.4
Summary29035.581.7−46.2
Certifications24463.081.1−18.1
Awards11055.775.4−19.7
Skills29081.992.1−10.2
Languages17180.984.3−3.4
Custom sections22332.349.9−17.6
Interests6771.891.7−19.9
Volunteering7859.484.5−25.1
Profiles3757.266.7−9.5
Projects8355.083.2−28.2
Publications5354.578.6−24.1

On the published resumes

Best and worst of the 20 public resumes.

Gemma 4 26B on published resumes
ResumeWhat makes it hardF1
Senior Customer Service RepresentativeBusy Canva page80.2
Head of Events & Public Space OperationsTable grid with emoji bullets78.0
Senior Data Scientist (Lead)Fifty skills, seven pages70.7
Senior ocularist and practice ownerHandwritten resume, six pages37.0
Deputy Head of MissionRotated scan with hidden identity text34.1
Supervisory Human Resources Specialist, GS-0201-15Resume-builder template29.4

How it was run

Gemma 4 26B A4B (open weights), page images in, JSON schema out. Same PDF, schema and instructions as every other system, one run per resume (4 November 2026).

Gemma 4 26B on Google’s site

Run the open-source harness: list its pipelines, or grade your own predictions (GitHub):

$ pip install "resume-bench[runners] @ git+https://github.com/careerflow/ResumeBench"
$ hf auth login   # the dataset is gated: accept its terms on Hugging Face first
$ resume-bench download
$ resume-bench providers
$ resume-bench grade-file my_predictions.jsonl --split test

Closest alternatives

Nearest in F1.

Embed this result

Shows its current rank. Updates with each run.

Gemma 4 26B: #16 on ResumeBench resume extraction benchmark
<a href="https://www.resumebench.ai/systems/gemma-4-26b"><img src="https://www.resumebench.ai/badge/gemma-4-26b.svg" alt="Gemma 4 26B: #16 on ResumeBench resume extraction benchmark" height="28"></a>

Choosing a resume extraction model

All 18 models · Leaderboard

Frequently asked questions (FAQs)

How accurate is Gemma 4 26B at resume extraction?

62.8 F1 on ResumeBench's 300 resumes, 16th of 18 models.

How much does Gemma 4 26B cost to parse resumes?

$0.56 per 1,000 pages, about $0.002 per resume.

How fast is Gemma 4 26B?

29 seconds per resume (median).

Which resumes is Gemma 4 26B best at?

Handwritten, expert-built (canva / latex) and table grid. Weakest on scanned & rotated, rotated & warped pages and hidden text & prompt injections.