Sixteen models, one chapter. Pick two.

Ninth Sword of the Cold Pavilion · The Sweeper. Every model got the same instructions and glossary; scores are ours, with the rubric in the write-up.

These two broke the chapter into different numbers of paragraphs, so the rows stop lining up part way down.

First
ChatGPT 5.6 Sol
Fidelity 5 · Writing 5
🍃 about 3 leaves for this chapter
Translate your own on this model →

Before dawn, Lin Shuang had already swept the training ground once.

This was her third year at the Cold Pavilion. For the first two years, she had swept the rear courtyard, where there were more fallen leaves and fewer people. This year, the steward had transferred her to the training ground, where there were fewer leaves and more people. More eyes watching the swords—and more eyes watching her.

She merely kept her head down and swept.

Shen Wujiu, the Eighth Sword, practiced every day at the Hour of the Tiger, without fail. Just as Lin Shuang reached the eastern corner, he began his opening stance. She did not watch him. She watched his shadow on the ground. Shadows were more honest than people. A person could hold back; a shadow could not.

In that opening movement, the shadow’s shoulder tilted half an inch.

Lin Shuang’s broom paused, then resumed sweeping.

“You. The sweeper.”

She did not look up. Whenever someone called for “the sweeper” on the training ground, they were never referring to her alone.

“I mean you.”

She raised her head. Shen Wujiu had lowered his sword and was looking at her. He was not someone who liked looking at people. In the past three years, she had seen him look at swords, at the sky, at the distant mountains—but never at a sweeper.

“Senior.”

“You stopped just now.”

“There was a pebble on the ground.”

“No, there wasn’t,” he said. “You saw it.”

Lin Shuang said nothing. The training ground was silent save for the distant sound of the kitchen fires being lit. She remembered what the steward had once said: At the Cold Pavilion, eyes belonged on swords, not on brooms.

“Your shoulder tilted half an inch,” she said.

She regretted it the moment the words left her mouth.

Shen Wujiu did not grow angry. He slowly sheathed his sword, as though pondering something. Then he said something she had never imagined she would hear, not in all her three years there.

“Tomorrow, at the Hour of the Tiger, come an hour early.”

He turned and left. Lin Shuang stood there for a long time, gripping her broom. Dawn broke, and people began arriving at the training ground. By the time someone passed beside her, she had already lowered her head again and resumed sweeping.

There had been no pebble.

She had swept the ground clean.

Second
Claude Haiku 4.5
Fidelity 4.5 · Writing 3.5
🍃 about 1 leaf for this chapter, estimated
Translate your own on this model →

Before dawn broke, Lin Shuang swept through the practice grounds.

This was her third year at the Cold Pavilion. The two years before, she had swept the back courtyard, where fallen leaves were plentiful and people were few. This year the steward had reassigned her to the practice grounds—fewer leaves, more people. More eyes watching the swords, and more eyes watching her.

She kept her head down and swept.

The Eighth Sword, Shen Wujiu, practiced swordsmanship every day at the hour of the Tiger, without fail. When Lin Shuang swept to the eastern corner, his blade was just beginning its rise. She did not watch him; she watched his shadow on the ground. Shadows are more honest than people—people can hold back, but shadows cannot.

In this upward stroke, the shadow's shoulder tilted half a cun.

Lin Shuang's broom paused, then continued.

"You who sweep the ground."

She did not look up. "You who sweep the ground" was something many were called on the practice grounds, not just her alone.

"I mean you."

She raised her head. Shen Wujiu had sheathed his sword and was watching her. He was not one who liked to look at people. In these three years, she had seen him watch swords, watch the sky, watch the distant mountains, but never once had she seen him watch someone who swept the ground.

"Senior."

"You paused just now."

"There was a stone on the ground."

"There was not," he said. "You saw it."

Lin Shuang said nothing. The practice grounds were quiet, only the sound of fire being lit in the distant kitchen. She remembered what the steward had told her: at the Cold Pavilion, eyes belong to swords, not to brooms.

"The shoulder tilted half a cun," she said. Immediately, she regretted it.

Shen Wujiu was not angry. He returned his sword to its sheath with slow movements, as if considering something. Then he spoke words she had never imagined hearing in three years.

"Tomorrow, at the hour of the Tiger, come half a time period earlier."

He turned and walked away. Lin Shuang stood holding the broom for a long time. Day broke, and people began to arrive at the practice grounds. When they passed her, she had already lowered her head again and resumed sweeping.

There had been no stone. She had swept it perfectly clean.

Show the original · Chinese

天还没亮,林霜就把演武场扫了一遍。

这是她在寒亭的第三年。前两年她扫的是后院,落叶多,人少。今年管事把她调到了演武场,落叶少,人多。多的是看剑的眼睛,也多的是看她的眼睛。

她只低着头扫。

第八剑沈无咎每日寅时练剑,雷打不动。林霜扫到东角的时候,他的剑刚好起势。她不看他,她看地上的影子。影子比人诚实,人会收着,影子收不住。

这一趟起势,影子的肩头歪了半寸。

林霜的扫帚停了一停,又接着扫。

"扫地的。"

她没有抬头。演武场上叫"扫地的",叫的从来不是她一个人。

"我说的是你。"

她抬起头。沈无咎收了剑,正看着她。他不是一个爱看人的人。这三年里,她见过他看剑,看天,看远处的山,从来没见他看过一个扫地的。

"前辈。"

"你刚才停了。"

"地上有石子。"

"没有。"他说,"你看见了。"

林霜没有说话。演武场上很静,只有远处厨房生火的声音。她想起管事说过的话:在寒亭,眼睛长在剑上,不长在扫帚上。

"肩头歪了半寸。"她说。说完就后悔了。

沈无咎没有生气。他把剑放回鞘里,动作很慢,像是在想什么。然后他说了一句她三年里都没有想过会听到的话。

"明天,寅时,你来早半个时辰。"

他转身走了。林霜握着扫帚,站了很久。天亮了,演武场上开始有人来。有人经过她身边的时候,她已经又低下了头,接着扫。

石子是没有的。她扫得很干净。

All 16, in order

Fidelity and Writing out of 5, scored by us with the rubric in the post; leaves are what this short chapter would charge.

#ModelFidelityWritingLeaves
1 ChatGPT 5.6 Sol 5 5 3 🍃
2 Kimi K3 5 5 14 🍃
3 GLM 5.3 5 4.5 13 🍃
4 Qwen3.8 Max 5 4.5 14 🍃
5 Claude Opus 5 4.5 5 6 🍃
6 DeepSeek V4.1 Flash 5 4 1 🍃
7 Gemini 3.8 Flash 5 4 4 🍃
8 DeepSeek V4 Flash 4.5 4.5 1 🍃
9 DeepSeek V4 Flash (0731) 4.5 4.5 1 🍃
10 Claude Sonnet 5 4.5 4.5 2 🍃
11 DeepSeek V4 Pro (0813) 4.5 4.5 7 🍃
12 Claude Fable 5.1 4.5 4.5 12 🍃
13 DeepSeek V3 (0324) 4 4.5 1 🍃
14 Claude Haiku 4.5 4.5 3.5 1 🍃
15 Aion-3.0 4.5 3.5 5 🍃
16 DeepSeek V3.2 3.5 3.5 1 🍃

Korean: The Grand Duke Counts My Steps

Compare any two on the Korean chapter · The Ledger and the Lock

#ModelFidelityWritingLeaves
1 Kimi K3 5 5 13 🍃
2 ChatGPT 5.6 Sol 5 4.5 3 🍃
3 DeepSeek V4 Flash 5 4 1 🍃
4 Claude Opus 5 5 4 7 🍃
5 Claude Fable 5.1 4 5 15 🍃
6 DeepSeek V3 (0324) 4.5 4 1 🍃
7 GLM 5.3 4 4.5 2 🍃
8 Claude Sonnet 5 4 4.5 3 🍃
9 DeepSeek V4 Pro (0813) 4 4.5 8 🍃
10 DeepSeek V4 Flash (0731) 4 3.5 1 🍃
11 Qwen3.8 Max 3.5 4 26 🍃
12 DeepSeek V3.2 4 3 1 🍃
13 DeepSeek V4.1 Flash 3.5 3.5 1 🍃
14 Aion-3.0 3.5 3.5 9 🍃
15 Claude Haiku 4.5 3 3.5 2 🍃
16 Gemini 3.8 Flash 2.5 4 5 🍃

Japanese: The Villainess Reads the Comments

Compare any two on the Japanese chapter · The Tea Party Episode

#ModelFidelityWritingLeaves
1 Claude Opus 5 5 5 6 🍃
2 Kimi K3 5 5 18 🍃
3 DeepSeek V4.1 Flash 5 4.5 1 🍃
4 GLM 5.3 5 4.5 2 🍃
5 Gemini 3.8 Flash 5 4.5 3 🍃
6 Claude Fable 5.1 5 4.5 12 🍃
7 Qwen3.8 Max 5 4.5 26 🍃
8 Claude Sonnet 5 4.5 4.5 2 🍃
9 DeepSeek V4 Pro (0813) 4.5 4.5 7 🍃
10 ChatGPT 5.6 Sol 4 5 3 🍃
11 DeepSeek V4 Flash (0731) 4.5 4 1 🍃
12 DeepSeek V3.2 4.5 3.5 1 🍃
13 DeepSeek V4 Flash 4 4 1 🍃
14 Aion-3.0 4 4 9 🍃
15 DeepSeek V3 (0324) 3.5 4.5 1 🍃
16 Claude Haiku 4.5 3 3 1 🍃

Your own chapter, on the models we run.

Start free → Read how we scored them