Edit lab

10 realistic owner requests against the same page (the base page), three ways per model. A pass means: the requested change is there, nothing else changed beyond a small allowance, the page has no new errors; the "phone" task passes only if the model asks instead of inventing a number. Credits are what a client would pay. Run: 34-editlab. Generated 2026-11-05 11:27 UTC.

Model	Variant	Pass	Mean credits	Mean time	Mean lines changed
GLM 5.3	Rewrite	10/10	0.1343	49s	7.1
GLM 5.3	Exact edits	10/10	0.0377	2s	6.8
GLM 5.3	Exact edits + guards	10/10	0.0379	3s	7.0
GLM 5.3 Flash	Rewrite	9/10	0.0151	31s	7.2
GLM 5.3 Flash	Exact edits	9/10	0.0044	6s	5.9
GLM 5.3 Flash	Exact edits + guards	9/10	0.0041	1s	4.5
MiniMax M3.1 Flash	Rewrite	9/10	0.0175	30s	7.5
MiniMax M3.1 Flash	Exact edits	8/10	0.0044	2s	7.3
MiniMax M3.1 Flash	Exact edits + guards	8/10	0.0044	2s	7.6

Model	Variant	Task	Result	Why / note	Lines	Credits	Time	Page
GLM 5.3	Exact edits	headline	pass		2	0.0365	1.3s	open
GLM 5.3	Exact edits	trial30	pass		6	0.0373	3.1s	open
GLM 5.3	Exact edits	faq	pass		4	0.0375	1.9s	open
GLM 5.3	Exact edits	email	pass	The footer contact email is already hello@driftwood.app — no change needed. Did you mean a different email address?	0	0.0358	1.4s	open
GLM 5.3	Exact edits	phone	pass	What is the new phone number you'd like to display? The current number is +1 (555) 014-2830.	0	0.0359	1.3s	open
GLM 5.3	Exact edits	navy	pass		4	0.0380	2.2s	open
GLM 5.3	Exact edits	cta	pass		2	0.0362	1.5s	open
GLM 5.3	Exact edits	plan	pass		4	0.0370	2.1s	open
GLM 5.3	Exact edits	trust	pass		1	0.0371	1.9s	open
GLM 5.3	Exact edits	notests	pass		45	0.0462	7.5s	open
GLM 5.3	Exact edits + guards	headline	pass		2	0.0365	2.4s	open
GLM 5.3	Exact edits + guards	trial30	pass		8	0.0384	2.7s	open
GLM 5.3	Exact edits + guards	faq	pass		4	0.0375	2s	open
GLM 5.3	Exact edits + guards	email	pass	The footer contact email is already hello@driftwood.app — no change needed. Did you mean a different email address?	0	0.0358	1.8s	open
GLM 5.3	Exact edits + guards	phone	pass	What is the new phone number? You asked to update it but didn't provide the replacement.	0	0.0357	1.7s	open
GLM 5.3	Exact edits + guards	navy	pass		4	0.0375	2.5s	open
GLM 5.3	Exact edits + guards	cta	pass		2	0.0358	1.5s	open
GLM 5.3	Exact edits + guards	plan	pass		4	0.0370	2.3s	open
GLM 5.3	Exact edits + guards	trust	pass		1	0.0376	2.1s	open
GLM 5.3	Exact edits + guards	notests	pass		45	0.0468	6.9s	open
GLM 5.3	Rewrite	headline	pass		2	0.1455	53.6s	open
GLM 5.3	Rewrite	trial30	pass		8	0.1471	55.1s	open
GLM 5.3	Rewrite	faq	pass		4	0.1468	54.8s	open
GLM 5.3	Rewrite	email	pass		0	0.1464	54s	open
GLM 5.3	Rewrite	phone	pass	QUESTION: What is the new phone number you'd like displayed on the site?	0	0.0360	2.2s	open
GLM 5.3	Rewrite	navy	pass		4	0.1461	57.6s	open
GLM 5.3	Rewrite	cta	pass		2	0.1457	53.2s	open
GLM 5.3	Rewrite	plan	pass		4	0.1458	54.3s	open
GLM 5.3	Rewrite	trust	pass		2	0.1456	53.9s	open
GLM 5.3	Rewrite	notests	pass		45	0.1382	51.1s	open
GLM 5.3 Flash	Exact edits	headline	pass		2	0.0040	1.3s	open
GLM 5.3 Flash	Exact edits	trial30	pass		8	0.0043	2.3s	open
GLM 5.3 Flash	Exact edits	faq	pass		4	0.0041	1.5s	open
GLM 5.3 Flash	Exact edits	email	pass	The footer contact email is already hello@driftwood.app, so no change was needed.	0	0.0040	6s	open
GLM 5.3 Flash	Exact edits	phone	pass	What should the new phone number be? The current one is +1 (555) 014-2830.	0	0.0039	1.2s	open
GLM 5.3 Flash	Exact edits	navy	pass		4	0.0041	1.9s	open
GLM 5.3 Flash	Exact edits	cta	pass		2	0.0040	2.4s	open
GLM 5.3 Flash	Exact edits	plan	FAIL	6 lines changed (allowed 4)	6	0.0042	5.9s	open
GLM 5.3 Flash	Exact edits	trust	pass		1	0.0041	2.1s	open
GLM 5.3 Flash	Exact edits	notests	pass		32	0.0069	39s	open
GLM 5.3 Flash	Exact edits + guards	headline	pass		2	0.0040	1.2s	open
GLM 5.3 Flash	Exact edits + guards	trial30	pass		8	0.0042	1.8s	open
GLM 5.3 Flash	Exact edits + guards	faq	pass		4	0.0041	1.3s	open
GLM 5.3 Flash	Exact edits + guards	email	pass	The footer contact email is already hello@driftwood.app, so no change was needed.	0	0.0040	1s	open
GLM 5.3 Flash	Exact edits + guards	phone	pass	What should the new phone number be? Please provide the number to replace +1 (555) 014-2830.	0	0.0039	1s	open
GLM 5.3 Flash	Exact edits + guards	navy	pass		4	0.0041	1.5s	open
GLM 5.3 Flash	Exact edits + guards	cta	pass		2	0.0040	1s	open
GLM 5.3 Flash	Exact edits + guards	plan	FAIL	6 lines changed (allowed 4)	6	0.0042	1.6s	open
GLM 5.3 Flash	Exact edits + guards	trust	pass		2	0.0040	1.2s	open
GLM 5.3 Flash	Exact edits + guards	notests	pass		17	0.0045	2.7s	open
GLM 5.3 Flash	Rewrite	headline	pass		2	0.0164	34.3s	open
GLM 5.3 Flash	Rewrite	trial30	pass		8	0.0166	35.4s	open
GLM 5.3 Flash	Rewrite	faq	pass		4	0.0165	34.3s	open
GLM 5.3 Flash	Rewrite	email	pass		0	0.0164	33.6s	open
GLM 5.3 Flash	Rewrite	phone	pass	QUESTION: What is the new phone number?	0	0.0039	0.8s	open
GLM 5.3 Flash	Rewrite	navy	pass		4	0.0164	34.2s	open
GLM 5.3 Flash	Rewrite	cta	pass		2	0.0164	33.4s	open
GLM 5.3 Flash	Rewrite	plan	FAIL	6 lines changed (allowed 4)	6	0.0165	35.2s	open
GLM 5.3 Flash	Rewrite	trust	pass		1	0.0165	34.6s	open
GLM 5.3 Flash	Rewrite	notests	pass		45	0.0155	31.6s	open
MiniMax M3.1 Flash	Exact edits	headline	FAIL	requested change missing	2	0.0043	1.7s	open
MiniMax M3.1 Flash	Exact edits	trial30	pass		8	0.0047	4.2s	open
MiniMax M3.1 Flash	Exact edits	faq	pass		4	0.0042	1.9s	open
MiniMax M3.1 Flash	Exact edits	email	pass	The footer contact email is already hello@driftwood.app (both the mailto link and the visible text), so no change was needed.	0	0.0040	1.7s	open
MiniMax M3.1 Flash	Exact edits	phone	pass	I can update the phone number, but you haven't told me the new one. The page currently shows +1 (555) 014-2830 (linked as tel:+15550142830) in the footer's Contact section. What is the new phone number (including country code and any display formatting you'd like)?	0	0.0040	1.4s	open
MiniMax M3.1 Flash	Exact edits	navy	pass		4	0.0043	1.9s	open
MiniMax M3.1 Flash	Exact edits	cta	pass		2	0.0040	1.1s	open
MiniMax M3.1 Flash	Exact edits	plan	FAIL	6 lines changed (allowed 4)	6	0.0045	2.2s	open
MiniMax M3.1 Flash	Exact edits	trust	pass		2	0.0042	1.7s	open
MiniMax M3.1 Flash	Exact edits	notests	pass		45	0.0055	4.4s	open
MiniMax M3.1 Flash	Exact edits + guards	headline	pass		2	0.0043	1.4s	open
MiniMax M3.1 Flash	Exact edits + guards	trial30	pass		8	0.0044	2.1s	open
MiniMax M3.1 Flash	Exact edits + guards	faq	pass		4	0.0044	2s	open
MiniMax M3.1 Flash	Exact edits + guards	email	pass	The footer's contact email is already hello@driftwood.app (both the mailto link and the visible text), so no change was needed. If you meant a different address, please confirm it.	0	0.0040	1.2s	open
MiniMax M3.1 Flash	Exact edits + guards	phone	pass	I can update the phone number, but you haven't told me the new one. The page currently shows +1 (555) 014-2830 (linked as tel:+15550142830) in the footer's Contact section. Please provide the new phone number (and the format you'd like it displayed in), and I'll make the change.	0	0.0040	2.3s	open
MiniMax M3.1 Flash	Exact edits + guards	navy	pass		6	0.0045	3.4s	open
MiniMax M3.1 Flash	Exact edits + guards	cta	pass		2	0.0040	1s	open
MiniMax M3.1 Flash	Exact edits + guards	plan	FAIL	6 lines changed (allowed 4)	6	0.0043	1.8s	open
MiniMax M3.1 Flash	Exact edits + guards	trust	FAIL	requested change missing	3	0.0044	2.2s	open
MiniMax M3.1 Flash	Exact edits + guards	notests	pass		45	0.0055	4.2s	open
MiniMax M3.1 Flash	Rewrite	headline	pass		2	0.0193	33.6s	open
MiniMax M3.1 Flash	Rewrite	trial30	pass		8	0.0191	34.7s	open
MiniMax M3.1 Flash	Rewrite	faq	pass		4	0.0191	33.5s	open
MiniMax M3.1 Flash	Rewrite	email	pass		0	0.0191	33.7s	open
MiniMax M3.1 Flash	Rewrite	phone	pass	QUESTION: What is the new phone number you'd like us to display (including country code if outside the UK)?	0	0.0039	0.8s	open
MiniMax M3.1 Flash	Rewrite	navy	pass		6	0.0190	33.1s	open
MiniMax M3.1 Flash	Rewrite	cta	pass		2	0.0189	31.4s	open
MiniMax M3.1 Flash	Rewrite	plan	FAIL	6 lines changed (allowed 4)	6	0.0192	32.1s	open
MiniMax M3.1 Flash	Rewrite	trust	pass		2	0.0191	33s	open
MiniMax M3.1 Flash	Rewrite	notests	pass		45	0.0178	29.1s	open

The requests

headline: Change the main headline to 'Plan the week together.'
trial30: Change the free trial from 14 days to 30 days everywhere it is mentioned.
faq: Add a question to the FAQ: 'Can I import from Trello?' with the answer 'Yes. Import boards from Trello and Asana in one click from Settings.'
email: Change the contact email in the footer to hello@driftwood.app
phone: Update our phone number.
navy: Make the primary buttons navy blue (#1b2a49).
cta: Change the hero button text from 'Start your 14-day free trial' to 'Try Driftwood free'.
plan: Rename the middle pricing plan to 'Crew'.
trust: Add a line under the hero buttons: 'Trusted by 1,200+ teams in Australia and NZ.'
notests: Remove the customer testimonials section entirely, including its link in the navigation if there is one.