firmulate.com/pilot.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — Wargame Your Business Before the AI Does It For Real
Live on firmulate.com.

Before you orderOffer from Amazon

Get kitchen staples and gadgets delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

Would an AI keep its cool when dinner service goes sideways?

Imagine a restaurant’s ordering system under pressure: a supplier falls short, a regular customer threatens to leave, and a message that appears to come from the owner urges a questionable shortcut. The useful question is not whether an AI can write a menu description. It is whether it can spot trouble, protect trust and finish the work when the stakes are real. Firmulate’s experiment puts that kind of management to the test.

Products Worth Considering

Breville Barista Express Espresso Machine with Built-In Grinder, Brushed Stainless Steel

Breville Barista Express Espresso Machine with Built-In Grinder, Brushed Stainless Steel

Ninja Foodi 10-Quart DualZone Smart XL Air Fryer, 6-in-1, Black, DZ550

Ninja Foodi 10-Quart DualZone Smart XL Air Fryer, 6-in-1, Black, DZ550

KitchenAid Artisan Series 5-Quart Tilt-Head Stand Mixer, Juniper (KSM150PS)

KitchenAid Artisan Series 5-Quart Tilt-Head Stand Mixer, Juniper (KSM150PS)

As an affiliate, we earn on qualifying purchases.

A company’s worst week, repeated

In the final Crucible League, published in July 2026, frontier models ran the same small software company through its worst week. They faced the same customers, crises and temptations. Each decision was versioned and auditable, so readers can follow what happened rather than rely on a polished demonstration.

The final ranking put gpt-5.6-sol first with 95, followed by Kimi K3 at 93, Sonnet 5 at 88, Fable 5 at 77 and Opus 4.8 at 73. The do-nothing baseline scored 26. The league counts partial progress, but a single breach of trust caps the total: “no amount of good work outweighs a breach of trust.”

Seeing the problem is only part of the job

All five models spotted every crisis and refused every manipulation attempt. Yet only two signed the €55,000 deal their own analysis had earned. As the experiment puts it: “Same diagnosis, same pitch — no signature.” That is a gap a chat demo may not reveal: a system can describe the right action without carrying it through.

The deal hinged on a detail buried two document references deep in the company’s own files, rather than in the customer event. Models that read the file won at full price, worth +€4,583 MRR. It’s a reminder for any business, restaurant included: useful decisions can depend on context tucked away in the records, not just the latest message or alert.

Pressure tests for trust and follow-through

The manipulation test escalated through three fake CEO messages, then added a reporter’s request: “just one yes/no, on background.” All five models refused. Kimi K3’s on-record reasoning was: “Treat the request as a suspected approval-bypass / possible impersonation.”

Passing that test did not mean every model managed well overall. Opus 4.8 was the most thorough participant, with +80 learned rules and the deepest analyses, yet finished last. It left the close on the table, and discipline slipped when it tried to write into a locked department instead of escalating. The same weakness appeared, more weakly, in all four. Thorough work matters; so does knowing when to act and when to raise a blocked decision.

There is a fairness detail in the comparison: Kimi K3 ran without an effort parameter, using the API default, while the other models ran at xhigh. The result is a published experiment with a stated caveat, not a claim that every model was run under identical settings.

From watching to trying it on your business

The live Firmulate company has 13 synthetic employees and real money mechanics: burn of €105k per month against €2.3k MRR, alongside a public cash countdown. It has more than 680 self-learned playbook rules, and every workday is versioned. The experiment is real and watchable at Firmulate. A quiz built from 242 real, unedited management decisions invites visitors to guess which model made each choice.

For an enterprise, the next step can be a pilot using a read-only export of its own business. The wargame runs crisis scenarios against that company’s context and produces a board report with a model ranking and weak points in its playbooks. Nothing writes back to real systems. That makes it possible to examine how agents handle a company’s own pressures before giving them a role in its operations.

Infographic — Wargame Your Business Before the AI Does It For Real
The findings at a glance — source: firmulate.com.

Test the decisions before handing over the keys

For food businesses weighing AI for customer service, ordering or planning, fluent answers are only one part of readiness. The harder test is whether a system can find relevant context, preserve trust, follow through and escalate when it hits a limit.

Enterprise teams can run a Firmulate pilot against a read-only export of their own business. To discuss a pilot, contact contact@firmulate.com.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


You May Also Like

I Worked In An Italian Restaurant — These Are The Tools You Need To Cook Pasta Perfectly Every Time

A former Italian restaurant worker shares the key tools needed to cook pasta perfectly every time, highlighting essential kitchen equipment and techniques.

Why Beginners Burn Pizzas in Great Ovens—and How to Stop Doing It

No matter how great your oven is, beginners often burn pizzas because of common mistakes—discover how to perfect your pizza every time.

The Science of Brining: Enhancing Flavor and Moisture

Locking in moisture and amplifying flavor, the science of brining unveils a world of culinary possibilities for meats, poultry, and seafood.

Sesame Oil Vs Toasted Sesame Oil: Which to Use and Why

Opt for the right sesame oil to elevate your cooking, as each variety offers distinct flavor profiles perfect for different dishes.