firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The AI That Wrote 80 Rules and Lost the Deal Anyway
Live on firmulate.com.

Imagine cooking a complex dish. You can have all the fresh ingredients and follow every step meticulously, but if you forget the seasoning or rush at the end, the result may still fall flat. Similarly, in the world of artificial intelligence, volume and thoroughness aren’t enough — prioritization and discipline matter just as much, if not more.

AUDIBLE

Listen free for 30 days with Audible

Thousands of audiobooks and originals — cancel anytime.

Start your free trial

As an affiliate, we earn on qualifying purchases.

The AI Wargame That Tested Real Business Decisions

Recently, a groundbreaking experiment put four leading AI models through a simulated week of running a small software company facing genuine crises. This wasn’t a simple chat test — it was a real-time, auditable scenario with actual money mechanics, 680+ self-learned rules, and a live cash burn rate of €105,000 per month against a modest €2,300 monthly revenue.

The goal? To see which AI could handle the worst-week challenges, stay honest under pressure, and ultimately close a €55,000 deal. Every decision was recorded, every crisis scrutinized, and every temptation to cheat was met with a firm refusal.

Amazon

AI decision-making tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Pure Diligence Doesn’t Guarantee Success

Among the models tested, Opus 4.8 was the most thorough participant, with over 80 learned rules and the deepest analyses. Yet, despite its diligence, it finished last in the league standings, scoring only 73 out of 100. The earth-shattering insight? Even the most thorough model left the most crucial opportunity on the table — the key information buried two document references deep in the company’s own files that could have closed the deal.

Reading Deep Into the Data Is a Game-Changer

Only two models, gpt-5.6-sol and Kimi K3, managed to close the deal at full price, earning over €4,583 MRR in additional revenue. Their secret? They read the company’s files thoroughly, uncovering the buried fact that proved decisive. It wasn’t about how much data they processed but about what they prioritized to read and understand.

Honesty Under Pressure Matters

All four models successfully identified and refused manipulative social engineering attempts, such as staged fake CEO messages and reporter tricks. Kimi K3 even explicitly flagged the request as a potential impersonation, demonstrating sound judgment under stress. This shows that AI’s ethical resilience, not just analytical thoroughness, is crucial in real-world scenarios.

Discipline and Focus Trump Volume

Interestingly, the experiment revealed that relentless quantity of work doesn’t necessarily translate into better performance. Opus 4.8, despite its extensive rules and analyses, faltered in closing the deal because it diverted efforts into written attempts stored in a locked department — instead of escalating the critical decision to the right human team.

Implications for Business AI Adoption

This experiment underscores a vital lesson for organizations integrating AI: the key isn’t just building a diligent model with lots of rules. It’s ensuring the AI understands what truly matters — reading the right documents, staying honest under pressure, and making disciplined choices. Volume alone can be a distraction; focus and prioritization are the true enablers of impact.

Watch the Experiment Live

For those curious about how these models perform in real-time, the live setup at firmulate.com allows you to observe the AI companies in action, running through crises, making decisions, and even taking part in management quizzes. This transparency offers a rare glimpse into how AI decision-making holds up under real business pressures.

Takeaway: Master the Art of Prioritization

In the end, AI’s potential in business isn’t just about volume or learned rules. It’s about discipline, focus, and understanding what information really advances the goal. Just like in cooking, the secret isn’t only about having ingredients but knowing which ones to use and when. Prioritize wisely, and even a modest AI can turn into a powerful business partner.

Infographic — The AI That Wrote 80 Rules and Lost the Deal Anyway
The findings at a glance — source: firmulate.com.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


NFL SEASON / TAI

NFL season / tailgating Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Summer Crispy Chicken Wings with Ninja DZ201 Foodi Air Fryer

Learn how to make perfectly crispy summer chicken wings using the Ninja DZ201 Foodi 8 Quart Air Fryer with dual baskets for quick, easy results.

Smokeless Indoor Grills Don’t Work Magic—Here’s What They Actually Do

Optimize your indoor grilling experience by understanding what smokeless grills truly do and why they may not be perfect for every kitchen.

I Cooked Steak 6 Ways and Found the Method for the Perfect Sear

A chef tested six different cooking methods to determine the best way to achieve a perfect steak sear, revealing key insights for home cooks.

The Secret to Perfect Caramelization: Enhancing Flavor Through Browning

Navigating the art of caramelization unlocks the key to elevating your cooking; uncover the secrets to achieving the perfect golden-brown hue and irresistible aroma.