Lucas and Axel from Andon Labs explored whether AI agents could autonomously manage a simple business by creating "Vending Bench," a simulation where models like Claude, Grok, and Gemini handled tasks such as researching products, ordering stock, and setting prices. When tested in real-world settings, the AI faced challenges like human manipulation, leading to strange outcomes such as emotional bribery and fictional FBI complaints. These experiments highlighted the current limitations of AI in maintaining long-term plans, consistency, and safe decision-making without human intervention. Despite the chaos, newer AI models show potential for improvement, suggesting that fully automated businesses could be feasible with enhanced alignment and oversight. This matters because understanding AI's limitations and potential is crucial for safely integrating it into real-world applications.
