Eagerness about artificial intelligence has led to a competitive push at tech companies to use as much AI as possible in a trend called tokenmaxxing. Employers are happily spending thousands to keep up with output, but whether the practice is sustainable is up for debate.
What is it? At the core of the AI workplace trend are tokens. They represent small bits of text that AI models process during a prompt, and their use helps track AI usage and calculate costs. AI companies “typically charge a monthly subscription for a fixed allotment of tokens,” with additional usage billed separately or available in higher-tier plans, said Built In.
To achieve tokenmaxxing, employees rack up tokens by deploying multiple agentic AI models on separate projects simultaneously or by running longer prompts. Token budgets are “becoming another form of employee compensation, alongside stock options and yearly bonuses,” said Built In. And while some workers go through millions of tokens a week, employers are “happily footing the bill.”
Is it worth it? The popularity of tokenmaxxing “reflects a desire to incentivize AI usage” and presents the assumption that tokens are the “base unit for AI usage,” meaning “greater consumption indicates higher value of AI,” said Jim Rowan, the U.S. head of AI at Deloitte Consulting LLP, to Forbes. While well-intentioned, there are “risks of turning tokens into a ‘vanity metric.’”
Still, some proponents of the competitive practice push back against such rhetoric. “We all should be tokenmaxxing,” said Sonya Huang, a partner at Sequoia Capital, to The Wall Street Journal.
It’s true that the “cost of training AI models is falling, making AI tokens more affordable,” but people have started using “more tokens in their day-to-day tasks,” said Tom’s Hardware (a sister site of The Week). Though AI is “indeed a useful tool,” some companies are “using it to replace people in a bid to cut labor costs.” If the number of tokens needed to accomplish tasks “outpaces the speed at which these tokens become cheaper, then that move might just backfire.”
|