Why is your AI bill high?
AI coding with large codebases and the real cost of tokens.
In this article series, we look at how better context can make AI coding agents more efficient, more accurate and less expensive.
In Part 1, we looked at why an AI coding agent’s token usage can increase so quickly, and why the number of questions is not necessarily the real problem.
In Part 2, we explored how too much low-relevance information affects both cost and answer quality, and why targeted context works better.
In Part 3, we showed why access to the code alone is not enough if the AI cannot see the dependencies, business rules and the knowledge behind the system.
SOFEEi is not a coding agent, and it does not claim to automatically “understand the entire company”.
SOFEEi is a structured enterprise code and business memory and search layer for AI coding agents.
It helps make a company’s own system knowledge searchable and retrievable: source code, documentation, relationships, dependencies and the context behind business rules. In practice, this means the agent does not have to rely only on the prompt or try to work everything out from an entire codebase before starting a task.
SOFEEi helps the coding agent find:
Important!
Retrieved context does not replace developer review. But it can provide more sources and a better starting point for analysis, impact assessment and preparing a change. This means developers and AI agents can spend less time manually piecing information together from multiple repositories, documents and expert explanations.
One distinction is especially important:
SOFEEi’s goal is to make enterprise code and business knowledge searchable and available to AI agents and developers, especially in complex, business-critical enterprise environments such as IBM i, RPG, COBOL and Java.
You can measure the difference even without SOFEEi.
In other words, simply trying to solve the problem by “giving the LLM as many documents as possible” is usually not a good approach. It tends to be expensive and difficult to maintain.
A good starting point is one specific development task:
Some AI costs are unavoidable: models need to process questions and generate answers. But unnecessary token usage is often a sign that the AI has to spend too much time searching, figuring things out and asking again before it can understand the company’s own system.
A coding agent understands programming, but it does not automatically know your environment, your enterprise dependencies, the reasons behind old decisions or the business rules hidden in the code. Finding the relevant context is therefore not just a minor technical detail. It is one of the things that makes AI use more cost-aware, faster and more responsible from a business perspective.
Can your AI coding agent find the right code and business rule in your system – or do you keep giving it more and more tokens so it can try to work them out?
Tell us your hardest-to-answer system question!
AI coding with large codebases and the real cost of tokens.
Why understanding context matters more than sending more of it.
Why repository access alone is not enough for an AI coding agent.