What we tested
We connected codebase-memory-mcp 0.12.1 to Claude Code through npx and pointed it at a copy of a real project: Ordalin's own Next.js site at commit e0c7a1d, about 460 files in Git. We asked one question that usually takes several searches: where a shared metadata function, withSocial, is defined, what calls it, and which files a change to it would affect. We told the agent to use only the server's tools, not grep or file reads. The index went into the test folder, not the home folder.
What we found
- It connected and listed all 17 tools the README names.
- Four calls answered the question. index_repository built the graph (5,494 nodes, 12,500 edges), search_graph found the function at
src/lib/seo.tslines 24 to 49, trace_path counted 40 callers within three hops, and query_graph listed each caller with its file. The run took 6 turns, 26 seconds and $0.21 at API prices, as reported by Claude Code. - It caught indirect callers. Six pages call two editorial helpers that call
withSocial; a text search for the name would not show those pages. - It missed one file. A text search found 34 files that call the function directly. The graph found 33; the missing one was an MDX page, which it did not parse. The agent's own answer also pointed out that the graph's 34 inbound edges might include more than calls, and that 82 non-source files were not indexed.
- It left little behind. The index took 29 MB, no process was left running after the session, and nothing new appeared in the home folder. The npx download, though, took 320 MB in the npm cache.
This is one question on one project with one model, so read it as an example, not a benchmark.