Parsing single file is easier than navigating a file system for an LLM. Until the models have context windows large enough to hold the entire codebase in one shot, single files will beat multiple files every time.
This. I suspect the codebases in the future will be made of a small number of gigantic source files. These will be able to be transpiled into a more human friendly that produces multiple smaller files per big file in human-debug mode.
As a human who typically uses large files, 10k to 30K lines of code files are pretty common, I find the agents don’t read the whole file after the first time, they almost always do a range select for the bit they are interested in.
Its getting pretty close. Chatgpt can easily figure out your order and find you a restaurant. It just can't do the last mile bit of placing the order itself.
It gave me a riddle for the first digit, but I repeated the riddle back to her which she took as the correct answer.
Then a 20 questions quiz for the second digit which was cool, then a series of clues for the last digit, the last of which was "the last digit is the sum of X and y".
Not saying code quality isn't important - it is. But I think what is described as quality code will change.
reply