This reminds me of the "Compulsive Programmer" chapter in "Computer Power and Human Reason" (c. 1976), and also of how I used to write code when I first started - way before LLMs were a thing and also before I studied proper engineering. That kind of unfortunately common type of programmer follows exactly the hook-loop model, except instead of relying on an LLM to randomise the result of each loop iteration you do it yourself by proceeding without really trying to understand the problem.
I think this is a basic feature of programming, where a single iteration of trial and error is very fast and cheap, and where you can very easily have something that looks like it works without knowing why or even if it does. ChatGPT removes technical barriers and friction, sure, but programming was already kinda cooked. I would be interested in whether generative tools make this approach feasible in other more mature technical disciplines.
Also, that chapter in Computer Power is well worth a read on its own, as a finely aged sneer at computering under the assumption that enough computering is a good substitute for understanding anything else.
