One way to bypass teh linear model is to do what humans do - use groups and use the techniques Edward De Bono espoused. So use a few LLMs to replicate these ideas using the API to let them interact. Yes, much more costly to run, but this reinforces my contention that we should run these LLMs locally. What we may need is models that are trained to interact and work through more complex problems, rather than re-architecting the LLMs to take the more convoluted approach itself. In some sense, the aim is to create a hive-mind, using different models with different training and expertise, yet able to work together to solve complex problems, just as humans can do.
One way to bypass teh linear model is to do what humans do - use groups and use the techniques Edward De Bono espoused. So use a few LLMs to replicate these ideas using the API to let them interact. Yes, much more costly to run, but this reinforces my contention that we should run these LLMs locally. What we may need is models that are trained to interact and work through more complex problems, rather than re-architecting the LLMs to take the more convoluted approach itself. In some sense, the aim is to create a hive-mind, using different models with different training and expertise, yet able to work together to solve complex problems, just as humans can do.