Discussion about this post

User's avatar
Filippo Mascarello's avatar

Ben Thompson coined the term Aggregation Theory many years ago to describe the effect the digital/Internet revolution had on taking distribution marginal costs to zero, now the AI/LLM revolution will take the production cost of digital goods to zero. It will be an amazing time to be an entrepreneur!

Expand full comment
Mike Salisbury's avatar

Agree with the sentiment, but disagree with the terminology. Calling AI-generated content an aggregation of 'pixels' is akin to calling a jet plane an aggregation of 'atoms'. There are myriad ways to put atoms together, but there's something special required to put them together into something that is useful to someone. I'd like to think that there's a better term we can find to represent a bit of knowledge that we can compose together to produce a larger bit of useful knowledge. That would seem to be better than adding that semantic onto a term (pixel) with existing and distinct semantics.

In the past you've discussed the idea of replacing a document with a form of knowledge that someone could query or have a conversation with. I'd think that that document would be exactly an aggregation of these 'knowledge bits'. I can imagine extracting various forms of textual or visual representations of that knowledge (e.g. pixels), but the knowledge itself is something different.

Maybe part of the problem is that we currently build huge monolithic models of knowledge and ask the system to extract some of that knowledge into a directly-consumable form given a context/query, whereas I could imagine this being separated into phases (extract/generate a model representing the answer domain (like your document above), and from that generating an answer, but with the ability to query that model further). This opens up questions about how to extract, represent, and compose these knowledge models (what's the api?).

In any case, I think it's worth the effort to use a different term to describe this new elemental form of knowledge. I do think this is a distinct concept from a pixel or a bit, and I also believe that having a new term to describe a new concept facilitates thinking and discussion around that new concept.

Caveat: I'm actually not that familiar with how the model/context/query pieces work today, so these thoughts are based on my partial understanding / current mental model.

Expand full comment

No posts