A few months back, I posted an essay here about how I think we are entering an age where the personal library will become an asset class unto itself [1]. This is due to a combination of the advent of semantic search and the revival of personal knowledge management in the deluge of our age.
As such, I’ve been working on the software to bring this vision to life, which is called Your Commonbase (a portmanteau of Commonplace Book and Vector Database).
In short, the purpose of the work is to create a data structure that works the way humans store, retrieve, and share information. By making these three elements as close to zero stress as possible, you catalyze creativity through remixing and augmentation of memories. My hypothesis is a lifetime building a Commonbase creates an idiosyncratic system, filled with the interpretations of an individual or a group. This individualized structure then creates demand that others want. I.e, a curation of all of the books you have read, organized by the marginalia you have added to them. This is a system people would pay for, and also a system that becomes more valuable over time.
I’ve been “working in public” by posting updates on my site [2], and am just beginning a small waitlist alpha testing phase (email me if you want in!)
I've read a ton of your writing on this topic. There is still much more, but I'm tired. You described the problem well, and if your software alleviates it, then I see the value.
I'd like to try the software if it'd available please. But I'm not sure where it is or if it's out yet. Is it the Obsidian template you linked here, or is it a separate software called Your Commonbase? Because the Obsidian vault has a different name.
I have to say that the irony is hilarious that I can't find this information in the (well written) sea of information you posted. But then of course I'm not using your solution yet!
The problem with existing knowledge management systems is that they all eventually become victim to scale the operator can no longer manage.
Consider two scenarios:
Scenario 1:
You have a chaotic system of notes, dispersed throughout random pieces of paper and digital notes on your phone and computer. You have a relatively easy go of it when saving new notes (its as simple as pressing "New Note" or pulling out a new sheet of paper), but as you add more notes to your system it becomes harder and harder to find a particular piece of information. The cost of adding stays the same, but searching goes up and up. Scenario 1 causes us to eventually succumb to chaos.
Scenario 2:
You have an extremely rigid system of tag management, headings, sub-headings, sub-subheadings and sub-sub-subheadings. This taxonomy makes it easier to find information...at first. The problem with these systems is that they require a ton of manual maintenance, and they also make it easy to find certain "classes" of information, but fail at geo locating others. Much more perniciously, this scenario eventually stifles creativity as it falls prey to too much order. The cost of searching stays roughly the same, but the cost of insertion goes up and up.
(I am personally guilty of creating a system like this btw [1][2]).
Both of these systems eventually begin to become inert holders of information, as the processor (us), begin to fear them and stop working with them.
IMO, the closest technology to managing human information well in my opinion is well over two thousand years old, the commonplace book [3]. Simply put, a commonplace book is extremely resilient to chaos due to its centrality of information, but even people like John Locke had to create indexes to fully utilize them [4].
This changed recently with the advent of vector databases[5]. It turns out that commonplace book entries are the perfect form factor to benefit from an address in vector space, since entries are atomic. In simpler terms, the vector processing layer handles the order, allowing our system to "live" and assign headings/tags/etc. as it evolves. Vector databases love commonplace books as well, because many vector solutions have way too much noise as they chunk and store useless information at quite a disappointing ratio.
My system differs from current offerings because it makes no attempt to automize parts that are meant for the human, and makes no attempt at making humans do the work computers should be doing. Ergo, creating a type of symbiotic relationship.
Finally, a note on why I use the term "asset". An asset should become more valuable over time, and particularly, each individual component of the overall asset class should be worth more (e.g. $1 in a bank account of $20 is inherently less valuable than $1 in a $20MM bank account, because it grows slower). So in our scenarios above, the transmutation of information to knowledge peaks out at a logarithmic curve, subject to the scale issues I mentioned before. Old entries appear less frequently in even the most ordered systems, and when they do, it is only in one particular context. My system stores time of entry in the metadata, but since I use vector addresses, the information is accessible in many different ways (dog can be found when query == canine, fido, perro, mans best friend, etc...). An informational asset should scale linearly, and each action of create/read/update/delete should improve the health of the overall system.
There's much, much, much more I could say here, but I'll stop for now :)
As such, I’ve been working on the software to bring this vision to life, which is called Your Commonbase (a portmanteau of Commonplace Book and Vector Database).
In short, the purpose of the work is to create a data structure that works the way humans store, retrieve, and share information. By making these three elements as close to zero stress as possible, you catalyze creativity through remixing and augmentation of memories. My hypothesis is a lifetime building a Commonbase creates an idiosyncratic system, filled with the interpretations of an individual or a group. This individualized structure then creates demand that others want. I.e, a curation of all of the books you have read, organized by the marginalia you have added to them. This is a system people would pay for, and also a system that becomes more valuable over time.
I’ve been “working in public” by posting updates on my site [2], and am just beginning a small waitlist alpha testing phase (email me if you want in!)
[1] - https://news.ycombinator.com/item?id=40192359
[2] - https://www.bramadams.dev/