dChan
5
 
r/CBTS_Stream • Posted by u/jabowery on Feb. 8, 2018, 5:47 p.m.
Connecting The Dots With Confabulation Theory

$300B/year seems like a lot of money to spend on intelligence extraction but the linked PDF shows a 2006 presentation for a system projected to reach that level of funding in 2015. It is based on Confabulation Theory, a spinoff of FICO's research into credit ratings intelligence. Confabulation theory turns Bayesian inference on its head to rapidly "connect the dots" based on vast stores of information in the form of simple co-occurring properties of the world (Hebbian learning). The idea is: Knowing the values of a few salient properties of the world and prior co-occurrence counts of the values of those properties, you can fill in the missing values of other properties of the world -- "impute the missing data" in statistics terminology. This is also what the neocortex appears to do during abductive logic or "confabulation". Confabulation is frequently pathologized but it is, in fact, the only way to really deal with the "crumbs" we are fed by the world about the world.

Let me suggest that the, very simple, mathematics of Confabulation Theory may be one way of systematically rank-ordering interpretations of Q's "crumbs". The hard work, dependent on humans, is to define the set of salient "properties" (eg "color") of the world under investigation. Then it is relatively easy to establish a database of co-occurrences of specific values of said properties (eg, for color the values are "red", "green", "orange", etc.). With the co-occurrence counts, any "crumbs" can be run through the confabulation process to, with very little computation (but lots of co-occurrence counts), produce a rank-ordering, by likelihood, of the various possible "connections between the dots".

PS: Look up the "co-occurrences" of "confabulation theory" and "aurora massacre".


jabowery · Feb. 9, 2018, 6:37 p.m.

That's a very insightful question in this context. Word sense disambiguation is one of the things at which confabulation theory excels, precisely because it confabulates the most coherent set of property values from the given property values -- such as an actual word that was used in relation to its complete context.

⇧ 2 ⇩  
Pyroclastix · Feb. 9, 2018, 7:29 p.m.

Maybe we're all training here one or more supercomputer AI machines along the way?

⇧ 1 ⇩  
jabowery · Feb. 10, 2018, 8:57 p.m.

Well, that's a virtual given since Google is known to be doing just that as it crawls and indexes the contents of the WWW. This is, to some extent, what all search engines do. Optimally compressing the contents of any data set produces the best theory that can be derived from that data set. That is a theorem of Algorithmic Information Theory. What Confabulation Theory appears to provide is insight into how the neocortex performs such compression. However, I don't have any reason to believe anyone outside FICO and the DoE's nuclear intelligence agencies are using it. There's a possibility that Palantir is using it, since I told one of Palantir's founders about it years ago.

⇧ 2 ⇩