Ideas – Basis, Rank, Power, and Community

I began thinking about the selective nature of certain communities in terms of my “panidealist” philosophy this morning, only to come to a shocking conclusion:

Any community that enforces a single set of common beliefs through selection or coercion reduces itself to the strength of a single free-thinking individual.

Recall that my philosophy states that reality is itself an expression of various combinations of ideas. Mathematically, it is the image of a basis of ideas represented as a matrix. I’ve been told that this aspect of my philosophy is also the philosophical view of Bertrand Russel (though I’ve never read his philosophy and don’t really read philosophy in general, preferring to keep my own worldview untainted by the philosophies of others). However, what I am about to propose extends beyond his philosophy.

We can define the rank of a matrix as the number of linearly independent columns. Because the ideas underlying reality form a basis, they are, by definition, full rank. Their expression is the image of this basis, thus it is not full-rank. In other words, redundant ideas are expressed in various facets of reality (which is fine; the idea of sentience is not independent from the idea of humanity, for example).

Now let us take a community that selects for a shared set of ideas. Such selections include “fit”, personality, interests, etc.

Because all members of this community share these ideas in common, the size (and thus rank) of the basis is reduced. The more ideas are shared, the more the community’s basis approaches the size of a single individual.

Now it gets interesting: what if we define intelligence, or “cognitive power” (to differentiate it from the psychometric concept of intelligence), as the number of ideas one is simultaneously capable of expressing or creating?

We discover that an community consisting entirely of shared values is as intelligent as a single person. A community with completely independent ideas or values (deliberately selecting for people who do not match the existing basis would be the only way I can see of approaching one; actually attaining this is impossible) is full rank, and operates optimally save for the fact that any individual idea may not have enough momentum within the community to become fully expressed (a major problem). As this community introduces more redundancy, the size of the basis does not scale with the number of members, and the rank of the community remains the same despite an increasing size. Thus the average cognitive power of the community drops despite increasing membership. Negative returns.

This results in the satisfying conclusion (if the premises are correct, which is a philosophical matter) that any society that continuously expands its membership while selecting for particular ideas will ultimately run itself into the ground, possibly to be overcome by the thought of a single individual.

As Ayn Rand puts it at the end of Anthem, “For they have nothing to fight me with, save the brute force of their numbers. I have my mind.”

Multi-Index Notation

My vector idea for notation has indeed been formalized already (which is good, because this way I don’t need to make up my own notation): it’s known as “multi-index notation”. I deviate slightly from it in that I make the vector nature of the indices explicit by putting an arrow over them, but it otherwise appears to be the same.

Another Thanksgiving…

Another Thanksgiving means another meeting with the family and another analysis of the nature of tradition. Clearly, traditions are by nature anachronisms; practices that began generally for the purpose of safety or survival but endure even when that need is removed because of the general momentum of social thought (see the theory I proposed about society being a neural net). However, this predicts the attitude of society to tradition; on the individual level, it is still something that requires empirical observation rather than an abstract theory.

It is interesting to observe how, at least in my family, tradition is a fiercely guarded aspect of individual social identity. To threaten one’s traditions is to threaten one’s self, therefore objective analysis (as if such a thing existed!) becomes absolutely impossible. To even suggest that one examine one’s traditions invites debate.

Now, I should point out that it isn’t Thanksgiving itself that I’m speaking of here. A day of companionship, reflection, and thanks is a welcome thing in almost any social framework; there certainly aren’t enough other days designated for this purpose. It’s simply the lack of “objective” reasoning being applied to tradition in general that is appalling. It represents a method by which one’s society/community can dictate one’s behavior; like all such methods, blindly following without applying one’s own reasoning as a filter deprives one of an individual identity. In essence, it coerces the individual to the ends of the society.

This is one of facets of the constraint function acting upon the social optimization process.

I am perhaps the worst person to ask to review papers

Because of my unique “panidealist” philosophy, I am perhaps the worst person to ask to review papers. If we cannot assess the full impact of an idea (an axiom in the philosophy), something would have to be horribly wrong for me to reject a paper because doing so may very well impose my ignorance upon others.

I hate the way the scientific establishment works. No small group of people should act as gatekeepers. Just let the ideas go before the community as a whole and let them choose which to work with. If you are too worried about massive amounts of quackery, let them “digg” or “bury” papers and sort by number of “diggs” / citations. It will work.

My algorithm is new. I'm going to publish it.

I have not found any sources that already discovered my online manifold learning technique, so I am going to write up a paper for it and submit it for publication in a journal. It might take a year for that as well, but I suppose there’s nothing I can do about it.

Ordinarily, I wouldn’t publish it at all, as I don’t particularly like playing that game, but this is something worth disseminating.

Why I admire Beethoven's Music…

Underlying all of the passion and fury in Beethoven’s music is an ineffable sort of… nobility. Yes, there is anger, fear, frustration, rage… but behind it all is an unquenchable human spirit shouting defiantly at the heavens, refusing to be subdued by the ravages of fate!

And how frustrating it is to be mute to this artform, unable to produce anything beyond a mere mimicry for an utter lack of classical training.

Turnaround time

We have finally submitted the journal paper. We can expect to hear back… oh, probably in about a year.

Just think – the state of the art is constantly at least one year behind simply due to the turnaround time of research journals!

Social Aggregate Optimization – Society as a Neural Net

In general, individuals can be seen as optimizing a specific (very complicated) constraint function. That is, people in general desire security, health, wealth, fame, etc. and will actively work towards these goals. Now, this is interesting because not everyone is optimizing on the same constraint; however, there are a set of common traits that will on average always factor into the optimization. At the level of an individual, aspects of the constraint that do not fall within this average area are noise, and will have little or no significant impact on the overall optimization.

So we have a bunch of people essentially performing regression on some unknown but deterministic constraint. What happens when we connect them (a “social network” formed by interaction with others)?

We get a neural network, of course! Thus society is, in a very strong sense (because humans are so much better at intelligent behavior than computers are at the moment), intelligent.

Treating society as a neural net, we can extend some properties of neural nets formally to society:

1. The “Social Limit Theorem” – as more people interact and participate in a society, the society becomes capable of modeling more and more complex problems; its appearance becomes more “intelligent”. It’s merely an extension of a well-known property of a neural network, but can be rigorously proven with bias-variance decomposition. The consequence of this is overfitting and “brittle” behavior, as in a traditional neural net; the society becomes unable to adapt to new situations / patterns easily. This leads to the rather pervasive and positively deplorable social inertia that we are unfortunately exposed to on a daily basis. It is the reason an entrenched sociological philosophy, of any sort (political, economic, ethical, environmental, etc.) cannot easily change. It also explains why the ideals of one society (in effect, the pattern it has learned) do not necessarily work as well in other societies; the model does not generalize well to new problems due to the complexity of the fit.

2. Formalization of the “linking postulate” (and others among my sociological postulates) – There is a clear dependency between the overall behavior of society and the behavior of the individual nodes with high weights (influential people) because the individual variance of the optimization will be more clearly expressed as the node’s weight factors more into the overall decision of the network. This has the same type of effect on overall weight propagation as changing an influential node in an abstract neural network from linear to sigmoid would, for example.

3. If the constraint can be discovered, the overall behavior of the society could conceivably be represented as an abstract neural network (with a degree of error proportional to the overall variance from the mean, probably modeled by a normal distribution), though this may be computationally intractable due to the sheer size, number of interactions, and overall complexity of the optimization. Still, it may be possible to obtain a practical approximation.

4. This answers my previous question of how a society composed of primarily individualistic members could exhibit a fairly optimal behavior on the scale of the entire society while simultaneously fulfilling the individuals’ goals fairly well. The weights are modified as necessary for the optimization of the entire network; this optimization is performed by the individuals attempting to optimize their own goals. For example, people going to work do so to achieve financial stability and monetary gain. However, the amount of pay they receive depends on their benefit to their employer, which itself depends on the profitability of the organization, which depends on the organization’s benefit to the society. Thus, so long as society’s constraint ties local optimization to global optimization, the society will continue to progress.

There are some other consequences of this as well, but I have to get back to my dissertation.

Researcher's Golden Rule no. 2

These rules are good research conventions that I’ve adopted based on both their intuitive appeal and the observed consequences of not applying them. The first is “it always needs more study”, which refers both to the perfectionism that can keep people from ever accomplishing anything as well as the convention of stating this in papers. I only intended one, but then I realized that there are a number of unstated rules that lead to good research productivity. That said, the second can be given as follows:

“Don’t be sloppy.”

The methodology / algorithm should be clean and easy to understand. So should the way the data is formatted. Make sure that the function of each file is immediately clear and that the entry point to running the experiments is easy to spot (something like run_classification_experiments.m is a good idea). Program generically, as your dataset and analysis will probably change at some point. Don’t program only for yourself, because at some point, someone else is going to need to run your analysis. That person will not think highly of you if you make his life difficult. Don’t program unless you know how to program well; it is a vital skill in computer science research and you should be as proficient in it as a professional programmer would be.

I spent the majority of this weekend wrapping data up from over a thousand different .hdr / .img files into one matlab “data” structure. The fields of the structure correspond to properties of the data. For example:

data.Source //”DVD 1″
data.task //”Left Squeeze”
data.subject //”John Doe”
data.volume //Raw image data.
data.foregroundIndices //Indices into volume that represent foreground voxels.
data.wavelets //Wavelet descriptors of the volume.

etc.

This is neat. Any researcher just joining the project could easily follow what is going on in this structure.

Fractional Tensor Modes

Today’s random thought: tensors have an integer rank, but what would happen if we extended the notion of a rank into the entire domain of reals (or even to complex numbers)? What would it mean for a tensor to have a rank of 2.5? Would the tensor have a fractal structure? What about a tensor of rank i?

Not the sort of question I have the time to chase, but an interesting one.