Monthly Archives: December 2007

The Second Ascent

Positive thoughts to combat the usually-negative tone of the past few years and to set an upbeat plan of action for the next few:

I think my “dark year” may be over. I’m beginning to realize now that there is only one person who can suppress me: me. Perhaps my failure to obtain good training has made my ordeal more difficult, but even at Temple, my ideas are beginning to blossom… and I’m finally being given a chance to pursue them. As for the difficulty of obtaining the training I wanted, I am not responsible for others, and I am not going to be held responsible for the poor decisions others have made. My training is what it is. I am doing what I can. Let society gain returns only to the extent it has invested; I will no longer overwork to compensate for my lack of knowledge. If I live long enough, I have too much talent and too many ideas to be suppressed forever; that is sufficient.

My classwork is finished. I obtained an A- in my last required traditional class, which is sufficient to exempt me from the qualifier altogether. This means all I need to do is pass the preliminary exams (on my research, which I can do now, much less in six months) and defend my dissertation. I’m going to continue on with my dissertation while I wait for feedback, since waiting indefinitely for feedback while doing nothing is a bad idea for making progress.

My idea for extending semidefinite embedding is implemented and working. I haven’t compared the speed or memory requirements, but I imagine it will consume significantly less memory than traditional SDE. After doing the experiments, I’ll put a paper together and it will go off to KDD. It’s completely novel, so if it is rejected, that is their problem; I will no longer assume responsibility for the outcome of others’ decisions. Let it be on their heads; I publish to spread my ideas, not for the fame! Manifold learning is quite an interesting field of research, since, as I mentioned before, it models the cognitive process of abstraction very well. I’m also learning that many things in data mining are guess-and-checks (they like to call it “optimization”, but that’s really what it is – guess, check, move, repeat) on MSE, which is, to put it bluntly, stupid. Gradient descent is probably the optimal stepwise procedure, since the gradient vector points in the direction of maximum ascent by definition, but it’s not optimal in the sense of total convergence: we can converge much faster if we can extrapolate parts of the global MSE curve from local information, which we most certainly can do, especially in the case of polynomials (we know EXACTLY how many roots it will have, we know whether the function is odd or even, and yet we don’t use this information!) We might be wrong, but the error should obey probabilistic bounds, and convergence should still be easy to achieve. I guess I’ll need to figure the error bounds out, even though I hate doing that sort of work.

Anyway, this is a whole class of things to pursue.

The Softee Variations are complete – all seven and a half minutes of them. The theme is something most people would consider trivial, but it really is an excellent theme to write variations to – as evidenced by the fact that I derived a second theme from it, set it at counterpoint with the first (I still have no counterpoint training, but I’ve learned to let my intuition guide me), and still added a third voice in without a problem – and worked with both of these themes for over 7 minutes, making this my longest piece yet. The second theme is simple and translates well into a minor key, after which I overlay a third theme, again loosely based on the first. My musical style is rapidly evolving in the direction I wish it to go – I’m blending the classical theory I’ve learned, the theory I’ve acknowledged I will never learn and thus intuit, and my melodic and fairly modern style. The result is something completely unique. I continue to experiment with orchestration in “Water” and “Painting a Sunrise”, and I am also finding myself establishing my own unique orchestral arrangement, not for the sake of changing things, but because I desire a precise and unique sound from my music. My music will initially be overlooked, because it’s a niche and music is an art, but my scientific work will eventually drive people to examine my artistic work as well if it’s good enough. Since I write music for the sake of the music itself (it compels me to write it down before it is lost forever), I’ll be ready when this happens.

Lower on the list is “Cap”, the capability-oriented programming language. I know how the language syntax will look, but I haven’t figured out how I’m going to compile it yet. I’ve never had the opportunity to take a class in compilers or programming language theory, so I may need to do some reading first. Maybe no one will use it. That’s fine – it models my cognitive processes well and is much more versatile than OO, so these people will simply be left in the dust. I started programming very early and by now I’m very good at it, but I still work in a paradigm that does not model my own cognitive paradigm, which is inhibitory. Once thought and expression are meshed, I’m going to fly.

Following these things (that is, once I have my Ph. D.), I intend to devote myself to my Polymath idea. The job offers continue to stream in, freeing me from the worries of an uncertain financial future and ensuring that I will indeed have the time and resources to devote to such an undertaking. Three students and one faculty member have already praised the idea and given helpful comments where applicable, but I should attempt to organize a larger community around it. It shouldn’t be hard to do so – you’ll be surprised at how many people the current educational system shortchanges simply because they’re capable of handling much, much more than what schools give them. They want to learn in multiple fields – they want to become polymaths. But they can’t. Think of all of the interdisciplinary challenges – we could solve these much more efficiently if we trained individual polymaths instead of devoting teams of specialized experts to them! For example, if I could gain access to laboratory equipment and some better biological training, my knowledge of computational modeling and machine learning would make me excellent at, say, devising cancer treatments (those following the blog have probably noted that I’ve already devised a few, but lack resources to test or refine them). Of course, once given the prerequisite knowledge, insight is universal.

Mathematically, I’m becoming very powerful. Restlessly so, in fact – like having a lot of bottled up energy screaming for release. I need to prove something with all of the new mathematical knowledge I have acquired, so I’m thinking of resuming my divisor function research. Legendre’s conjecture also looks like an interesting question to pursue. The partial failure of my previous approach (what I presented in my divisor function research was actually an intermediate result, not what I set out to prove) was due to a reluctance to use higher, more abstract levels of mathematics. I know better now.

I’ve acknowledged I will never be a particularly excellent pianist. I can perhaps do anything that requires mental effort, but this restriction is physical. I simply cannot compel my hands to move quickly or accurately enough to become an excellent pianist, nor am I sure all of the practice time I would spend attempting would be put to good use. I’ll continue practicing about one hour a day just to steadily increase my proficiency and to maintain my position ahead of everyone else at the recitals.

This is the end of my Dark Year. It’s the beginning of the Second Ascent.

Forgetfulness deprives the watcher of victory…

The sorts of people for whom the best punishment is to simply watch the consequences of their actions unfold tend to be the type that forget what their actions were by the time the consequences roll around, I’ve noticed. If they can’t even remember important actions from day to day, how can they even claim a hold on consciousness?

Neuroplasticity and tool-using behavior

One highly likely reason for neuroplasticity is to compensate for damage. However, the adaptation of the cortex in primates to accommodate new “limbs” connected via a brain-computer interface is also very interesting, and leads me to believe that tool-using behaviors require a certain amount of such plasticity. After all, there’s no good evolutionary reason for the cortex to adapt to new limbs after a certain age… animals don’t grow new limbs. I suppose one important question that this raises is: “does the same degree of neuroplasticity occur in animals that are less prone to tool use?” Hominids, anyway, are pretty good at it, and it wouldn’t surprise me if primates are too. A handful of other animals, such as finches, ravens, and dolphins might also qualify. But that leaves a large number of animals who aren’t known to be prone to tool use. Would they exhibit the same response?

The Viola is Overlooked

I’m taking a well-deserved break from all of the research I’ve been doing recently and finally putting the theme to my water suite on paper. I originally composed it for the piano, but something that… ambient… needs an orchestral treatment to do it justice. I notice that I’m developing a preference for ensembles of strings, harp, and flute, but this one also has a French horn carrying the melody to give it somewhat of a stronger, nobler quality than “Painting a Sunrise”, the other piece I’m currently working on with this orchestral arrangement.

But enough of that; onto the main subject of this post: the viola, as an instrument, is overlooked. Most of the solo string repertoire is created for either violin or cello, and some performers and composers can’t even read viola parts because they’re written on the tenor clef (I’ve written enough string work to be able to read fairly well on the tenor clef myself). Even in an orchestral setting, the viola mostly plays inner harmonizations, which means it’s usually playing second fiddle (pun intended) to the violin. The (first) violin is usually playing the melody, so it is heard, the cello is usually playing the bass, so it is heard, but the poor viola is almost always sandwiched right between the two. It adds something, but people just tend to group the sound into “strings”; it isn’t meant to be picked out.

But while deciding which instrument to harmonize the horn part in my piece to, I noticed that the upper registers of the cello, while nice, had a sort of “hollow” timbre, while the violin was too “stringy” to mesh well with the horn. The viola, however, yields a full, rich sort of sound that fits the horn part perfectly without that sort of “stringy” feel (the string quakes in a way that the horn does not, and for this passage, I wanted a sort of noble but tranquil feel). Though I spent a while tinkering with the ensemble and the dynamics, the final result sounds excellent. This leads me to believe that the viola is overlooked, probably because of the propensity in classical music to follow a traditional ensemble. I guess a single string doesn’t usually play with the horns.

As for the rest of the piece, I’ve also noticed that the harp carries an arpeggiated bassline excellently (I guess that’s why they call it “harp-like!”), even when overlaid with almost any solo instrument. I find myself orchestrating a lot of ascending 6/8 arpeggios in this manner. It works well with the horn (not really the trumpet, though), the flue, the oboe, the violin, the clarinet, and perhaps even the piano. I suppose harp + flute is my favorite combination, though it isn’t suitable to every piece.

Ah, to have the chance to do this more often… and to be able to write a minute of music without having to spend an hour ruminating over what would sound best 🙂

More on the "Knol" thing

Knol is that Google Wikipedia spinoff that I had foreseen about a day before it went public.

Because the site is designed essentially as a “Wikipedia with attribution”, what is going to end up happening in all likelihood is that the people who are credited with the page’s content will actually end up writing fairly little of it. It will fall to others – those working for the expert, if not the general public – to maintain these pages. If Knol becomes sufficiently popular, maintaining a Knol page will become a sort of resume-worthy badge of honor. Because this will help people’s careers, it will become another sort of paper-mill.

Of course, this is precisely the sort of result I’d expect, given the homogeneity I thought existed in Google when I visited. What we’re seeing here is likely the product of a bunch of academics attempting to apply existing concepts in scientific publishing to an online encyclopedia, probably in their 20% time. Unfortunately, as I’ve repetitively stressed, there are many significant problems in the way scientific publishing is conducted, not the least that attribution and work put into the project are often unlinked.

It’s a good idea in theory, but an awful one in practice, not to mention that fragmenting the world’s knowledge is not a good thing. Better to concentrate the efforts of an encyclopedia in one place.

Dissertation – Week 8

A lot of stuff is going on this week, including a conference deadline for two papers, and because it’s still being reviewed, I don’t think I should continue working on my dissertation this week. Once it’s reviewed, I will resume.

I might still write 2 or 3 pages today if I find some free time, though.

Festivals of Light

Hanukkah is called “The Festival of Lights”, but it certainly isn’t the only one – just like flood myths, festivals of light are commonplace in many cultures. Unsurprisingly, they tend to be held in the winter. It is one of the great joys of humanity that it responds to external darkness with internal light, but it makes me wonder what the origin is – the message. Is it defiance of the weather or the long night? An innate comfort defined by a basic human need? A reminder that winter is only transient? A prayer for an easy season? It’s an interesting thing to think upon while driving past all of the decorations. As children, some of us are afraid of the dark – we flee from it. Here, as adults, we appear to be taking a stand against it, however – repelling or perhaps even defiantly challenging it.

Nope, still not getting it

In another example of society not getting it, spinoffs (or should I say variations) of Wikipedia, typically revolving around correction of one of its perceived flaws by somehow restricting access to articles, are sprouting up on the web. Of course, this is more akin to a traditional online encyclopedia, such as Encarta, than Wikipedia, whose very existence is due to the success of using an unrestricted editing process (although it has a fair deal of informal schism and an unacknowledged but well-defined hierarchy within its ranks, as I found out when I was an active contributor – I was one of the first to realize it and that is why I am no longer an active contributor). Wikipedia proves that this model works very well, but some people seem to miss the lesson.

The most ironic ones are the ones that start with Wikipedia’s articles as a base. “Sure, your model doesn’t work, but we’ll use it for what will likely form the majority of content in our encyclopedia”.

(Update: Just saw this a day after posting. Woof!)

More is less

I’m noticing that the more information you put into a paper, the more the reviewers demand (example: add an ROC curve to your new results in addition to class accuracies and suddenly they ask why you didn’t compute one for the old results that you’re citing as well!) This is probably why papers also tend to get needlessly long, which was the subject of another post some months back. Sort of stupid, but that’s what you get for getting people started on your ideas. The ironic thing is that the more a paper gets people to think about similar issues, the more successful it probably is – and yet because of this phenomenon, the less likely it is to be accepted!

If this hypothesis is correct, it would not only indicate that peer review causes rejection of perfectly good papers spontaneously, but that it actively seeks good papers to reject.