IBM has developed a new
supercomputer, reputed to be the fastest computer on the face of the planet. It is capable of astounding computational speed. This computer utilizes 131,000 Power PC processors massively paralleled in a hardware setup that would crowd your living space.
Is this design overkill? Before you ridicule this idea, have a read. And then reconsider your personal perception of reality.
I used to program computers for a living. I used a hugely popular sophisticated commercial programming environment with a huge library of functions which were all written in C and assembly language. I also never used the supplied meta functons which provided the high level data browse and search routines, because I discovered that writing my own routines that did the same thing produced much faster and way more efficient, not to mention considerably smaller, data display and manipulation functions, especially as the data sets grew larger and larger.
Complex computer code embedded in large modules are difficult for any programmer to grasp if they have not written the code themselves, and over-documenting the code only adds to the aggravation of that task.
I am of the opinion that IBM likes simple, stupid, linear code, and no matter how intelligent and efficient a modular program is, and no matter how clean and logical the recursion of called functions is, they will invariably reject a clever program for being too smart. I have personal evidence of that fact. They will call the computer code to be "convoluted", or "spaghetti code". This, in spite of the fact that the compiled program may be completely bug free and really very good.
You see, the bottom line is MONEY.
In this world of increasing microprocessor circuit density and ultra-miniaturization there is a fear among large mainframe manufacturers that they are becoming dinosaurs. Their profit strategy lies in hugely over-priced ultra-expensive and very large and imposing metallic boxes that fill a room. If IBM optimized its engineering to produce very fast and very small boxes that fit on a desktop and utilized intelligent generic operating systems and clever software they would soon go out of business.
There once was an intelligent physicist by the name of Williams who took thirteen years to build a computer of his own design because nothing existed at the time to do the work that he needed to do, which was to calculate the probabilities of sub-nuclear particle properties and characteristics in order to prove that each and every particle in existence had its very own unique place in the cosmic scheme of things. By the time he was finished, he could have accomplished the same task by parallelling a couple of Pentium 1's, which were the cutting edge in PC's at the time.
Which begs the question, why does IBM still build them so big? Is there a software problem? Or is it a deliberate strategy to reap huge profits on the sale of appartment sized hardware? I think the latter, myself.
Fact is, we don't need to parallel 131,000 Power PC processors to do the tasks that researchers are demanding of them. What we need is intelligent software, but what I actually see happening is that there are very, very few intelligent programmers out there who are allowed to work outside of a large group in a team environment in a colossal institution. That is one of the reasons that Windows is hundreds and hundreds of megabytes large. Believe me, that is not a good thing.