In reading David Hornik's recent post over at VentureBlog regarding SEC filings I am encouraged -- in the long-run the market will bear fruit for those that take the time to understand the companies dealt in. That's why I've gone so far as to create my own tool for tracking those stocks and filings of note: Level 12. It is more than just a hobby, it is a need to understand how things work and to hold the companies I hold shares in accountable for their actions. I invest not just by my research, but by my moral barometer and reading the filings allows me to be better informed. I feel that if more people knew what resources were available to them, they'd do the same; hence the project.
The hard part is that the data set it so very large (in terms of records, not so much in terms of actual storage as I do not cache the filings) it takes more than just a single server to keep up. At this time, actually, there are at least 3 agents working, desegregating, and serving up content at any given time throughout the day; and usually there are more, as I have clients on my laptop, the iMac at home, and my G4 at BSU that do some processing when time allows. In the future there will be more and more processing to do as I add some extra features to the system, such as: keyword tagging, tracking the amount -- and fluctuation -- of the particular holdings, as well as merging in market data. Should be fun!
The good news is that I'm looking for help! If you have an interest in the market, some good programming skills, and a want to understand working within some large data drop me a line! help@level12.org