You might also consider reading 15 months and growing.... or Hale's big boy room.
29
Aug Fri 03
New scheduling algorithm
For lack of a better term, I’ll call what I added an algorithm. What it actually represents is a small agent that looks at how often a particular feed produces a new article and adjusts the collection agent’s schedule for that feed (or site). I think this will cut down dramatically on the bandwidth I am using because the default schedule on most feeds is hourly. Also, it is adapting. If some site has a month stretch where there are new feeds several times a day, then that schedule will quickly change or remain in hourly. After a few days of inactivity, or a slower pace, that feed will change to daily.
We’ll see how it works.
written by Kevin in web stuff