Timeline
Not logged in

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

40 timeline items

2013-12-21
00:29
[af7df126ca] Leaf: improving gui and responsiveness (user: jrogers, tags: trunk)
2013-12-12
02:50
[9677abf989] add "qack" - "qa crawl keeper" - gui version of crawler. initial version (user: jrogers, tags: trunk)
02:50
[533d3f7731] track link sources (user: jrogers, tags: trunk)
02:49
[3a5c1e1ed0] track source of links (user: jrogers, tags: trunk)
02:49
[0613cc06e1] refactor for command-line options add port mapping ability (user: jrogers, tags: trunk)
02:47
[1a8c2fe6e4] cleaning up validation (user: jrogers, tags: trunk)
02:46
[0201026d7a] add google-rank type thing (user: jrogers, tags: trunk)
2013-09-12
23:39
[1232ac487d] Leaf: removed vwait and update commands replaced jiffy accounting with a more simple scheme that should have about the same effect (user: pooryorick, tags: pyk)
2013-07-23
18:51
[c7e676d1d5] added start of css parser (user: jrogers, tags: trunk)
2013-06-07
01:18
[afbb61c5d9] millis -> micros for better resolution (user: jrogers, tags: trunk)
2013-06-06
22:31
[645a77d908] change "clock clicks" to "clock millis" - stop wraparound problems (user: jrogers, tags: trunk)
22:30
[85181060bb] update from other working copy (user: jrogers, tags: trunk)
2013-01-03
19:56
[68b5b842f8] keep all references to a link, to report multiple sources for broken links (user: jrogers, tags: trunk)
2012-07-26
00:04
[d20be14de2] improve robots loading (user: jrogers, tags: trunk)
2012-07-25
04:55
[492d5f6766] add host column to db (user: jrogers, tags: trunk)
03:20
[fa773831f5] add crawlq main script (user: jrogers, tags: trunk)
01:21
[c024a6f394] break apart db-queued multithread crawler (user: jrogers, tags: trunk)
2012-07-19
07:14
[46ba98ec58] Leaf: initial add of crawlq (sqlite database backed crawler) (user: jeffr, tags: trunk)
2012-03-27
22:26
[6fbc67eeb0] add getattr proc for consistently parsing attributes (user: jrogers, tags: trunk)
2012-01-26
18:46 • Changes to wiki page hr-proxy (user: anonymous)
2011-10-18
22:02
[6db86c82d9] added gradual increasing of rate/load (user: jrogers, tags: trunk)
2011-10-17
22:15
[674060936b] micro-tuning for MAXIMUM speed. It's now SLIGHTLY faster. Sometimes. (user: jrogers, tags: trunk)
2011-10-13
19:24
[ebe1c999fc] added ability to get paramters from file. Some other tweaks too. (user: jrogers, tags: trunk)
2011-01-27
00:22
[5ab2331b23] improve usage message; trap case where no urls passed (user: jrogers, tags: trunk)
2010-10-28
22:45 • Changes to wiki page Web Tools (user: evilotto)
22:35
[97f9221388] reorganizing (user: jrogers, tags: trunk)
22:34 • Changes to wiki page webtest (user: evilotto)
22:25 • Changes to wiki page Web Tools (user: evilotto)
22:25
[25755d4d64] added webtest files (user: jrogers, tags: trunk)
22:01 • Changes to wiki page hr-proxy (user: evilotto)
21:55 • Changes to wiki page crawl (user: evilotto)
21:49 • Changes to wiki page Web Tools (user: evilotto)
19:58
[45d0b16402] imported various versions of redirecting proxy (user: jrogers, tags: trunk)
19:37
[b22c5cad1f] rearranging (user: jrogers, tags: trunk)
19:15
[49d7692eca] remove some junk (user: jrogers, tags: trunk)
19:14 • Changes to wiki page Web Tools (user: jrogers)
18:41
[d54447df75] Leaf: initial empty check-in (user: evilotto, tags: trunk)
18:36
[91d87a70fd] added flag to write broken links to a file detect broken links (404 errors) handle get timeouts better handling of anchor-only links implemented 'exit after time' flag track link sources to command line and through redirects (user: jrogers, tags: trunk)
2010-03-30
23:04
[0fd3433a50] initial add (user: jrogers, tags: trunk)
23:03
[87bea19dca] initial empty check-in (user: jrogers, tags: trunk)