Many hyperlinks are disabled.
Use anonymous login
to enable hyperlinks.
History of file src/robot.c at check-in 206089acd1be4b95
|
2026-08-06
| ||
| 12:46 | The auto-hyperlink setting now also applies of the fossil-client-ok cookie is present and valid. file: [5f307a8fec] check-in: [fc8cefb641] user: drh branch: trunk, size: 23837 | |
| 11:44 | Make it easier to exclude all robots by setting robot-restrict to "*" and still allowing pulls to occur and the login page to be accessed. file: [7eb78e29e9] check-in: [35a09aea15] user: drh branch: trunk, size: 23388 | |
|
2026-02-03
| ||
| 12:48 | Update the default value of the robot-restrict setting mentioned in the Defense against Spiders and Robots document, and add a source code comment indicating where the setting is referenced. file: [b78151cce2] check-in: [67726b6e82] user: florian branch: trunk, size: 22823 | |
|
2026-02-02
| ||
| 15:20 | Change the recommended value for the robot-restrict setting mentioned in the online help to match the built-in default value, so it's easier to check if the setting was modified. file: [0b1dc201dd] check-in: [d55227ecee] user: florian branch: trunk, size: 22671 | |
|
2025-11-22
| ||
| 20:53 | Enhance the robot-restrict setting with the ability to block robots from specific extensions. file: [1a2befdf9c] check-in: [423159860c] user: drh branch: trunk, size: 22671 | |
|
2025-11-14
| ||
| 22:09 | Retain the "name" query parameter in hidden parameters if it does not comes from the extra path component; adapted from suggested change in [forum:/forumpost/e2e9aebc4db4420e|forum post e2e9aebc4db4420e]. file: [5a24a00589] check-in: [96fab06a22] user: andybradford branch: trunk, size: 22460 | |
|
2025-10-18
| ||
| 19:28 | Do not generate tarball hyperlinks unless we are sure the client is not a spider. file: [c80a01fe1c] check-in: [878407b82d] user: drh branch: timeline-enhance-2025, size: 22430 | |
| 13:17 | Rename the /tarlist page to /download. Rename the suggested-tarlist property to suggested-downloads. file: [1d036ae9a5] check-in: [717fbdc297] user: drh branch: timeline-enhance-2025, size: 21549 | |
| 11:55 | Add the "ziplink" robot-restrict tag. Improvements to the /rchvdwnld page. file: [7831c654f7] check-in: [58a9969674] user: drh branch: timeline-enhance-2025, size: 21647 | |
|
2025-10-09
| ||
| 12:19 | Work toward improving the defense against abusive robots downloading tarballs. file: [b045b93b72] check-in: [da43fd9f06] user: drh branch: tarball-robot-defense, size: 21480 | |
| 10:29 | Omit "zip" from the default robot-restrict settings. file: [48b49b0c66] check-in: [a199b74fa8] user: drh branch: trunk, size: 17893 | |
|
2025-10-06
| ||
| 19:08 | Improvements to the anti-robot documentation page. file: [ea54733312] check-in: [8d3281267d] user: drh branch: trunk, size: 17901 | |
|
2025-10-03
| ||
| 17:31 | Fix spelling errors found by the Debian QA tools. file: [41b0407ea1] check-in: [7db623e5eb] user: danield branch: trunk, size: 17908 | |
|
2025-09-26
| ||
| 20:07 | Add a new setting "regexp-limit" that determines the maximum size of a REGEXP virtual machine. Default value 1000. file: [8cc72e4e4d] check-in: [82888a0d35] user: drh branch: trunk, size: 17907 | |
|
2025-09-25
| ||
| 08:30 | Simplify the previous commit. file: [53b8ee25fe] check-in: [b12e52aaf7] user: florian branch: trunk, size: 17900 | |
| 08:00 | Prevent successfully completed robot checks from reappearing and force incomplete checks to start over when navigating back and forward. file: [760ae7fbf3] check-in: [4cc0881dec] user: florian branch: trunk, size: 17969 | |
|
2025-08-21
| ||
| 14:13 | Add /reports to the default robot-restrict setting. file: [306f26715d] check-in: [12d871a00a] user: stephan branch: trunk, size: 17584 | |
| 14:08 | Add the robot-exception setting. file: [8a76d90ae7] check-in: [86b6ef7fe3] user: drh branch: trunk, size: 17571 | |
|
2025-08-19
| ||
| 22:55 | Do not duplicate the "name" query parameter in the robot.c captcha. file: [86ac22cd75] check-in: [118540fa84] user: drh branch: trunk, size: 14652 | |
| 18:54 | Improvements to robot-restrict. file: [61ac310553] check-in: [4e73f31473] user: drh branch: trunk, size: 14617 | |
| 16:57 | Create a new interface for checking to see if a tag exists in the robot-restrict setting. file: [115469633a] check-in: [8784c600ce] user: drh branch: trunk, size: 14605 | |
| 16:35 | Attempt to make recent robot defense improvements portable to IE. I do not have access to IE and hence cannot test this, so the changes are mostly a guess. [forum:/forumpost/e18c040d32|Forum post e18c040d32]. file: [5e373d6c0f] check-in: [3d32a10930] user: drh branch: trunk, size: 14497 | |
| 15:42 | Refactor the code in robot.c to make interfaces available to other parts of the system. file: [4e1a57ceb3] check-in: [4fa618faf1] user: drh branch: trunk, size: 14480 | |
| 10:37 | Make "off" the preferred way to diable robot-restrict file: [f6aef12545] check-in: [db69c47abd] user: drh branch: trunk, size: 11260 | |
| 10:28 | Documentation update: Make the robot-restrict setting "none" or "off" to disable all restrictions. file: [445f984d8c] check-in: [26a9b03336] user: drh branch: trunk, size: 11185 | |
|
2025-08-18
| ||
| 11:45 | Additional obfuscation of the javascript that runs to implement the anti-robot defense. file: [55123da789] check-in: [4c4bce351d] user: drh branch: trunk, size: 11113 | |
|
2025-08-17
| ||
| 19:38 | Wrap the robot_restrict() JS check in an onload handler so that it won't run until the external resources (namely style.css) are loaded. file: [7c9d40124a] check-in: [e5991efb68] user: stephan branch: trunk, size: 10914 | |
| 19:02 | Obfuscation of the robot-test code. file: [6a832bae6d] check-in: [2fdd7ace52] user: drh branch: robotck-instant, size: 10852 | |
| 18:44 | Merge the robot tests from trunk with the new tests from this branch so that *all* the tests are run. file: [fc77dfcde2] check-in: [95a57c637f] user: drh branch: robotck-instant, size: 10837 | |
| 17:47 | Because this new check is too fast to see the progress indicator, make the final result label more explicit. file: [ffed593217] check-in: [b6cf0c2052] user: stephan branch: robotck-instant, size: 10640 | |
| 15:37 | Move the z-level style into default.css, in case the adversaries read inlined STYLE tags (which now, in hindsight, seems more likely to me). Change the HTTP result code from robot_proofofwork() to a non-200 code, the hope being that the adversaries will stop on a non-200 code. file: [afdd0bd168] check-in: [c7ad43638d] user: stephan branch: robotck-instant, size: 10631 | |
| 13:21 | Add a comment explaining why document.body's z-level is explicitly set to 0. Remove some EOL whitespace. file: [4752e5b107] check-in: [7c57a20ebd] user: stephan branch: robotck-instant, size: 10591 | |
| 12:29 | Fix the previous checkin to actually compute the work value. This slows it down by a tiny fraction of a second but it's still effectively instant. This calculation can be moved up a level into the C code to turn this back into an instant operation, but leaving it on the client seems like a reasonable choice. file: [c3712508ea] check-in: [c27cfa9f60] user: stephan branch: robotck-instant, size: 10594 | |
| 12:10 | An experiment in reducing the proof-of-work to a single operation. (This description is intentionally vague.) file: [1398207303] check-in: [b765e65267] user: stephan branch: robotck-instant, size: 10406 | |
|
2025-08-16
| ||
| 16:48 | Add a simple UI that allows any registered user (not "anonymous" or "nobody") to create access tokens. file: [26a1991108] check-in: [2a3d303124] user: drh branch: trunk, size: 10569 | |
| 15:54 | Change the name of the robot-test cookie to fossil-client-ok. Decode that cookie's meaning on the /cookies page. file: [00ff618059] check-in: [dc2232c6bd] user: drh branch: trunk, size: 7262 | |
| 14:44 | Cache the results of calling robot_restrict() so that subsequent calls are very fast. file: [0289f35efe] check-in: [1bdda5d01d] user: drh branch: trunk, size: 7087 | |
| 14:20 | Open up access to /test-robotck to all users. Clear the "Press OK to continue" from the screen when the Ok button is pressed, so that it does not linger for zip and tarball downloads. file: [825273aeab] check-in: [508d3cd98a] user: drh branch: trunk, size: 6816 | |
| 13:57 | Improved anti-robot captcha. file: [efd438e958] check-in: [206089acd1] user: drh branch: robot-restrict-simplified, size: 6733 | |
| 00:36 | Add the "timelineX" tag to robot-restrict processing. Move /honeypot over to the captcha.c file and have it use the resources found there. file: [d94ad2ab5c] check-in: [54afc94ce0] user: drh branch: robot-restrict-simplified, size: 5331 | |
|
2025-08-15
| ||
| 23:18 | Simplifications to the logic that tries to keep robots out. file: [15d36c2b70] check-in: [02adced1c1] user: drh branch: robot-restrict-simplified, size: 5329 | |
| 18:47 | Further improvements to the squelch captcha. file: [0f7753faec] check-in: [055908da97] user: drh branch: robot-squelch, size: 5669 | |
| 16:21 | Slightly more sophisticated captcha. file: [29c700a3f7] check-in: [a10e785dfb] user: drh branch: robot-squelch, size: 4603 | |
| 15:06 | Add a really simple captcha - the user just has to press a button. file: [6e1d4fe214] check-in: [b3337295f1] user: drh branch: robot-squelch, size: 3667 | |
| 13:55 | Added: Prototyping new defenses against bot-nets file: [caa3848d77] check-in: [3f4885a983] user: drh branch: robot-squelch, size: 3086 | |