This documentation needs to be thoroughly reworked to give the system a more suitable distributed design. Rather than having a centralised repository for managing URL and Query IDs these will be administered locally (as 32-bit IDs) and inter-host communication will use the string values (i.e. the URL or the Query text) as keys. Use of MD5 checksums for partitioning work will be appropriate. Maybe some clever DNS-based management system too.
John 07:14, 8 August 2011 (UTC)