| Job log file Mon Apr 09 09:11:17 PDT 2012 (Monday, April 9, 2012 4:11:17 PM GMT) This log file contains three main sections. The first section is the spider log. The spider log
is generated as our spider crawls your website. It shows what pages our spider has requested from
your server, your server's response, and the new links that the spider finds in each page. The second section contains a summary of how many pages of what type the spider read from your website. It is
followed by Builder log section which includes an alphabetical list of pages included in your search. Please read the log file documentation. Log sections on this page Spider log - our spider's requests and your server's responses
Spider summary - number of bytes and pages read
Builder log - list of pages included in your search Settings in effect for this job | | site id: | 42854964 | | | main url: | http://www.hartwell.pwp.blueyonder.co.uk/ | | | extended document types: | enabled | | | authentication: | none | | | additional starting points: | none | | | user excludes: | none | | | site subsections: | none | | | url matching: | standard |
Spider logtime action url
09:11:25 request get http://www.hartwell.pwp.blueyonder.co.uk/robots.txt
09:11:26 response not found (404) http://www.hartwell.pwp.blueyonder.co.uk/robots.txt 0 bytes
09:11:28 request get http://www.hartwell.pwp.blueyonder.co.uk/
09:11:30 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/ 11,938 bytes
09:11:30 extracted url excluded http://geoffreybh.wordpress.com/ off site
09:11:30 extracted url excluded http://nabtag.com/tagthis/ off site
09:11:30 extracted url excluded http://scholar.google.com/ off site
09:11:30 extracted url excluded http://www.activesearchresults.com/ off site
09:11:30 extracted url excluded http://www.arbitrators-society.org/ off site
09:11:30 extracted url excluded http://www.arbitrators.org/ off site
09:11:30 extracted url excluded http://www.bhacromwell.co.uk/ off site
09:11:30 extracted url excluded http://www.facebook.com/business/dashboard/ off site
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/022.Preparing%20to%20Write%20an%20Award.pdf
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/873Award.pdf
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/Arbitration_Power.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/Bergsten.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/Course_links.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/Geneva%207.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/Introduction.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/Prato.pdf
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/Salzburg_2000.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/appeal.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/bath.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/ethical_code.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/expert.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/gmbhcv.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/intaward.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/nyc_asa.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/tbpic.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/whittl%7E1.htm
09:11:30 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/whoshall.htm
09:11:30 extracted url excluded http://www.iccwbo.org/index_court.asp off site
09:11:30 extracted url excluded http://www.idrc.co.uk/ off site
09:11:30 extracted url excluded http://www.streetmap.co.uk/map.srf?X=528611&Y=163145&A=Y&Z=110 off site
09:11:30 extracted url excluded http://www.tinycounter.com/ off site
09:11:30 extracted url excluded http://www.totalenvironment.co.uk/profile.html off site
09:11:30 extracted url excluded http://www.visualthesaurus.com/ off site
09:11:30 request get http://www.hartwell.pwp.blueyonder.co.uk/bath.htm
09:11:32 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/bath.htm 28,410 bytes
09:11:32 extracted url excluded http://www.hartwell.demon.co.uk/index.htm off site
09:11:32 extracted url excluded http://www.hartwell.demon.co.uk/nyc_asa.htm off site
09:11:32 request get http://www.hartwell.pwp.blueyonder.co.uk/Prato.pdf
09:11:36 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/Prato.pdf 229,848 bytes
09:11:36 file parsed ok http://www.hartwell.pwp.blueyonder.co.uk/Prato.pdf 13 pages
09:11:36 request get http://www.hartwell.pwp.blueyonder.co.uk/tbpic.htm
09:11:37 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/tbpic.htm 29,605 bytes
09:11:37 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/index.htm
09:11:37 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/tb_sect.htm
09:11:37 extracted url excluded http://www.hoteltravel.com/england/london/hotels.htm off site
09:11:37 extracted url excluded http://www.todayinsci.com/Events/Bridges/BridgeTower.htm off site
09:11:37 request get http://www.hartwell.pwp.blueyonder.co.uk/appeal.htm
09:11:39 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/appeal.htm 10,051 bytes
09:11:39 request get http://www.hartwell.pwp.blueyonder.co.uk/expert.htm
09:11:40 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/expert.htm 11,344 bytes
09:11:40 extracted url excluded http://www.xproexperts.co.uk/ off site
09:11:40 request get http://www.hartwell.pwp.blueyonder.co.uk/gmbhcv.htm
09:11:42 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/gmbhcv.htm 20,937 bytes
09:11:42 extracted url excluded #Qualifications: protocol exclude
09:11:42 extracted url excluded http://siac.org.sg/ off site
09:11:42 extracted url excluded http://www.rcakl.org.my/ off site
09:11:42 request get http://www.hartwell.pwp.blueyonder.co.uk/nyc_asa.htm
09:11:44 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/nyc_asa.htm 15,607 bytes
09:11:44 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/nyc_text.htm
09:11:44 request get http://www.hartwell.pwp.blueyonder.co.uk/873Award.pdf
09:11:46 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/873Award.pdf 80,848 bytes
09:11:47 file parsed ok http://www.hartwell.pwp.blueyonder.co.uk/873Award.pdf 23 pages
09:11:47 request get http://www.hartwell.pwp.blueyonder.co.uk/Bergsten.htm
09:11:50 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/Bergsten.htm 140,343 bytes
09:11:50 extracted url excluded http://kompozer.net/ off site
09:11:50 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/www.kluwerlaw.com
09:11:50 extracted url excluded http://www.uncitral.org/uncitral/en/uncitral_texts/arbitration/NYConvention_status.html off site
09:11:50 request get http://www.hartwell.pwp.blueyonder.co.uk/intaward.htm
09:11:52 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/intaward.htm 64,054 bytes
09:11:52 request get http://www.hartwell.pwp.blueyonder.co.uk/whoshall.htm
09:11:54 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/whoshall.htm 35,624 bytes
09:11:54 extracted url excluded http://ourworld.compuserve.com/homepages/arbitrators off site
09:11:54 request get http://www.hartwell.pwp.blueyonder.co.uk/Geneva%207.htm
09:11:58 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/Geneva%207.htm 23,693 bytes
09:11:58 request get http://www.hartwell.pwp.blueyonder.co.uk/whittl%7E1.htm
09:11:59 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/whittl%7E1.htm 7,862 bytes
09:11:59 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/chapter.htm
09:11:59 request get http://www.hartwell.pwp.blueyonder.co.uk/Course_links.htm
09:12:01 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/Course_links.htm 18,837 bytes
09:12:01 extracted url excluded http://cedar.evansville.edu/%7Eecoleweb/glossary/abelard.htm off site
09:12:01 extracted url excluded http://europa.eu.int/comm/dg24/policy/developments/acce_just/acce_just02_en.html off site
09:12:01 extracted url excluded http://members.tripod.com/philosopher_2/heloise.html off site
09:12:01 extracted url excluded http://orb.rhodes.edu/encyclop/culture/Philos/abelard1.htm off site
09:12:01 extracted url excluded http://www.belmont.edu/Humanities/Philosophy/AncientPHI/abelard/poem.htm off site
09:12:01 extracted url excluded http://www.cif.rochester.edu/sa-org/logos/spring96/abe.htm off site
09:12:01 extracted url excluded http://www.execpc.com/%7Epewter/Derek_de_Lint/film_tv/stealing_heaven/thestory.htm off site
09:12:01 extracted url excluded http://www.fordham.edu/halsall/basis/abelard-histcal.html off site
09:12:01 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/Dallah.html
09:12:01 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/IBA_Evidence.htm
09:12:01 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/index.html
09:12:01 extracted url excluded http://www.ilr.cornell.edu/library/research/subjectGuides/adr.html off site
09:12:01 extracted url excluded http://www.perseus.tufts.edu/ off site
09:12:01 extracted url excluded http://www.roga.demon.co.uk/frames.htm off site
09:12:01 extracted url excluded http://www.ronkelly.com/RonKellyMedAct.html off site
09:12:01 extracted url excluded http://www.stanford.edu/group/sccn/mediation/ off site
09:12:01 extracted url excluded http://www.supremecourt.gov.uk/decided-cases/docs/UKSC_2009_0165_Judgment.pdf off site
09:12:01 extracted url excluded http://www.supremecourt.gov.uk/decided-cases/docs/UKSC_2010_0170_Judgment.pdf off site
09:12:01 extracted url excluded http://www.uncitral.org/uncitral/en/uncitral_texts/arbitration/1996Notes_proceedings.html off site
09:12:01 extracted url excluded http://www.utm.edu/research/iep/%20 off site
09:12:01 request get http://www.hartwell.pwp.blueyonder.co.uk/Introduction.htm
09:12:06 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/Introduction.htm 100,276 bytes
09:12:07 request get http://www.hartwell.pwp.blueyonder.co.uk/ethical_code.htm
09:12:10 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/ethical_code.htm 24,311 bytes
09:12:10 request get http://www.hartwell.pwp.blueyonder.co.uk/Salzburg_2000.htm
09:12:12 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/Salzburg_2000.htm 25,208 bytes
09:12:12 extracted new url http://www.hartwell.pwp.blueyonder.co.uk/Paris.htm
09:12:12 request get http://www.hartwell.pwp.blueyonder.co.uk/Arbitration_Power.htm
09:12:14 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/Arbitration_Power.htm 36,110 bytes
09:12:14 request get http://www.hartwell.pwp.blueyonder.co.uk/022.Preparing%20to%20Write%20an%20Award.pdf
09:12:18 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/022.Preparing%20to%20Write%20an%20Award.pdf 103,710 bytes
09:12:19 file parsed ok http://www.hartwell.pwp.blueyonder.co.uk/022.Preparing%20to%20Write%20an%20Award.pdf 18 pages
09:12:19 request get http://www.hartwell.pwp.blueyonder.co.uk/Paris.htm
09:12:20 response not found (404) http://www.hartwell.pwp.blueyonder.co.uk/Paris.htm 0 bytes
09:12:20 request get http://www.hartwell.pwp.blueyonder.co.uk/index.htm
09:12:21 response not found (404) http://www.hartwell.pwp.blueyonder.co.uk/index.htm 0 bytes
09:12:21 request get http://www.hartwell.pwp.blueyonder.co.uk/index.html
09:12:23 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/index.html 11,938 bytes
09:12:23 request get http://www.hartwell.pwp.blueyonder.co.uk/Dallah.html
09:12:25 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/Dallah.html 41,415 bytes
09:12:25 request get http://www.hartwell.pwp.blueyonder.co.uk/chapter.htm
09:12:27 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/chapter.htm 52,086 bytes
09:12:27 extracted url excluded http://www.hartwell.pwpblueyonder.co.uk/index.htm off site
09:12:27 request get http://www.hartwell.pwp.blueyonder.co.uk/tb_sect.htm
09:12:28 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/tb_sect.htm 3,581 bytes
09:12:28 request get http://www.hartwell.pwp.blueyonder.co.uk/nyc_text.htm
09:12:30 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/nyc_text.htm 19,185 bytes
09:12:30 request get http://www.hartwell.pwp.blueyonder.co.uk/IBA_Evidence.htm
09:12:32 response ok (200) http://www.hartwell.pwp.blueyonder.co.uk/IBA_Evidence.htm 18,015 bytes
09:12:32 request get http://www.hartwell.pwp.blueyonder.co.uk/www.kluwerlaw.com
09:12:33 response not found (404) http://www.hartwell.pwp.blueyonder.co.uk/www.kluwerlaw.com 0 bytes
Spider summary| total documents: | 26 | | total bytes: | 1,164,836 | | adjusted bytes: | 886,563 | | document limit: | n/a | | | | document breakdown | | | html documents: | 23 | | pdf documents: | 3 ( 54 pages ) | | word (.doc) documents: | 0 | | powerpoint (.ppt) documents: | 0 | | excel (.xls) documents: | 0 | | rich text (.rtf) documents: | 0 | | open office writer (.sxw) documents: | 0 | | open office impress (.sxi) documents: | 0 | | open office calc (.sxc) documents: | 0 | | open document text (.odt) documents: | 0 | | open document presentation (.odp) documents: | 0 | | open document spreadsheet (.ods) documents: | 0 | | text documents: | 0 |
Builder Loglast-modified date page size status url
no last-modified date 11,938 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/
17:06:58 Oct 13 2009 44,051 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/022.Preparing%20to%20Write%20an%20Award.pdf
17:07:00 Oct 13 2009 51,861 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/873Award.pdf
no last-modified date 36,114 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/Arbitration_Power.htm
no last-modified date 140,479 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/Bergsten.htm
no last-modified date 18,837 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/Course_links.htm
no last-modified date 41,429 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/Dallah.html
no last-modified date 23,697 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/Geneva%207.htm
no last-modified date 18,015 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/IBA_Evidence.htm
no last-modified date 100,278 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/Introduction.htm
17:10:27 Oct 13 2009 40,046 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/Prato.pdf
no last-modified date 25,209 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/Salzburg_2000.htm
no last-modified date 10,051 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/appeal.htm
no last-modified date 28,410 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/bath.htm
no last-modified date 52,087 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/chapter.htm
no last-modified date 24,311 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/ethical_code.htm
no last-modified date 11,344 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/expert.htm
no last-modified date 20,944 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/gmbhcv.htm
no last-modified date 11,938 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/index.html
no last-modified date 64,055 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/intaward.htm
no last-modified date 15,609 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/nyc_asa.htm
no last-modified date 19,185 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/nyc_text.htm
no last-modified date 3,581 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/tb_sect.htm
no last-modified date 29,607 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/tbpic.htm
no last-modified date 7,863 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/whittl%7E1.htm
no last-modified date 35,624 bytes indexed http://www.hartwell.pwp.blueyonder.co.uk/whoshall.htm
|