# Format is: # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # User-agent: # Disallow: | # Date By Reason # 20050516 Joe Updated disallow rules # 20050601 GW Updated disallow rules for state statutes and constitution pages # 20050629 Joe Updated disallow rules for Environmental Books # ----------------------------------------------------------------------------- User-agent: * Disallow: /us-federal-code/ Disallow: /US-federal-code/ Disallow: /US-Federal-Code/ Disallow: /US-Federal-code/ Disallow: /US-FEDERAL-code/ Disallow: /US-FEDERAL-cODE/ Disallow: /Us-federal-code/ Disallow: /Us-Federal-Code/ Disallow: /US-Federal-Code Disallow: /RankingReport/ Disallow: /rankingreport Disallow: /links.cfm Disallow: /Links.cfm Disallow: /Need-Help.cfm Disallow: /need-help.cfm Disallow: us-federal-code Disallow: US-federal-code Disallow: US-Federal-Code Disallow: US-Federal-code Disallow: US-FEDERAL-code Disallow: US-FEDERAL-cODE Disallow: Us-federal-code Disallow: Us-Federal-Code Disallow: US-Federal-Code Disallow: RankingReport Disallow: rankingreport Disallow: links.cfm Disallow: Links.cfm Disallow: Need-Help.cfm Disallow: need-help.cfm Disallow: stateconstitution.cfm Disallow: Stateconstitution.cfm Disallow: StateConstitution.cfm Disallow: /stateconstitution.cfm Disallow: statestatutes.cfm Disallow: Statestatutes.cfm Disallow: /state-statutes/ Disallow: /State-Statutes/ Disallow: state-statutes Disallow: State-Statutes Disallow: /EnvironmentalBooks/ Disallow: EnvironmentalBooks/ Disallow: /AdLog/