User-Agent: *
Disallow:/cache/
Disallow:/download/
Disallow:/email/
Disallow:/extra/
Disallow:/extras/
Disallow:/htmlarea/
Disallow:/media/
Disallow:/pub/
Disallow:/temp/
Disallow:/rss/
Disallow:/ajaxzip2/
Disallow:/*checkout*/
Disallow: /*.gif$
Disallow: /*.jpg$
Disallow: /*.jpeg$


Sitemap : http://spiderweb.jp/sitemap.xml