User-agent: Slurp
Disallow: /*.pdf
Disallow: /*.js
Disallow: /*.gif