User-agent: * Disallow: /*.js$ Disallow: /*.css$ Disallow: /data/admin/*.txt Disallow: /.gif$ Disallow: /.jpg$ Disallow: /toutiao/*.xml$ Disallow: /xml/*.xml$