minus-square100@fedia.iotoLemmy Shitpost@lemmy.world•robots.txt is a suggestionlinkfedilinkarrow-up29arrow-down1·9 days agotime to fill sites code with randomly generated garbage text that humans will not see but crawlers will gobble up? linkfedilink
time to fill sites code with randomly generated garbage text that humans will not see but crawlers will gobble up?