Skip to content
Standard Reader
Log in
Tag

Robots.txt

Articles and publications tagged Robots.txt across the Atmosphere.

4articles4publications
Vincent Breton
Vincent BretonOct 7, 2026
La politique du site vis-à-vis des IA
le point aujourd'hui sur les réponses mises en place face aux robots sur ce site
IAllms.txt
wirres.net
wirres.netJul 3, 2026
immer an die lesenden denken …
robots geben mir bereitwillig auskunft darüber was ihnen an wirres.net gefällt und was nicht. mit den humans ist das schwieriger.
seohumans.txt
Scott Spence
Scott SpenceOct 23, 2023
Making a robots.txt syntax highlighter for VS Code
I was asking ChatGPT to read some posts from my site and summarise them for me, I was a bit surprised when I got the response “I wasn’t able to directly access the URL you provided due to restrictions on the webpage.” from the bot. It was then that...
referenceguide
Anil Dash
Anil DashMay 11, 2001
Robots Bookmarklet
For Andre, the Show Robots.txt) bookmarklet. As Andre correctly pointed out to me, it’s a wonderful thing that we live in a world where we have to write little notes to robots that crawl around the Internet. Stay out, Robot! Go here, Robot! Good Robot. (What’s a robots.txt file?)
bookmarkletrobots

You've reached the end.