Please stop externalizing your costs directly into my face
SourceHut spent20â100%of weekly time mitigating hyperâaggressive LLM crawlers. That work caused dozens of short outages and delayed core projects. The crawlers ignorerobots.txt. They hit costly endpoints likegit blame. They scan full git logs and commits. They rotate randomUserâAgentsand thousands o.. read more Â






