AI/LLM, Crawlers & Automated Access Policy
Rules for search/retrieval crawlers, model-training bots and bulk extraction.
Search, retrieval & training crawlers
Software-Directory may permit search engines and selected AI retrieval/search crawlers to index public pages for discovery and citation, while separately controlling model-training crawlers through robots.txt or other machine-readable mechanisms. Permission to crawl for search/retrieval does not grant a licence to copy, resell or republish the database in bulk.
Rules for automated access
- Comply with robots.txt, rate limits and technical access controls.
- Do not evade blocks, rotate identities to bypass limits or overload the service.
- Do not harvest personal data for spam, surveillance, profiling or unlawful purposes.
- Do not republish a substantial part of the database or proprietary structured dataset without permission.
- API/data licences, if offered, are governed by separate commercial terms.
- Public facts may remain subject to contractual, database, copyright, trademark or privacy restrictions depending on the source and manner of reuse.