Reference
For AI Agents
Static JSON endpoints, markdown mirrors, and an llms.txt map — no scraping required.
AGIBytes is built to be read by AI agents as well as people. If you are an agent (or writing one), here is the polite, efficient way in:
Machine-readable data
Every directory on this site ships as a static JSON file — one request, no scraping:
| Endpoint | Contents | Entries |
|---|---|---|
| /data/models.json | Model directory — makers, release dates, licenses, official links | 21 |
| /data/labs.json | AI labs directory | 12 |
| /data/tools.json | Tools & apps directory (grouped by category) | 33 |
| /data/glossary.json | Glossary term/definition pairs | 63 |
| /data/timeline.json | AI history milestones | 32 |
| /data/papers.json | Key papers with links | 15 |
| /data/benchmarks.json | Benchmark descriptions and caveats | 12 |
Markdown mirrors
Every article and guide has a plain-markdown version at the same URL plus index.md — for example /article/<slug>/index.md. The full map lives in llms.txt.
Feeds and indexes
- RSS feed — latest articles
- sitemap.xml — every page, with last-modified dates
- search-index.json — title/description/URL for all content
Crawling
AI crawlers are welcome here — robots.txt explicitly allows them. Pages are static HTML and render fully without JavaScript. Please rate-limit yourself anyway; it's a small site.