Sample work · AI & Automation
Web Crawl: Pages scraped and converted to Markdown for chatbots and analysis
Public websites are scraped and saved as clean Markdown with preserved links, for example as a knowledge base for a chatbot or for data analysis. Tested on three real, public pages.
Sample work (demo), not a client job. Built as a trial task with invented example data; the check figures below come from the automatic test run and are not polished.
What was built
- Page content as Markdown, headings and links are preserved
- One file per page, directly usable for chatbot knowledge or analysis
- Only public pages, no login into third-party accounts
Download example-com.md Download gltools-startseite.md Download gltools-beispiele.md
How it was checked
Automatic test run on 2026-10-31, taken from the log (test data invented, figures measured):
- https://www.gltools.de/: 44487 characters of Markdown, content and links preserved
- https://www.gltools.de/beispiele/: 35056 characters of Markdown, content and links preserved
- https://example.com/: 959 characters of Markdown, content and links preserved
Limits
What this sample does not cover, so nobody expects more:
- Firecrawl free tier: 1,000 pages per month - larger crawls only upon consultation (costs)
- Only public pages; robots.txt and website terms of use apply; no login into third-party accounts
- Output: Markdown/JSON per page, for RAG, chatbots or data analysis
Something like this for your business?
Describe briefly what you need. You get a fixed price before I start; nothing happens without your yes.