Dataset card
Question-answer pairs and retrieval chunks from semalt.com: SEO and AI SEO services, rank tracking, case studies and FAQ.
Built for testing retrieval and assistants on SEO product knowledge.
Summary
- Source website
- https://semalt.com/
- Pages analysed
- 45
- Q&A pairs
- 261
- RAG chunks
- 135
- Words
- 32,905
- Q&A written by LLM, quote-verified
- 129
- AI-readiness score of the site
- 83 / 100
How it was built
Pages were fetched by DatasetsDBBot with robots.txt respected, cleaned of navigation and cookie notices, and split into Q&A pairs and retrieval chunks. Each record keeps its source URL and a confidence score: 1.0 for FAQ markup, 0.9 for question headings, 0.8 for model-written pairs whose supporting quote was found in the page. Low-confidence pairs made from plain topic headings are left out of the public files.
robots.txt
Site owners point crawlers to their dataset with a Dataset line in robots.txt (why):
Dataset: https://datasetsdb.com/datasets/semalt/semalt-com
Not found in robots.txt of the source site at the last check.