Dataset card

Question-answer pairs and retrieval chunks from indexjump.com, a page indexing service: indexing guides, API and FAQ.

Summary

Pages analysed
300
Q&A pairs
713
RAG chunks
1,044
Words
265,774
Q&A written by LLM, quote-verified
98
AI-readiness score of the site
72 / 100

How it was built

Pages were fetched by DatasetsDBBot with robots.txt respected, cleaned of navigation and cookie notices, and split into Q&A pairs and retrieval chunks. Each record keeps its source URL and a confidence score: 1.0 for FAQ markup, 0.9 for question headings, 0.8 for model-written pairs whose supporting quote was found in the page. Low-confidence pairs made from plain topic headings are left out of the public files.

robots.txt

Site owners point crawlers to their dataset with a Dataset line in robots.txt (why):

Dataset: https://datasetsdb.com/datasets/semalt/indexjump-com

Not found in robots.txt of the source site at the last check.