Dataset card
Question-answer pairs and retrieval chunks from trustburn.com company review pages: ratings, review summaries and FAQ about listed companies.
Summary
- Source website
- https://trustburn.com/
- Pages analysed
- 3,000
- Q&A pairs
- 1,582
- RAG chunks
- 6,715
- Words
- 1,627,423
- Q&A written by LLM, quote-verified
- 131
- AI-readiness score of the site
- 82 / 100
How it was built
Pages were fetched by DatasetsDBBot with robots.txt respected, cleaned of navigation and cookie notices, and split into Q&A pairs and retrieval chunks. Each record keeps its source URL and a confidence score: 1.0 for FAQ markup, 0.9 for question headings, 0.8 for model-written pairs whose supporting quote was found in the page. Low-confidence pairs made from plain topic headings are left out of the public files.
robots.txt
Site owners point crawlers to their dataset with a Dataset line in robots.txt (why):
Dataset: https://datasetsdb.com/datasets/semalt/trustburn-com
Not found in robots.txt of the source site at the last check.