Your RAG index might be mostly sidebar.
On 30 LlamaIndex docs pages:
- SimpleWebPageReader: 362,849 tokens
- Website Content Crawler: 44,813 tokens
That's 8x fewer tokens. 86% of the extra text was navigation repeated on every page.
blog.apify.com/llamaindex-r...
#LlamaIndex #RAG
