Is an attention heat map sufficient evidence that a mod...

Attention distributions can be adversarial and yield equivalent predictions regardless of the mass assigned to specific tokens. To verify if a chunk was used, drop the chunk and re-run the generation. If the answer remains unchanged, the generator is at fault; if it changes, the prompt or retrieval is the cause. This experiment is cheap and provides definitive evidence compared to relying on heat maps.