← All questions
Data, Privacy & LegalHard· Provenance· Fine-tuning· Licensing

A publisher's license allows ingesting content into a retrieval index but forbids using it for training. How do you improve grounding without violating this?

The constraint shifts the problem from quality to provenance. Using licensed text in fine-tuning pairs puts that data into the model weights, which makes the most popular licensed documents highly extractable. You should propose using alternative data for training to teach grounding, while keeping the licensed content in the retrieval index only. The final decision should be empirical: probe the resulting checkpoint against the licensed subset to ensure compliance before deployment.

Code playground (Python)