How do you handle a compliance requirement to remove a...

Compliance requirements often conflate three things: answering with the current rule, not asserting the old rule, and making the old rule unrecoverable from weights. Retrieval solves the first two via grounding and abstention. However, for the third, continual training is insufficient because it does not guarantee the removal of information. The most honest architecture is a datastore split, which also allows you to maintain historical versions of rules for queries about past standards.