When lazy loading, let's clear cached replacement data on disable. This is purges memory immediately, and also allows force-reloading textures by toggling the setting.