[Upgrading] Recommend to delete cache when upgrading to a major version#19456