<!-- If you need to report a security issue please visit https://github.com/apache/dubbo/security/policy -->

- [ ] I have searched the [issues](https://github.com/apache/dubbo/issues) of this repository and believe that this is not a duplicate.

### Environment

* Dubbo version: 3.1.1
* Operating System version: xxx
* Java version: xxx

### Steps to reproduce this issue

1. xxx
2. xxx
3. xxx

Pls. provide [GitHub address] to reproduce this issue.

### Expected Behavior

<!-- What do you expect from the above steps？-->

### Actual Behavior

![image](https://user-images.githubusercontent.com/9292748/209817200-def8712e-1992-4cc6-987c-d872d89a493c.png)

配置一个应用级配置，有三个接口，但是最后元数据刷新的却只有一个接口，另外两个接口的timeout 还是不变，重启后才变
<!-- What actually happens? -->

If there is an exception, please attach the exception trace:

```
Just put your stack trace here!
```

this.exporter = exporter;
        }
        @Override
        public void unexport() {
            String key = getCacheKey(this.originInvoker);
            bounds.remove(key);
            Registry registry = RegistryProtocol.this.getRegistry(getRegistryUrl(originInvoker));
            try {
                registry.unregister(registerUrl);
            } catch (Throwable t) {
                logger.warn(INTERNAL_ERROR, "unknown error in registry module", "", t.getMessage(), t);
            }
            try {
                if (subscribeUrl != null) {
                    Map<URL, NotifyListener> overrideListeners = getProviderConfigurationListener(subscribeUrl).getOverrideListeners();
                    NotifyListener listener = overrideListeners.remove(registerUrl);
                    if (listener != null) {
                        if (!registry.isServiceDiscovery()) {
                            registry.unsubscribe(subscribeUrl, listener);
                        }
                        ApplicationModel applicationModel = getApplicationModel(registerUrl.getScopeModel());
                        if (applicationModel.getModelEnvironment().getConfiguration().convert(Boolean.class, ENABLE_CONFIGURATION_LISTEN, true)) {
                            for (ModuleModel moduleModel : applicationModel.getPubModuleModels()) {
                                if (moduleModel.getServiceRepository().getExportedServices().size() > 0) {
                                    moduleModel.getExtensionLoader(GovernanceRuleRepository.class).getDefaultExtension()
                                        .removeListener(subscribeUrl.getServiceKey() + CONFIGURATORS_SUFFIX,
                                            serviceConfigurationListeners.remove(subscribeUrl.getServiceKey()));
                                }
                            }
                        }