**Build scan:**
https://gradle-enterprise.elastic.co/s/swrn2vccdizu6/tests/:qa:smoke-test-http:javaRestTest/org.elasticsearch.http.ClusterStateRestCancellationIT/testClusterStateRestCancellation

**Reproduction line:**
`./gradlew ':qa:smoke-test-http:javaRestTest' --tests "org.elasticsearch.http.ClusterStateRestCancellationIT.testClusterStateRestCancellation" -Dtests.seed=2034D67B43AAFEF0 -Dtests.locale=ca -Dtests.timezone=Europe/Madrid -Druntime.java=17`

**Applicable branches:**
main

**Reproduces locally?:**
No

**Failure history:**
https://gradle-enterprise.elastic.co/scans/tests?tests.container=org.elasticsearch.http.ClusterStateRestCancellationIT&tests.test=testClusterStateRestCancellation

**Failure excerpt:**
```
java.lang.IllegalStateException: unable to launch a new watch service

  at __randomizedtesting.SeedInfo.seed([2034D67B43AAFEF0:A2A0FB19FD8E07BE]:0)
  at org.elasticsearch.reservedstate.service.FileSettingsService.startWatcher(FileSettingsService.java:271)
  at org.elasticsearch.reservedstate.service.FileSettingsService.startIfMaster(FileSettingsService.java:142)
  at org.elasticsearch.reservedstate.service.FileSettingsService.doStart(FileSettingsService.java:116)
  at org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:43)
  at org.elasticsearch.node.Node.start(Node.java:1372)
  at org.elasticsearch.test.InternalTestCluster$NodeAndClient.startNode(InternalTestCluster.java:982)
  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
  at java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:820)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
  at java.lang.Thread.run(Thread.java:833)

  Caused by: java.io.IOException: User limit of inotify watches reached

    at sun.nio.fs.LinuxWatchService$Poller.implRegister(LinuxWatchService.java:264)
    at sun.nio.fs.AbstractPoller.processRequests(AbstractPoller.java:266)
    at sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:364)
    at java.lang.Thread.run(Thread.java:833)

```
server/src/test/java/org/elasticsearch/reservedstate/service/FileSettingsServiceTests.java
}).start();
            return new ReservedStateChunk(Collections.emptyMap(), new ReservedStateVersion(1L, Version.CURRENT));
        }).when(spiedController).parse(any(String.class), any());
        service.start();
        assertTrue(service.watching());
        Files.createDirectories(service.operatorSettingsDir());
        
        Files.write(service.operatorSettingsFile(), "{}".getBytes(StandardCharsets.UTF_8));
        
        
        assertTrue(processFileLatch.await(30, TimeUnit.SECONDS));
        
        service.stop();
        assertFalse(service.watching());
        service.close();
        
        deadThreadLatch.countDown();
    }
    @SuppressWarnings("unchecked")
    public void testStopWorksIfProcessingDidntReturnYet() throws Exception {
        var spiedController = spy(controller);
        var fsService = new FileSettingsService(clusterService, spiedController, env, nodeClient);
        FileSettingsService service = spy(fsService);
        doAnswer(i -> clusterAdminClient).when(service).clusterAdminClient();
        CountDownLatch processFileLatch = new CountDownLatch(1);
        CountDownLatch deadThreadLatch = new CountDownLatch(1);
        doAnswer((Answer<ReservedStateChunk>) invocation -> {
            
            
            Thread.sleep(1_000);