I created a maven archetype for stormcrawler and Opensearch. I brought the Opensearch dashboard up and set the username and password. But when I start the storm crawl topology it fails when the sniffer tries to connect. This is the stack dump
Any help will be appreciated
15:48:12.246 [Thread-38-filter-executor[4, 4]] INFO o.a.s.u.ConfigurableHelper -
Setup RegexURLFilter[org.apache.stormcrawler.filtering.regex.RegexURLFilter]
15:48:12.246 [Thread-38-filter-executor[4, 4]] INFO o.a.s.u.ConfigurableHelper – Setup SelfURLFilter[org.apache.stormcrawler.filtering.basic.SelfURLFilter]
15:48:12.246 [Thread-38-filter-executor[4, 4]] INFO o.a.s.u.ConfigurableHelper – Setup SitemapFilter[org.apache.stormcrawler.filtering.sitemap.SitemapFilter]
15:48:12.246 [Thread-38-filter-executor[4, 4]] INFO o.a.s.e.b.BoltExecutor – Prepared bolt filter:[4]
15:48:12.350 [opensearch_rest_client_sniffer[T#1]] ERROR o.o.c.s.Sniffer – error while sniffing nodes
org.apache.http.ConnectionClosedException: Connection is closed
at org.opensearch.client.RestClient.extractAndWrapCause(RestClient.java:942) ~[crawler-0.9.jar:?]
at org.opensearch.client.RestClient.performRequest(RestClient.java:333) ~[crawler-0.9.jar:?]
at org.opensearch.client.RestClient.performRequest(RestClient.java:321) ~[crawler-0.9.jar:?]
at org.opensearch.client.sniff.OpenSearchNodesSniffer.sniff(OpenSearchNodesSniffer.java:122) ~[crawler-0.9.jar:?]
at org.opensearch.client.sniff.Sniffer.sniff(Sniffer.java:223) ~[crawler-0.9.jar:?]
at org.opensearch.client.sniff.Sniffer$Task.run(Sniffer.java:154) ~[crawler-0.9.jar:?]
at org.opensearch.client.sniff.Sniffer$1.run(Sniffer.java:95) ~[crawler-0.9.jar:?]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572) ~[?:?]
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.base/java.lang.Thread.run(Thread.java:1583) [?:?]
Caused by: org.apache.http.ConnectionClosedException: Connection is closed
at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.endOfInput(HttpAsyncRequestExecutor.java:356) ~[crawler-0.9.jar:?]
at org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:261) ~[crawler-0.9.jar:?]
at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:87) ~[crawler-0.9.jar:?]
at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:40) ~[crawler-0.9.jar:?]
at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114) ~[crawler-0.9.jar:?]
at org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162) ~[crawler-0.9.jar:?]
at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337) ~[crawler-0.9.jar:?]
at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315) ~[crawler-0.9.jar:?]
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276) ~[crawler-0.9.jar:?]
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) ~[crawler-0.9.jar:?]
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591) ~[crawler-0.9.jar:?]
… 1 more
15:48:12.350 [opensearch_rest_client_sniffer[T#1]] ERROR o.o.c.s.Sniffer – error while sniffing nodes
org.apache.http.ConnectionClosedException: Connection is closed
at org.opensearch.client.RestClient.extractAndWrapCause(RestClient.java:942) ~[crawler-0.9.jar:?]
at org.opensearch.client.RestClient.performRequest(RestClient.java:333) ~[crawler-0.9.jar:?]
at org.opensearch.client.RestClient.performRequest(RestClient.java:321) ~[crawler-0.9.jar:?]
at org.opensearch.client.sniff.OpenSearchNodesSniffer.sniff(OpenSearchNodesSniffer.java:122) ~[crawler-0.9.jar:?]
at org.opensearch.client.sniff.Sniffer.sniff(Sniffer.java:223) ~[crawler-0.9.jar:?]
at org.opensearch.client.sniff.Sniffer$Task.run(Sniffer.java:154) ~[crawler-0.9.jar:?]
at org.opensearch.client.sniff.Sniffer$1.run(Sniffer.java:95) ~[crawler-0.9.jar:?]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572) ~[?:?]
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]