I am trying to setup the basic setup of minifi found at https://nifi.apache.org/minifi/getting-started.html. I am running nifi and minifi in a docker container. I’ve buit the config.yml file and put it in the minifi_home/conf directory. Here the log from minifi:
<code>2024-06-05 15:21:37,718 WARN [Timer-Driven Process Thread-1] o.apache.nifi.remote.client.PeerSelector Available peers collection is empty; no peer available
2024-06-05 15:21:42,332 WARN [NiFi Site-to-Site Connection Pool Maintenance] o.apache.nifi.remote.client.PeerSelector Could not communicate with 192.168.210.xx:10000 to determine which node(s) exist in the remote NiFi instance, due to java.net.ConnectException: Connection refused (Connection refused)
2024-06-05 15:21:42,333 WARN [NiFi Site-to-Site Connection Pool Maintenance] o.apache.nifi.remote.client.PeerSelector Unable to refresh remote group peers due to: Unable to retrieve nodes from remote instance
<code>2024-06-05 15:21:37,718 WARN [Timer-Driven Process Thread-1] o.apache.nifi.remote.client.PeerSelector Available peers collection is empty; no peer available
2024-06-05 15:21:42,332 WARN [NiFi Site-to-Site Connection Pool Maintenance] o.apache.nifi.remote.client.PeerSelector Could not communicate with 192.168.210.xx:10000 to determine which node(s) exist in the remote NiFi instance, due to java.net.ConnectException: Connection refused (Connection refused)
2024-06-05 15:21:42,333 WARN [NiFi Site-to-Site Connection Pool Maintenance] o.apache.nifi.remote.client.PeerSelector Unable to refresh remote group peers due to: Unable to retrieve nodes from remote instance
</code>
2024-06-05 15:21:37,718 WARN [Timer-Driven Process Thread-1] o.apache.nifi.remote.client.PeerSelector Available peers collection is empty; no peer available
2024-06-05 15:21:42,332 WARN [NiFi Site-to-Site Connection Pool Maintenance] o.apache.nifi.remote.client.PeerSelector Could not communicate with 192.168.210.xx:10000 to determine which node(s) exist in the remote NiFi instance, due to java.net.ConnectException: Connection refused (Connection refused)
2024-06-05 15:21:42,333 WARN [NiFi Site-to-Site Connection Pool Maintenance] o.apache.nifi.remote.client.PeerSelector Unable to refresh remote group peers due to: Unable to retrieve nodes from remote instance
I don’t understand why the nifi remote client is trying to communicate with the port 10000 and what should be behind this port.
I’ve read seen a post about the same problem but nothing seems to work.
I’ve tried to modify the nifi.properties inside the conf directoy of minifi to add the properties :
nifi.remote.input.host=
nifi.remote.input.secure=
nifi.remote.input.socket.port=
nifi.remote.input.http.enabled=
nifi.remote.input.http.transaction.ttl=
but the file is overwrited at run time..
Here my confi.yml if it helps:
<code>MiNiFi Config Version: 3
flow controller graceful shutdown period: 10 sec
flow service write delay interval: 500 ms
administrative yield duration: 30 sec
bored yield duration: 10 millis
max concurrent threads: 1
variable registry properties: ''
checkpoint interval: 2 mins
content claim max appendable size: 10 MB
content claim max flow files: 100
provenance rollover time: 1 min
Component Status Repository:
snapshot frequency: 1 min
algorithm: PBEWITHMD5AND256BITAES-CBC-OPENSSL
- id: fec263e3-bbc8-30d5-0000-000000000000
class: org.apache.nifi.processors.standard.GenerateFlowFile
scheduling strategy: TIMER_DRIVEN
scheduling period: 20 sec
penalization period: 30 sec
auto-terminated relationships list: []
Unique FlowFiles: 'false'
generate-ff-custom-text: test
- id: 9c7b79bc-b6d9-30f3-0000-000000000000
name: GenerateFlowFile/success/d8b8931e-ea1d-315b-a2d7-115a6c623549
source id: fec263e3-bbc8-30d5-0000-000000000000
source relationship names:
destination id: e2856d3f-018f-1000-5f2f-9fc0e40621db
max work queue size: 10000
max work queue data size: 1 GB
flowfile expiration: 0 sec
queue prioritizer class: ''
- id: 38511b2c-ddcf-3b5f-0000-000000000000
url: http://192.168.210.xx:8081/nifi
local network interface: ''
- id: e2856d3f-018f-1000-5f2f-9fc0e40621db
Properties: # Deviates from spec and will later be removed when this is autonegotiated
NiFi Properties Overrides: {}
<code>MiNiFi Config Version: 3
Flow Controller:
name: config
comment: ''
Core Properties:
flow controller graceful shutdown period: 10 sec
flow service write delay interval: 500 ms
administrative yield duration: 30 sec
bored yield duration: 10 millis
max concurrent threads: 1
variable registry properties: ''
FlowFile Repository:
partitions: 256
checkpoint interval: 2 mins
always sync: false
Swap:
threshold: 20000
in period: 5 sec
in threads: 1
out period: 5 sec
out threads: 4
Content Repository:
content claim max appendable size: 10 MB
content claim max flow files: 100
always sync: false
Provenance Repository:
provenance rollover time: 1 min
Component Status Repository:
buffer size: 1440
snapshot frequency: 1 min
Security Properties:
keystore: ''
keystore type: ''
keystore password: ''
key password: ''
truststore: ''
truststore type: ''
truststore password: ''
ssl protocol: ''
Sensitive Props:
key:
algorithm: PBEWITHMD5AND256BITAES-CBC-OPENSSL
provider: BC
Processors:
- id: fec263e3-bbc8-30d5-0000-000000000000
name: GenerateFlowFile
class: org.apache.nifi.processors.standard.GenerateFlowFile
max concurrent tasks: 1
scheduling strategy: TIMER_DRIVEN
scheduling period: 20 sec
penalization period: 30 sec
yield period: 1 sec
run duration nanos: 0
auto-terminated relationships list: []
Properties:
Batch Size: '1'
Data Format: Text
File Size: 1B
Unique FlowFiles: 'false'
character-set: UTF-8
generate-ff-custom-text: test
mime-type:
Controller Services: []
Process Groups: []
Input Ports: []
Output Ports: []
Funnels: []
Connections:
- id: 9c7b79bc-b6d9-30f3-0000-000000000000
name: GenerateFlowFile/success/d8b8931e-ea1d-315b-a2d7-115a6c623549
source id: fec263e3-bbc8-30d5-0000-000000000000
source relationship names:
- success
destination id: e2856d3f-018f-1000-5f2f-9fc0e40621db
max work queue size: 10000
max work queue data size: 1 GB
flowfile expiration: 0 sec
queue prioritizer class: ''
Remote Process Groups:
- id: 38511b2c-ddcf-3b5f-0000-000000000000
name: 'Remote'
url: http://192.168.210.xx:8081/nifi
comment: ''
timeout: 30 sec
yield period: 10 sec
transport protocol: RAW
proxy host: ''
proxy port: ''
proxy user: ''
proxy password: ''
local network interface: ''
Input Ports:
- id: e2856d3f-018f-1000-5f2f-9fc0e40621db
name: From MINIFI
comment: ''
max concurrent tasks: 1
use compression: false
Properties: # Deviates from spec and will later be removed when this is autonegotiated
Port: 1026
Host Name: localhost
# Output Ports: []
NiFi Properties Overrides: {}
</code>
MiNiFi Config Version: 3
Flow Controller:
name: config
comment: ''
Core Properties:
flow controller graceful shutdown period: 10 sec
flow service write delay interval: 500 ms
administrative yield duration: 30 sec
bored yield duration: 10 millis
max concurrent threads: 1
variable registry properties: ''
FlowFile Repository:
partitions: 256
checkpoint interval: 2 mins
always sync: false
Swap:
threshold: 20000
in period: 5 sec
in threads: 1
out period: 5 sec
out threads: 4
Content Repository:
content claim max appendable size: 10 MB
content claim max flow files: 100
always sync: false
Provenance Repository:
provenance rollover time: 1 min
Component Status Repository:
buffer size: 1440
snapshot frequency: 1 min
Security Properties:
keystore: ''
keystore type: ''
keystore password: ''
key password: ''
truststore: ''
truststore type: ''
truststore password: ''
ssl protocol: ''
Sensitive Props:
key:
algorithm: PBEWITHMD5AND256BITAES-CBC-OPENSSL
provider: BC
Processors:
- id: fec263e3-bbc8-30d5-0000-000000000000
name: GenerateFlowFile
class: org.apache.nifi.processors.standard.GenerateFlowFile
max concurrent tasks: 1
scheduling strategy: TIMER_DRIVEN
scheduling period: 20 sec
penalization period: 30 sec
yield period: 1 sec
run duration nanos: 0
auto-terminated relationships list: []
Properties:
Batch Size: '1'
Data Format: Text
File Size: 1B
Unique FlowFiles: 'false'
character-set: UTF-8
generate-ff-custom-text: test
mime-type:
Controller Services: []
Process Groups: []
Input Ports: []
Output Ports: []
Funnels: []
Connections:
- id: 9c7b79bc-b6d9-30f3-0000-000000000000
name: GenerateFlowFile/success/d8b8931e-ea1d-315b-a2d7-115a6c623549
source id: fec263e3-bbc8-30d5-0000-000000000000
source relationship names:
- success
destination id: e2856d3f-018f-1000-5f2f-9fc0e40621db
max work queue size: 10000
max work queue data size: 1 GB
flowfile expiration: 0 sec
queue prioritizer class: ''
Remote Process Groups:
- id: 38511b2c-ddcf-3b5f-0000-000000000000
name: 'Remote'
url: http://192.168.210.xx:8081/nifi
comment: ''
timeout: 30 sec
yield period: 10 sec
transport protocol: RAW
proxy host: ''
proxy port: ''
proxy user: ''
proxy password: ''
local network interface: ''
Input Ports:
- id: e2856d3f-018f-1000-5f2f-9fc0e40621db
name: From MINIFI
comment: ''
max concurrent tasks: 1
use compression: false
Properties: # Deviates from spec and will later be removed when this is autonegotiated
Port: 1026
Host Name: localhost
# Output Ports: []
NiFi Properties Overrides: {}