I found some time to test it. Here's my results.
For now, I just set up R1, as configuration are identical.
Controller
The exact commands I have done were the follows:
curl -sS https://get.openziti.io/install.bash | sudo bash -s openziti
export ZITI_PWD=admin
export EXTERNAL_IP="85.10.10.100"
export ZITI_CTRL_EDGE_IP_OVERRIDE="${EXTERNAL_IP}"
export ZITI_CTRL_EDGE_ADVERTISED_ADDRESS="${EXTERNAL_DNS:-${EXTERNAL_IP}}"
export ZITI_CTRL_ADVERTISED_PORT=8440
export ZITI_CTRL_EDGE_ADVERTISED_PORT=8441
export ZITI_ROUTER_IP_OVERRIDE="${EXTERNAL_IP}"
export ZITI_ROUTER_ADVERTISED_ADDRESS="${EXTERNAL_DNS:-${EXTERNAL_IP}}"
export ZITI_ROUTER_PORT=8442
source /dev/stdin <<< "$(wget -qO- https://get.openziti.io/ziti-cli-functions.sh)"; expressInstall
createControllerSystemdFile
createRouterSystemdFile "${ZITI_ROUTER_NAME}"
sudo cp "${ZITI_HOME}/${ZITI_CTRL_NAME}.service" /etc/systemd/system/ziti-controller.service
sudo cp "${ZITI_HOME}/${ZITI_ROUTER_NAME}.service" /etc/systemd/system/ziti-router.service
sudo systemctl daemon-reload
sudo systemctl enable --now ziti-controller
sudo systemctl enable --now ziti-router
sudo systemctl -q status ziti-controller --lines=0 --no-pager
sudo systemctl -q status ziti-router --lines=0 --no-pager
It seems works fine, except a couple of stuff I have noted. My final output for the status of Controller and Router is:
[controller@cpe-85-10-10-100 ~]$ sudo systemctl -q status ziti-controller --lines=0 --no-pager
sudo systemctl -q status ziti-router --lines=0 --no-pager
● ziti-controller.service - Ziti-Controller
Loaded: loaded (/etc/systemd/system/ziti-controller.service; enabled; preset: disabled)
Active: activating (auto-restart) (Result: exit-code) since Tue 2024-02-20 11:37:42 CET; 46ms ago
Process: 3232 ExecStart=/home/controller/.ziti/quickstart/cpe-85-10-10-100.dynamic.amis.net/ziti-bin/ziti-v0.32.2/ziti controller run /home/controller/.ziti/quickstart/cpe-85-10-10-100.dynamic.amis.net/cpe-85-10-10-100.dynamic.amis.net.yaml (code=exited, status=203/EXEC)
Main PID: 3232 (code=exited, status=203/EXEC)
CPU: 817us
● ziti-router.service - Ziti-Router for cpe-85-10-10-100.dynamic.amis.net-edge-router
Loaded: loaded (/etc/systemd/system/ziti-router.service; enabled; preset: disabled)
Active: activating (auto-restart) (Result: exit-code) since Tue 2024-02-20 11:37:42 CET; 61ms ago
Process: 3233 ExecStart=/home/controller/.ziti/quickstart/cpe-85-10-10-100.dynamic.amis.net/ziti-bin/ziti-v0.32.2/ziti router run /home/controller/.ziti/quickstart/cpe-85-10-10-100.dynamic.amis.net/cpe-85-10-10-100.dynamic.amis.net-edge-router.yaml (code=exited, status=203/EXEC)
Main PID: 3233 (code=exited, status=203/EXEC)
CPU: 653us
Processes seems to never be active, but always pending in activating. Moreover, there is an exit code with status 203. I have done this installation a couple of times resetting my VM but same outcome.
Moreover, even if minor, I have noticed that in your video, your output also has:
vendor preset: enabled
while mine it has it disabled.
This (I supposed) give me the problem that the ports are not up an Listening:
[controller@cpe-85-10-10-100 ~]$ ss -tuln
Netid State Recv-Q Send-Q Local Address:Port Peer Address:Port Process
udp UNCONN 0 0 0.0.0.0:47248 0.0.0.0:*
udp UNCONN 0 0 0.0.0.0:5353 0.0.0.0:*
udp UNCONN 0 0 127.0.0.1:323 0.0.0.0:*
udp UNCONN 0 0 [::]:5353 [::]:*
udp UNCONN 0 0 [::]:49388 [::]:*
udp UNCONN 0 0 [::1]:323 [::]:*
tcp LISTEN 0 4096 127.0.0.1:631 0.0.0.0:*
tcp LISTEN 0 128 0.0.0.0:22 0.0.0.0:*
tcp LISTEN 0 4096 [::1]:631 [::]:*
tcp LISTEN 0 128 [::]:22 [::]:*
After doing some random stuff like checking permission, firewall, and whatnot, I managed to get the ports listening, but both Controller and Router are still in activating. I don't know if this may be a problem or it if can become.
Router R1
Here things were much more straightforward. No major issue. Commands were taken and no error seems to happen.
I am able to link it with the controller and get it up and running. Here's the output (from the Controller):
[controller@cpe-85-10-10-100 ~]$ ziti edge list edge-routers
╭────────────┬───────────────────────────────────────────────┬────────┬───────────────┬──────┬────────────╮
│ ID │ NAME │ ONLINE │ ALLOW TRANSIT │ COST │ ATTRIBUTES │
├────────────┼───────────────────────────────────────────────┼────────┼───────────────┼──────┼────────────┤
│ J-M-BOWdf │ cpe-85-10-10-100.dynamic.amis.net-edge-router │ true │ true │ 0 │ public │
│ nWsWrtzALG │ r1 │ true │ true │ 0 │ │
╰────────────┴───────────────────────────────────────────────┴────────┴───────────────┴──────┴────────────╯
results: 1-2 of 2
But when I try to show fabric links, it won't show:
[controller@cpe-85-10-10-100 ~]$ ziti fabric list links
╭────┬────────┬──────────┬─────────────┬─────────────┬─────────────┬───────┬────────┬───────────╮
│ ID │ DIALER │ ACCEPTOR │ STATIC COST │ SRC LATENCY │ DST LATENCY │ STATE │ STATUS │ FULL COST │
├────┼────────┼──────────┼─────────────┼─────────────┼─────────────┼───────┼────────┼───────────┤
╰────┴────────┴──────────┴─────────────┴─────────────┴─────────────┴───────┴────────┴───────────╯
results: none
Now I am a bit clueless of the why, but looking at R1 output while running, I found a couple of Errors, I don't know if they mey be related:
[ 275.012] ERROR ziti/router/link.(*linkRegistryImpl).evaluateLinkState.func1: {key=[default->tls:J-M-BOWdf->default] linkId=[70fFLZ8QjVrbNkpiUq0JSj] iteration=[9] error=[error dialing outgoing link [l/70fFLZ8QjVrbNkpiUq0JSj@9]: error dialing payload channel for [l/70fFLZ8QjVrbNkpiUq0JSj]: dial tcp 85.10.10.100:10080: connect: no route to host]} error dialing link
[ 275.012] INFO ziti/router/link.(*linkState).updateStatus: {linkId=[70fFLZ8QjVrbNkpiUq0JSj] iteration=[9] newState=[dialFailed] key=[default->tls:J-M-BOWdf->default] oldState=[dialing]} status updated
^C[ 378.680] INFO ziti/ziti/router.waitForShutdown: shutting down ziti-router
[ 378.680] ERROR agent.(*handler).listen: {error=[accept unix /tmp/gops-agent.2622.sock: use of closed network connection]} error accepting gops connection, closing gops listener
[ 378.680] ERROR agent.(*handler).listen.func1: {error=[close unix /tmp/gops-agent.2622.sock: use of closed network connection]} error closing gops listener
[ 378.681] ERROR channel/v2.(*reconnectingImpl).Rx [u{reconnecting}->i{2MJy}]: {error=[use of closed network connection]} error closing peer after rx error
[ 378.681] ERROR channel/v2.(*reconnectingImpl).Rx [u{reconnecting}->i{2MJy}]: {error=[read tcp 85.10.10.50:49896->85.10.10.100:8440: use of closed network connection]} rx error. closed peer and starting reconnection process
The only thing I can think of, it is that R1 cannot reach Controller, but they are able to ping:
[router01@cpe-85-10-10-50 ziti-router01]$ ping 85.10.10.100
PING 85.10.10.100 (85.10.10.100) 56(84) bytes of data.
64 bytes from 85.10.10.100: icmp_seq=1 ttl=64 time=0.470 ms
64 bytes from 85.10.10.100: icmp_seq=2 ttl=64 time=0.325 ms
64 bytes from 85.10.10.100: icmp_seq=3 ttl=64 time=0.332 ms
64 bytes from 85.10.10.100: icmp_seq=4 ttl=64 time=0.337 ms
^C
--- 85.10.10.100 ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3080ms
rtt min/avg/max/mdev = 0.325/0.366/0.470/0.060 ms
Let me know if you have nay ideas.
Thanks ahead.
