Ziti Edge Client MAC loses connection, reconnect fixes problem

Hi,
I’ve recently experienced problems every once in a while when trying to access a web application via the MAC Ziti Edge Client.
Suddenly, the service behind the overlay doesn’t send a response back anymore.

Here are the logs. Any ideas what’s wrong (or what I might be doing wrong)

[2023-07-08T09:17:54:826Z]    INFO PacketTunnelProvider:ZitiTunnelDelegate.swift:222 tunnelEventCallback() ZitiTunnelEvent: <CZiti.ZitiTunnelContextEvent: 0x146240db0>
   identity: dm_mb:"ABCDEFG"
   status: OK
   name: dm_mb
   version: v0.26.10
   controller: 
   code: 0
[2023-07-08T09:17:54:832Z]    INFO PacketTunnelProvider:UserNotifications.swift:100 post() Attempting to post Info notification, subitile:Optional("Controller: Available"), body:Optional("dm_mb\nhttps://zt.mydomain.com:8441"), zid:Optional("dm_mb")
(72753)[2023-07-08T09:17:54.891Z]    INFO ziti-sdk:ziti.c:1422 ziti_set_api_session() ztx[0] api session set, setting api_session_timer to 1740s
(72753)[2023-07-08T09:17:54.917Z]    INFO ziti-sdk:channel.c:733 reconnect_channel() ch[0] reconnecting NOW
(72753)[2023-07-08T09:17:55.058Z]    INFO ziti-sdk:channel.c:631 hello_reply_cb() ch[0] connected. EdgeRouter version: v0.26.10|72978b5aa932|2022-10-13T15:31:04Z|linux|amd64
(72753)[2023-07-08T09:17:55.058Z]    INFO tunnel-cbs:ziti_tunnel_ctrl.c:801 on_ziti_event() ztx[dm_mb] router zt-edge-router@tls://zt.mydomain.com:8442 connected
(72753)[2023-07-08T09:18:28.844Z]   ERROR ziti-sdk:channel.c:488 dispatch_message() ch[0] received message without conn_id or for unknown connection ct[ED71] conn_id[9108]
(72753)[2023-07-08T09:18:30.000Z]   ERROR ziti-sdk:channel.c:488 dispatch_message() ch[0] received message without conn_id or for unknown connection ct[ED71] conn_id[9112]
(72753)[2023-07-08T09:18:50.256Z]    INFO tunnel-cbs:ziti_dns.c:500 format_resp() found record[100.64.0.5] for query[1:gl01.mydomain.com]
(72753)[2023-07-08T09:20:47.651Z]    INFO tunnel-cbs:ziti_dns.c:500 format_resp() found record[100.64.0.5] for query[1:gl01.mydomain.com]
(72753)[2023-07-08T09:23:18.252Z]    INFO tunnel-cbs:ziti_dns.c:500 format_resp() found record[100.64.0.5] for query[1:gl01.mydomain.com]
(72753)[2023-07-08T09:24:32.792Z]    INFO tunnel-cbs:ziti_dns.c:500 format_resp() found record[100.64.0.5] for query[1:gl01.mydomain.com]
(72753)[2023-07-08T09:25:53.251Z]    INFO tunnel-cbs:ziti_dns.c:500 format_resp() found record[100.64.0.5] for query[1:gl01.mydomain.com]
(72753)[2023-07-08T09:27:50.248Z]    INFO tunnel-cbs:ziti_dns.c:500 format_resp() found record[100.64.0.5] for query[1:gl01.mydomain.com]

Best regards
Dominik

In the logs you show, the errors are (I believe) the types of messages you'll see when the far side disconnects the connection. I'm pretty sure those errors are saying "this client tried to write data, but the connection is not here any more". Assuming that's right, (probably want/need @ekoby to confirm) then in my experience that's what happens when the far side closes the connection.

After this happens though, it never recovers??? That would be surprising and if that's the case we would want to understand that better.

Hm, I can almost rule out that the far side closed the connection because it did receive lots of data from another client simultaneously. But yes, it didn’t recover anymore except when clicking “Turn Ziti Off” and turning it on again. I have activated Trace Logging so that we have some more info when it happens again.

That’ll help. Is the far side an edge-router or is it another tunneler? going to debug level there would probably be useful too if possible.