Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

panicked at 'closing channel' #256

Open
PhilWaldmann opened this issue Jul 2, 2021 · 3 comments
Open

panicked at 'closing channel' #256

PhilWaldmann opened this issue Jul 2, 2021 · 3 comments

Comments

@PhilWaldmann
Copy link

PhilWaldmann commented Jul 2, 2021 •
edited

Hi,

I'm using sonic for a bigger project and it's working great. Except when it crashes in irregular intervals (every 1 - 2 days).
The communication is done via the elixir sonix client and sonic runs via the official docker container (latest version).

config is the default one and the stored data is about 25MB (~24MB ram usage, CPU usage very low)

The log is flooded with these lines:

  | 2021-07-02T11:45:39.424+02:00 | thread 'thread 'thread 'thread 'thread 'thread 'thread 'thread 'sonic-channel-client' panicked at 'closing channel', src/channel/handle.rs:sonic-channel-clientsonic-channel-client' panicked at 'closing channelsonic-channel-clientsonic-channel-client' panicked at 'closing channel', src/channel/handle.rs:', ' panicked at 'src/channel/handle.rs188:21
  | 2021-07-02T11:45:39.424+02:00 | :188188:21
  | 2021-07-02T11:45:39.424+02:00 | :21
  | 2021-07-02T11:45:39.424+02:00 | closing channel', src/channel/handle.rs:188:21
  | 2021-07-02T11:45:39.424+02:00 | sonic-channel-client' panicked at 'closing channel', src/channel/handle.rs:188:21
  | 2021-07-02T11:45:39.424+02:00 | ' panicked at 'sonic-channel-client' panicked at 'closing channel', src/channel/handle.rs:188:21
  | 2021-07-02T11:45:39.424+02:00 | sonic-channel-client' panicked at 'closing channel', src/channel/handle.rs:188:21
  | 2021-07-02T11:45:39.424+02:00 | closing channel', src/channel/handle.rs:188:21
  | 2021-07-02T12:00:11.153+02:00 | (WARN) - took a lot of time: 125ms to process channel message
  | 2021-07-02T12:14:19.737+02:00 | thread 'thread 'sonic-channel-clientsonic-channel-client' panicked at '' panicked at 'closing channelclosing channel', ', src/channel/handle.rssrc/channel/handle.rs::188188::2121
  | 2021-07-02T12:14:19.737+02:00 | thread 'thread 'sonic-channel-clientsonic-channel-client' panicked at '' panicked at 'closing channelclosing channel', ', src/channel/handle.rssrc/channel/handle.rs::188188::2121
  | 2021-07-02T12:14:19.737+02:00 | thread 'sonic-channel-client' panicked at 'closing channel', src/channel/handle.rs:188:21
  | 2021-07-02T12:14:19.737+02:00 | thread 'sonic-channel-client' panicked at 'closing channel', src/channel/handle.rs:188:21
  | 2021-07-02T12:14:19.737+02:00 | thread 'sonic-channel-client' panicked at 'closing channel', src/channel/handle.rs:188:21
  | 2021-07-02T12:14:19.737+02:00 | thread 'sonic-channel-client' panicked at 'closing channel', src/channel/handle.rs:188:21
  | 2021-07-02T13:53:21.945+02:00 | (WARN) - took a lot of time: 54ms to process channel message
  | 2021-07-02T13:53:21.967+02:00 | (WARN) - took a lot of time: 76ms to process channel message
  | 2021-07-02T13:53:21.997+02:00 | (WARN) - took a lot of time: 105ms to process channel message

Do you have any clue what is causing these log messages and the crashes?
After restarting the container everything is working fine again.

Thanks a lot!!
Philipp
@valeriansaliou
Copy link
Owner

Hello,

I'm not the developer of the Elexir connector, would you mind recording logs of all commands you're sending via this library (eg. from your client application), and sending there the commands that are sent right before Sonic panics?

I've never experienced this using my JS connectors, and given the thread 'thread 'thread [..] error trace I'm curious of what could be happening!

@Kryvchun
Copy link

Hi. I had a similar problem when I tried to push an invalid symbol. It was the first byte of 隻. Sonic logs showed 33407 logs of closing channel.

@Amber916Young
Copy link

Hi, any update?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@PhilWaldmann @valeriansaliou @Amber916Young @Kryvchun