Hi All,
What is the implication of the Conditional Alerts process get stuck?
Thanks,
Hi Siraj,
Is this different from Conditional Alert does not start of fininsh processing - #2 by Sravan_Reddy If not, is it okay if we close this and discuss there?
Thank you Sravan, let me look into the details.
Hi Srava, celery queues such as reminder_rule_queue get blocked even they work properly for some time after services are restarted.
The only issue I found from the log is:
2023-02-16 22:18:39,267 CRITICAL [celery.worker.request] Couldn't ack 21, reason:ConnectionResetError(104, 'Connection reset by peer')
Traceback (most recent call last):
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/kombu/message.py", line 128, in ack_log_error
self.ack(multiple=multiple)
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/kombu/message.py", line 123, in ack
self.channel.basic_ack(self.delivery_tag, multiple=multiple)
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/amqp/channel.py", line 1407, in basic_ack
return self.send_method(
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/amqp/abstract_channel.py", line 70, in send_method
conn.frame_writer(1, self.channel_id, sig, args, content)
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/amqp/method_framing.py", line 186, in write_frame
write(buffer_store.view[:offset])
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/amqp/transport.py", line 347, in write
self._write(s)
ConnectionResetError: [Errno 104] Connection reset by peer
2023-02-16 22:18:39,314 CRITICAL [celery.worker.request] Couldn't ack 16, reason:BrokenPipeError(32, 'Broken pipe')
Traceback (most recent call last):
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/kombu/message.py", line 128, in ack_log_error
self.ack(multiple=multiple)
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/kombu/message.py", line 123, in ack
self.channel.basic_ack(self.delivery_tag, multiple=multiple)
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/amqp/channel.py", line 1407, in basic_ack
return self.send_method(
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/amqp/abstract_channel.py", line 70, in send_method
conn.frame_writer(1, self.channel_id, sig, args, content)
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/amqp/method_framing.py", line 186, in write_frame
write(buffer_store.view[:offset])
File "/home/cchq/www/echis/releases/2023-02-09_17.40/python_env-3.9/lib/python3.9/site-packages/amqp/transport.py", line 347, in write
self._write(s)
BrokenPipeError: [Errno 32] Broken pipe
