A quick update on this. For some reason redis seems to be behaving again and I was able to get further with a deploy. This time it failed and told me:
[197.x.x.x] out: A migration must be performed before this environment can be upgraded to the latest version
[197.x.x.x] out: of CommCareHQ. This migration is run using the management command populate_custom_data_fields.
[197.x.x.x] out:
[197.x.x.x] out:
[197.x.x.x] out: Run the following commands to run the migration and get up to date:
[197.x.x.x] out:
[197.x.x.x] out: commcare-cloud monolith deploy commcare --commcare-rev=bb82e5c3d2840d6e3e3a6f5ebf1a0c7e817f4613
[197.x.x.x] out:
[197.x.x.x] out: commcare-cloud monolith django-manage populate_custom_data_fields
[197.x.x.x] out:
[197.x.x.x] out: commcare-cloud monolith deploy commcare
So I am trying that right now. Possibly there was some other changelog I missed?
That bb82e deploy is running now but throwing this regularly:
[197.x.x.x] sudo: /home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/bin/python /home/cchq/www/monolith/releases/2021-05-06_10.41/manage.py preindex_everything --check
[197.x.x.x] out: 2021-05-06 10:48:14,171 INFO AXES: BEGIN LOG
[197.x.x.x] out: Traceback (most recent call last):
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/manage.py", line 189, in <module>
[197.x.x.x] out: main()
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/manage.py", line 41, in main
[197.x.x.x] out: execute_from_command_line(sys.argv)
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/lib/python3.6/site-packages/django/core/management/__init__.py", line 364, in execute_from_command_line
[197.x.x.x] out: utility.execute()
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/lib/python3.6/site-packages/django/core/management/__init__.py", line 356, in execute
[197.x.x.x] out: self.fetch_command(subcommand).run_from_argv(self.argv)
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/lib/python3.6/site-packages/django/core/management/base.py", line 283, in run_from_argv
[197.x.x.x] out: self.execute(*args, **cmd_options)
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/lib/python3.6/site-packages/django/core/management/base.py", line 330, in execute
[197.x.x.x] out: output = self.handle(*args, **options)
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/corehq/apps/hqadmin/management/commands/preindex_everything.py", line 59, in handle
[197.x.x.x] out: if get_preindex_complete(head):
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/corehq/apps/hqadmin/management/commands/preindex_everything.py", line 138, in get_preindex_complete
[197.x.x.x] out: return rcache.get(PREINDEX_COMPLETE_COMMIT, None) == head
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/lib/python3.6/site-packages/django_redis/cache.py", line 32, in _decorator
[197.x.x.x] out: return method(self, *args, **kwargs)
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/lib/python3.6/site-packages/django_redis/cache.py", line 81, in get
[197.x.x.x] out: client=client)
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/lib/python3.6/site-packages/django_redis/client/default.py", line 198, in get
[197.x.x.x] out: client = self.get_client(write=False)
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/lib/python3.6/site-packages/django_redis/client/default.py", line 94, in get_client
[197.x.x.x] out: self._clients[index] = self.connect(index)
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/lib/python3.6/site-packages/django_redis/client/default.py", line 107, in connect
[197.x.x.x] out: return self.connection_factory.connect(self._server[index])
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/lib/python3.6/site-packages/django_redis/pool.py", line 65, in connect
[197.x.x.x] out: connection = self.get_connection(params)
[197.x.x.x] out: File "/home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/lib/python3.6/site-packages/django_redis/pool.py", line 77, in get_connection
[197.x.x.x] out: return self.redis_client_cls(connection_pool=pool, **self.redis_client_cls_kwargs)
[197.x.x.x] out: TypeError: __init__() got an unexpected keyword argument 'health_check_interval'
[197.x.x.x] out:
It's eventually failing with:
[197.x.x.x] sudo: /home/cchq/www/monolith/releases/2021-05-06_10.41/python_env-3.6/bin/python manage.py send_email --to-admins --subject ' You can'"'"'t deploy to monolith yet. There'"'"'s a preindex in process.' 'Preindexing is taking a while, so hold tight and wait for an email saying it'"'"'s done. Thank you for using AWESOME DEPLOY.'
Is there something else I can do for it to recognize the 'health_check_interval' argument - perhaps something else was missed?
Thanks again!