Thanks Simon. Unfortunately the limited release is failing - let me know if you want the full log, but it seems to go awry from here:
Cloning virtual env
[10.0.0.4] sudo: readlink -f /home/cchq/www/monolith/current/python_env-3.6
[10.0.0.4] out: /home/cchq/www/monolith/releases/2021-09-15_07.15/python_env-3.6
[10.0.0.4] out:
[10.0.0.4] sudo: virtualenv-clone /home/cchq/www/monolith/releases/2021-09-15_07.15/python_env-3.6 /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6
[10.0.0.4] sudo: sed -i -e "s~/home/cchq/www/monolith/current/python_env-3.6~/home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6~g" $(find /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/ -type f)
[10.0.0.4] sudo: export HOME=/home/cchq && source /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/activate && pip install --quiet --upgrade --timeout=60 pip-tools
[10.0.0.4] sudo: export HOME=/home/cchq && source /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/activate && pip-sync --quiet --pip-args='--timeout=60' /home/cchq/www/monolith/releases/2021-09-16_10.52/requirements/prod-requirements.txt
[10.0.0.4] out: ERROR: Command errored out with exit status 1:
[10.0.0.4] out: command: /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/python3.6 -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-n0catb2f/pystache_d1801855c7b24382a6775cd42327d13e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-n0catb2f/pystache_d1801855c7b24382a6775cd42327d13e/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-fbqj2f3s
[10.0.0.4] out: cwd: /tmp/pip-install-n0catb2f/pystache_d1801855c7b24382a6775cd42327d13e/
[10.0.0.4] out: Complete output (2 lines):
[10.0.0.4] out: pystache: using: version '58.0.4' of <module 'setuptools' from '/home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/lib/python3.6/site-packages/setuptools/__init__.py'>
[10.0.0.4] out: error in pystache setup command: use_2to3 is invalid.
[10.0.0.4] out: ----------------------------------------
[10.0.0.4] out: WARNING: Discarding https://files.pythonhosted.org/packages/d6/fd/eb8c212053addd941cc90baac307c00ac246ac3fce7166b86434c6eae963/pystache-0.5.4.tar.gz#sha256=f7bbc265fb957b4d6c7c042b336563179444ab313fb93a719759111eabd3b85a (from https://pypi.org/simple/pystache/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
[10.0.0.4] out: ERROR: Could not find a version that satisfies the requirement pystache==0.5.4 (from versions: 0.1.0, 0.2.0, 0.3.0, 0.3.1, 0.4.0, 0.4.1, 0.5.0, 0.5.1, 0.5.2, 0.5.3, 0.5.4)
[10.0.0.4] out: ERROR: No matching distribution found for pystache==0.5.4
[10.0.0.4] out: Traceback (most recent call last):
[10.0.0.4] out: File "/home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/pip-sync", line 8, in <module>
[10.0.0.4] out: sys.exit(cli())
[10.0.0.4] out: File "/home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/lib/python3.6/site-packages/click/core.py", line 1137, in __call__
[10.0.0.4] out: return self.main(*args, **kwargs)
[10.0.0.4] out: File "/home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/lib/python3.6/site-packages/click/core.py", line 1062, in main
[10.0.0.4] out: rv = self.invoke(ctx)
[10.0.0.4] out: File "/home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/lib/python3.6/site-packages/click/core.py", line 1404, in invoke
[10.0.0.4] out: return ctx.invoke(self.callback, **ctx.params)
[10.0.0.4] out: File "/home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/lib/python3.6/site-packages/click/core.py", line 763, in invoke
[10.0.0.4] out: return __callback(*args, **kwargs)
[10.0.0.4] out: File "/home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/lib/python3.6/site-packages/piptools/scripts/sync.py", line 177, in cli
[10.0.0.4] out: python_executable=python_executable,
[10.0.0.4] out: File "/home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/lib/python3.6/site-packages/piptools/sync.py", line 259, in sync
[10.0.0.4] out: check=True,
[10.0.0.4] out: File "/usr/lib/python3.6/subprocess.py", line 438, in run
[10.0.0.4] out: output=stdout, stderr=stderr)
[10.0.0.4] out: subprocess.CalledProcessError: Command '['/home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/python3.6', '-m', 'pip', 'install', '-r', '/tmp/tmpcsr76_nd', '-q', '--timeout=60']' returned non-zero exit status 1.
[10.0.0.4] out:
Fatal error: sudo() received nonzero return code 1 while executing!
Requested: export HOME=/home/cchq && source /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/activate && pip-sync --quiet --pip-args='--timeout=60' /home/cchq/www/monolith/releases/2021-09-16_10.52/requirements/prod-requirements.txt
Executed: sudo -S -p 'sudo password:' -H -u "cchq" /bin/bash -l -c "cd /home/cchq/www/monolith/releases/2021-09-16_10.52 >/dev/null && export HOME=/home/cchq && source /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/activate && pip-sync --quiet --pip-args='--timeout=60' /home/cchq/www/monolith/releases/2021-09-16_10.52/requirements/prod-requirements.txt"
Aborting.
!!! Parallel execution exception under host '10.0.0.4':
Process 10.0.0.4:
Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python3.6/multiprocessing/process.py", line 93, in run
self._target(*self._args, **self._kwargs)
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/tasks.py", line 240, in inner
submit(task.run(*args, **kwargs))
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/tasks.py", line 172, in run
return self.wrapped(*args, **kwargs)
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/decorators.py", line 52, in inner_decorator
return func(*args, **kwargs)
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/decorators.py", line 180, in inner
return func(*args, **kwargs)
File "/home/ccc/commcare-cloud/src/commcare_cloud/fab/operations/release.py", line 199, in update
cmd_prefix, proxy, " ".join(requirements_files)))
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/network.py", line 654, in host_prompting_wrapper
return func(*args, **kwargs)
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/operations.py", line 1121, in sudo
stderr=stderr, timeout=timeout, shell_escape=shell_escape,
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/operations.py", line 952, in _run_command
error(message=msg, stdout=out, stderr=err)
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/utils.py", line 359, in error
return func(message)
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/utils.py", line 55, in abort
raise env.abort_exception(msg)
Exception: sudo() received nonzero return code 1 while executing!
Requested: export HOME=/home/cchq && source /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/activate && pip-sync --quiet --pip-args='--timeout=60' /home/cchq/www/monolith/releases/2021-09-16_10.52/requirements/prod-requirements.txt
Executed: sudo -S -p 'sudo password:' -H -u "cchq" /bin/bash -l -c "cd /home/cchq/www/monolith/releases/2021-09-16_10.52 >/dev/null && export HOME=/home/cchq && source /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/activate && pip-sync --quiet --pip-args='--timeout=60' /home/cchq/www/monolith/releases/2021-09-16_10.52/requirements/prod-requirements.txt"
Fatal error: One or more hosts failed while executing task 'update'
Underlying exception:
sudo() received nonzero return code 1 while executing!
Requested: export HOME=/home/cchq && source /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/activate && pip-sync --quiet --pip-args='--timeout=60' /home/cchq/www/monolith/releases/2021-09-16_10.52/requirements/prod-requirements.txt
Executed: sudo -S -p 'sudo password:' -H -u "cchq" /bin/bash -l -c "cd /home/cchq/www/monolith/releases/2021-09-16_10.52 >/dev/null && export HOME=/home/cchq && source /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/activate && pip-sync --quiet --pip-args='--timeout=60' /home/cchq/www/monolith/releases/2021-09-16_10.52/requirements/prod-requirements.txt"
Aborting.
Traceback (most recent call last):
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/main.py", line 749, in main
*args, **kwargs
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/tasks.py", line 385, in execute
multiprocessing
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/tasks.py", line 275, in _execute
return task.run(*args, **kwargs)
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/tasks.py", line 172, in run
return self.wrapped(*args, **kwargs)
File "/home/ccc/commcare-cloud/src/commcare_cloud/fab/fabfile.py", line 288, in setup_limited_release
_setup_release(parse_int_or_exit(keep_days), full_cluster=False)
File "/home/ccc/commcare-cloud/src/commcare_cloud/fab/fabfile.py", line 336, in _setup_release
execute_with_timing(release.update_virtualenv(full_cluster))
File "/home/ccc/commcare-cloud/src/commcare_cloud/fab/utils.py", line 25, in execute_with_timing
execute(fn, *args, **kwargs)
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/tasks.py", line 417, in execute
error(err, exception=d['results'])
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/utils.py", line 359, in error
return func(message)
File "/home/ccc/.virtualenvs/cchq/lib/python3.6/site-packages/fabric/utils.py", line 55, in abort
raise env.abort_exception(msg)
Exception: One or more hosts failed while executing task 'update'
Underlying exception:
sudo() received nonzero return code 1 while executing!
Requested: export HOME=/home/cchq && source /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/activate && pip-sync --quiet --pip-args='--timeout=60' /home/cchq/www/monolith/releases/2021-09-16_10.52/requirements/prod-requirements.txt
Executed: sudo -S -p 'sudo password:' -H -u "cchq" /bin/bash -l -c "cd /home/cchq/www/monolith/releases/2021-09-16_10.52 >/dev/null && export HOME=/home/cchq && source /home/cchq/www/monolith/releases/2021-09-16_10.52/python_env-3.6/bin/activate && pip-sync --quiet --pip-args='--timeout=60' /home/cchq/www/monolith/releases/2021-09-16_10.52/requirements/prod-requirements.txt"