Hey Ethan, yes, according to check_services, it's able to write to blobdb:
(cchq) ccc@monolith:~/commcare-cloud$ cchq monolith django-manage check_servicesssh ccc@10.1.0.4 -t -o UserKnownHostsFile=/home/ccc/environments/monolith/known_hosts 'sudo -iu cchq bash -c '"'"'cd /home/cchq/www/monolith/current; python_env/bin/python manage.py check_services'"'"''
Ubuntu 18.04.5 LTS
SUCCESS (Took 0.61s) kafka : Kafka seems to be in order
SUCCESS (Took 0.00s) redis : Redis is up and using 206.25M memory
SUCCESS (Took 0.02s) postgres : default:commcarehq:OK p1:commcarehq_p1:OK p2:commcarehq_p2:OK proxy:commcarehq_proxy:OK synclogs:commcarehq_synclogs:OK ucr:commcarehq_ucr:OK Successfully got a user from postgres
SUCCESS (Took 0.01s) couch : Successfully queried an arbitrary couch view
SUCCESS (Took 0.01s) celery : OK
SUCCESS (Took 0.02s) elasticsearch : Successfully sent a doc to ES and read it back
SUCCESS (Took 0.06s) blobdb : Successfully saved a file to the blobdb
SUCCESS (Took 0.04s) formplayer : Formplayer returned a 200 status code: https://xxxxxxxx/formplayer/serverup
SUCCESS (Took 0.00s) rabbitmq : RabbitMQ OK
Connection to 10.1.0.4 closed.
@Ethan_Soergel I've sent you a link to a copy of the file in the log... all appears fine and it appears well formatted. I was able to access it using the cchq:cchq user (owner) but not sure if it's meant to be owned by another user. I'll compare on another system shortly.
Just a thought... Zookeeper isn't perhaps involved somehow? I ask since we're having zookeeper failures during after_reboot as per this post and have had to bypass that routine to get other services up.