"Is the output or raw data available in csv or xls format which is then
pushed in Joomla using Joomla API?"
Three points here : pulling data from CommCare, push it to Joomla and the
PULLING DATA FROM COMMCARE
To get data from CommCare, you have two options: downloading reports from
CommCareHQ or using the python import tool. Both can output CSV or XLS
Data Export Overview - CommCare Public - Dimagi Confluence
Export tool: GitHub - dimagi/commcare-export: A command-line tool and Python library to generate customized exports from CommCareHQ.
PUSHING DATA TO JOOMLA
I have no experience in developing for Joomla, but I guess some kind of
REST or XML-RPC API are available. You'd use these API to push data to
You'd get CSV or XLS files from CommCare, but for sure some work would
have to be done to use this data with Joomla. You must not expect to upload
the CSV or XLS directly to Joomla and be done with it.
About fluentd: I'm not sure what you are talking about… I don't see why
you'd use fluentd in this scenario.
About the languages: you'd get files on the CommCare side and will use a
REST / XML-RPC API on the Joomla side, so the language question is almost
irrelevant here. You should select a language according to your dev
proficiency and the availability of a good Joomla API binding for a given
Good luck Aurangzeb !
On Tuesday 19 May 2015 08:31:29 Aurangzeb Farrukh wrote:
Thank you so much for this. I'm fairly new to commcare and
and I am semi technical so please bear with me if I ask some silly
questions. Just trying to collect enough information for the customer
our internal team to agree on the right approach and then formally
working on it together.
I'm sure the customer would be Ok with a daily refresh which is going
a major improvement in the current reporting cycle and hence these
sound very useful. I think initially we can start doing this manually
you've suggested and then make it a recurrent automated task on Google
Engine to further improve this process.
Just need some additional information so I could discuss this in
When you say “Get data from Commcare either by running the python
tool or by downloading the daily report in HQ”,
· Is the output or raw data available in csv or xls format which is
then pushed in Joomla using Joomla API?
Is there a recommended python data import tool?
Is it something like ‘fluent-logger-python
http://github.com/fluent/fluent-logger-python’ available through a
service like Treasure data?
We do have access to technical resources/developers but I am not sure
programming language or experience the developer should have who can
with multiple platforms and languages (Joomla/PHP, CommCare, Python,
Apps, Python and JAVA). Any Suggestions?
I can have our technical lead take over this discussion if you feel it
would be more helpful
Thanks so much.
On Monday, May 18, 2015 at 9:07:34 PM UTC-7, Charles Flèche wrote:
How "live" do you want your system to be : do you want Joomla to be
updated as soon as a form is sent or a daily refresh would be good
If you don't need an instant refresh but a regular (let's say daily)
refresh is good enough, you could probably do without App Engine at
- Get data from CommCare, either by running the python data import
or simply by downloading the daily reports you can configure in HQ
- Push the data in Joomla using the Joomla API
You could manually run this program at first, then make it a
automated task on your workstation / Google App Engine / Amazon Cloud
Another approach would be to write a Joomla plugin that directly
Do you have developers in your team ?
On Monday 18 May 2015 13:44:15 Aurangzeb Farrukh wrote:
Hope everyone is doing well.
We are looking for some ideas to sync valuable information
through Commcare directly on our Joomla based website and Facebook
customized visualization and case reporting in real time or near
For example, we would like to create 'live' beneficiary/case
pictures, a video, basic facts on each individual
with a short narrative which can be posted without manual
the beneficiaries could have a presence on our website, cases or
files could be maintained and updated over time when more
available on each case e.g. through a new commcare form, and 'live'
are as real as possible so the donors could connect with them and
value in a transparent way throughout the program duration.
Currently the reporting/donor update process is very slow which
donor dissatisfaction because we cannot work fast enough to update
maintain the sites manually specially when there are multiple
platforms to handle with limited resources.
We've been told that CommCare outputs the raw data in csv or xls
which many of Commcare partners feed directly into dashboards for
visualization and reporting purposes along with tables or graphs
could be set up to display the collected data and automatically
with the latest submissions to Commcare server.
We would also like to achieve this in an efficient way. Someone has
suggested using Google Apps Engine