What do you use to analyze/house your data after export from CommCare?

Hi all –

I have a project that involves two apps and three levels of referrals (from
health outreach to clinic testing, and from clinic testing to continued ART
therapy when needed.)

Therefore the tables of exported forms that we export from our apps create
some pretty ambitious questions about the rates of referral from one form
to the next one, the typical path through those three levels, etc.

I would love to get input from other users about how you analyze… Can you
give me any thoughts about the methods or tools that you use to
process/analyze your data after you have exported from CommCare? Do you
use STATA or SPSS… or pour data into specialized apps related to your
technical/health area, or pour it into Access…?

Even the slightest input about what tools you use to crunch the numbers
after the data exports from CommCare would be great input for me…

Thanks!
Eric

Hi Eric

I know a few projects that use the CommCare Data Export Tool
https://wiki.commcarehq.org/display/commcarepublic/CommCare+Data+Export+Tool
to
export their data into a SQL database but I’m not sure what tools they use
after that (except for a few people who use Tableau to create dashboards).

··· On 14 September 2015 at 06:17, Eric Stephan wrote:

Hi all –

I have a project that involves two apps and three levels of referrals
(from health outreach to clinic testing, and from clinic testing to
continued ART therapy when needed.)

Therefore the tables of exported forms that we export from our apps create
some pretty ambitious questions about the rates of referral from one form
to the next one, the typical path through those three levels, etc.

I would love to get input from other users about how you analyze… Can
you give me any thoughts about the methods or tools that you use to
process/analyze your data after you have exported from CommCare? Do you
use STATA or SPSS… or pour data into specialized apps related to your
technical/health area, or pour it into Access…?

Even the slightest input about what tools you use to crunch the numbers
after the data exports from CommCare would be great input for me…

Thanks!
Eric


You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Simon Kelly
Senior Engineer | Dimagi South Africa

1 Like

Hi Eric,

Hi all –

I have a project that involves two apps and three levels of referrals
(from health outreach to clinic testing, and from clinic testing to
continued ART therapy when needed.)

Therefore the tables of exported forms that we export from our apps create
some pretty ambitious questions about the rates of referral from one form
to the next one, the typical path through those three levels, etc.

I would love to get input from other users about how you analyze… Can
you give me any thoughts about the methods or tools that you use to
process/analyze your data after you have exported from CommCare?


I think this depends on your statistical analysis plan. What do you want to
look at? Number of referrals? Referral rates? Referral sources? …

Do you use STATA or SPSS…

​The project I consult for we use STATA (the software is licensed with the
university)
If you are looking for a Free Open Source alternative have a look at R

or pour data into specialized apps related to your technical/health area,
or pour it into Access…?

​A prospective client is looking at pushing the data to DHIS 2, we are
still in the planning phase on how we are going to achieve this.

Best and Regards
Ronald Munjoma​

··· On 14 September 2015 at 06:17, Eric Stephan wrote:

Even the slightest input about what tools you use to crunch the numbers
after the data exports from CommCare would be great input for me…

Thanks!
Eric


You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Best and Regards
Ronald Munjoma
+263 775 625 283

[image: --]

Ronald Munjoma
[image: https://]about.me/ronaldmunjoma
https://about.me/ronaldmunjoma?promo=email_sig

Excel, R, SQL, Tableau, custom reports in CommCare, DHIS2 are all popular.

··· On Mon, Sep 14, 2015 at 3:58 PM, ronald munjoma wrote:

Hi Eric,

On 14 September 2015 at 06:17, Eric Stephan estephan@fhi360.org wrote:

Hi all –

I have a project that involves two apps and three levels of referrals
(from health outreach to clinic testing, and from clinic testing to
continued ART therapy when needed.)

Therefore the tables of exported forms that we export from our apps
create some pretty ambitious questions about the rates of referral from one
form to the next one, the typical path through those three levels, etc.

I would love to get input from other users about how you analyze… Can
you give me any thoughts about the methods or tools that you use to
process/analyze your data after you have exported from CommCare?


I think this depends on your statistical analysis plan. What do you want
to look at? Number of referrals? Referral rates? Referral sources? …

Do you use STATA or SPSS…

​The project I consult for we use STATA (the software is licensed with the
university)
If you are looking for a Free Open Source alternative have a look at R

or pour data into specialized apps related to your technical/health area,
or pour it into Access…?

​A prospective client is looking at pushing the data to DHIS 2, we are
still in the planning phase on how we are going to achieve this.

Best and Regards
Ronald Munjoma​

Even the slightest input about what tools you use to crunch the numbers
after the data exports from CommCare would be great input for me…

Thanks!
Eric


You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Best and Regards
Ronald Munjoma
+263 775 625 283

[image: --]

Ronald Munjoma
[image: https://]about.me/ronaldmunjoma
https://about.me/ronaldmunjoma?promo=email_sig


You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Hi Eric,

For quick analysis you can try out this method to pull into Excel
automatically:
https://confluence.dimagi.com/display/commcarepublic/Tutorial:+Create+an+Excel+Dashboard?src=search

Though it sounds like your data may be complex enough to outpace what Excel
can do it’s usually a good place to start for quick analysi / sanity check
on the data before getting into another stats program.

-Nick

Nick Nestle
Project Manager | Dimagi South Africa
+27 79 439 6081

··· On Mon, Sep 14, 2015 at 6:01 PM, Derek Hans wrote:

Excel, R, SQL, Tableau, custom reports in CommCare, DHIS2 are all popular.

On Mon, Sep 14, 2015 at 3:58 PM, ronald munjoma simbiso@gmail.com wrote:

Hi Eric,

On 14 September 2015 at 06:17, Eric Stephan estephan@fhi360.org wrote:

Hi all –

I have a project that involves two apps and three levels of referrals
(from health outreach to clinic testing, and from clinic testing to
continued ART therapy when needed.)

Therefore the tables of exported forms that we export from our apps
create some pretty ambitious questions about the rates of referral from one
form to the next one, the typical path through those three levels, etc.

I would love to get input from other users about how you analyze… Can
you give me any thoughts about the methods or tools that you use to
process/analyze your data after you have exported from CommCare?


I think this depends on your statistical analysis plan. What do you want
to look at? Number of referrals? Referral rates? Referral sources? …

Do you use STATA or SPSS…

​The project I consult for we use STATA (the software is licensed with
the university)
If you are looking for a Free Open Source alternative have a look at R

or pour data into specialized apps related to your technical/health
area, or pour it into Access…?

​A prospective client is looking at pushing the data to DHIS 2, we are
still in the planning phase on how we are going to achieve this.

Best and Regards
Ronald Munjoma​

Even the slightest input about what tools you use to crunch the numbers
after the data exports from CommCare would be great input for me…

Thanks!
Eric


You received this message because you are subscribed to the Google
Groups “commcare-users” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Best and Regards
Ronald Munjoma
+263 775 625 283

[image: --]

Ronald Munjoma
[image: https://]about.me/ronaldmunjoma
https://about.me/ronaldmunjoma?promo=email_sig


You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

The CommCare Data Export Tool saved me a tone of time!

If you need to constantly monitor data collection and produce regular reports, using the CommCare Export Tool will save you a lot of time. For my regular analysis and reporting, I prefer using R Studio (https://rstudio.com/) for two reasons: the software is free and there is a wealth of free and paid online learning resources available. The preferred reporting format for our team is MS Word documents and R Studio does a great job at producing these.

Thanks for sharing your experiences, Andre! I’ve had another conversation recently where R came up as a potentially strong analysis tool, and am happy to have some recent experience to pull from.

Are you using any special connector to get the data from the export tool into R, or are you running on top of an in-place relational database like Postgres?

-Clayton

Hi Andre,

Do you export the data as .CSV files and then load it into R or there is a connect that allows you to load the data directly from CommCare into R?

Yaw

Hi Yaw,

Exporting data to CSV is too time-consuming if you have to do it every day.

I’m using the CommCare Data Export Tool to export the data to a PostgreSQL database hosted on my computer. From there, it is easy to access the data with most programming languages.

André

@Clayton_Sims, I’m happy to share. Yes, I use the CommCare Data Export Tool to export to Postgres and then import and process the data in R - all happening in the background while I’m starting my computer.

Andre
That is great. Thank you

Yaw