Seeking CommCare linkable data repository

The holy grail for my project right now would be a software that meets the
following criteria. Because the criteria includes “directly link/refresh
data from CommCare,” I thought it’s be appropriate to ask in this forum.

Thanks for any leads!

(in order of priority)

Must have:
Centralized, secure repository of all project data in a single web-based
interface both data from Commcare and data manually uploaded from excel
Ability to append metadata and related documents to a data set
Automated piping (via an API) of data collected over mobiles into the
repository. (in this case, that’s through CommCare)

Like to Have:
Ability to create analysis that draws on data from across several data sets
in the system
Ability to generate and share tables, graphs, and maps that draw on data
from across several data sets in the system
Ability to create organizational accounts with individual projects within
and establish robust permissions
Ability to draw on data stored in the repository into another system system
for further reporting via an API (future need).

Hey Eric,

Any reason to not just make CommCare HQ the data repository? I believe that
it would meet all of your “must haves” and many of your “like to haves”.

That said, if you need them - we do have a number of ways of pulling data
out of CommCare using the APIs
https://confluence.dimagi.com/display/commcarepublic/CommCare+HQ+APIs or
the data export tool
https://confluence.dimagi.com/display/commcarepublic/CommCare+Data+Export+Tool.
There are also things like MOTECH http://docs.motechproject.org/en/latest/
which can pull data out of CommCare (and many other data sources) and serve
as a central repository or an integration hub.

thanks,
Cory

··· On Wed, Jul 1, 2015 at 9:23 AM, Eric Couper wrote:

The holy grail for my project right now would be a software that meets the
following criteria. Because the criteria includes “directly link/refresh
data from CommCare,” I thought it’s be appropriate to ask in this forum.

Thanks for any leads!

(in order of priority)

Must have:
Centralized, secure repository of all project data in a single web-based
interface both data from Commcare and data manually uploaded from excel
Ability to append metadata and related documents to a data set
Automated piping (via an API) of data collected over mobiles into the
repository. (in this case, that’s through CommCare)

Like to Have:
Ability to create analysis that draws on data from across several data
sets in the system
Ability to generate and share tables, graphs, and maps that draw on data
from across several data sets in the system
Ability to create organizational accounts with individual projects within
and establish robust permissions
Ability to draw on data stored in the repository into another system
system for further reporting via an API (future need).


You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Cory,

Thanks for the ideas! A few questions.

Can Commcare allow manual data uploads from excel file?!? We need a
central store of our data collected on mobile and stuff collected on paper
and then later digitized. Also, some of it coming from other sources
already in excel.

Also, can you point me to where I can associate metadata and related
documented to a CommCare app? I’d like to at minimum include links to data
dictionary, methodology, use agreements for each application or form.

As an FYI, the best option I’ve found so far is a tool called aWhere, and
it has ODK Aggregate tie-ins, but not CommCare. I’ll definitely check-out
MOTECH, but I’m looking for an off-the-shelf SaaS, something I could
connect CommCare to and get my existing excel files imported to within a
day or two even if there was a moderate price tag. My understanding is that
I’d need a third party or our developers to customize and stand-up an
instance. Is that right?

··· On Wed, Jul 1, 2015 at 11:46 AM, Cory Zue wrote:

Hey Eric,

Any reason to not just make CommCare HQ the data repository? I believe
that it would meet all of your “must haves” and many of your “like to
haves”.

That said, if you need them - we do have a number of ways of pulling data
out of CommCare using the APIs
https://confluence.dimagi.com/display/commcarepublic/CommCare+HQ+APIs
or the data export tool
https://confluence.dimagi.com/display/commcarepublic/CommCare+Data+Export+Tool.
There are also things like MOTECH
http://docs.motechproject.org/en/latest/ which can pull data out of
CommCare (and many other data sources) and serve as a central repository or
an integration hub.

thanks,
Cory

On Wed, Jul 1, 2015 at 9:23 AM, Eric Couper eric.couper@gmail.com wrote:

The holy grail for my project right now would be a software that meets
the following criteria. Because the criteria includes “directly
link/refresh data from CommCare,” I thought it’s be appropriate to ask in
this forum.

Thanks for any leads!

(in order of priority)

Must have:
Centralized, secure repository of all project data in a single web-based
interface both data from Commcare and data manually uploaded from excel
Ability to append metadata and related documents to a data set
Automated piping (via an API) of data collected over mobiles into the
repository. (in this case, that’s through CommCare)

Like to Have:
Ability to create analysis that draws on data from across several data
sets in the system
Ability to generate and share tables, graphs, and maps that draw on data
from across several data sets in the system
Ability to create organizational accounts with individual projects within
and establish robust permissions
Ability to draw on data stored in the repository into another system
system for further reporting via an API (future need).


You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to a topic in the
Google Groups “commcare-users” group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/commcare-users/OQSidxivqx8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Eric A. Couper
m. +1 504 478 9954
e. eric.couper@gmail.com
w. www.ericcouper.com
t. @_couper https://twitter.com/_couper

Hey Eric

Cory,

Thanks for the ideas! A few questions.

Can Commcare allow manual data uploads from excel file?!? We need a
central store of our data collected on mobile and stuff collected on paper
and then later digitized. Also, some of it coming from other sources
already in excel.

You can use the case importer
https://confluence.dimagi.com/display/commcarepublic/Importing+Cases+Using+Excel
to do this.

Also, can you point me to where I can associate metadata and related
documented to a CommCare app? I’d like to at minimum include links to data
dictionary, methodology, use agreements for each application or form.

Ah, I misunderstood this requirement. This is not currently possible in
CommCare. Is this basically just a file repository? It seems like you could
easily just manage this in a second service for now, though not sure if
that’s a dealbreaker for you.

As an FYI, the best option I’ve found so far is a tool called aWhere, and
it has ODK Aggregate tie-ins, but not CommCare. I’ll definitely check-out
MOTECH, but I’m looking for an off-the-shelf SaaS, something I could
connect CommCare to and get my existing excel files imported to within a
day or two even if there was a moderate price tag. My understanding is that
I’d need a third party or our developers to customize and stand-up an
instance. Is that right?

Yeah, that’s right. Not familiar with awhere and took a quick look at their
website to see if it looked like we might be able to integrate but it
wasn’t obvious how the ODK stuff worked.

Cory

··· > > On Wed, Jul 1, 2015 at 11:46 AM, Cory Zue wrote: > >> Hey Eric, >> >> Any reason to not just make CommCare HQ the data repository? I believe >> that it would meet all of your "must haves" and many of your "like to >> haves". >> >> That said, if you need them - we do have a number of ways of pulling data >> out of CommCare using the APIs >> >> or the data export tool >> . >> There are also things like MOTECH >> which can pull data out of >> CommCare (and many other data sources) and serve as a central repository or >> an integration hub. >> >> thanks, >> Cory >> >> On Wed, Jul 1, 2015 at 9:23 AM, Eric Couper wrote: >> >>> The holy grail for my project right now would be a software that meets >>> the following criteria. Because the criteria includes "directly >>> link/refresh data from CommCare," I thought it's be appropriate to ask in >>> this forum. >>> >>> Thanks for any leads! >>> >>> (in order of priority) >>> >>> Must have: >>> Centralized, secure repository of all project data in a single web-based >>> interface both data from Commcare and data manually uploaded from excel >>> Ability to append metadata and related documents to a data set >>> Automated piping (via an API) of data collected over mobiles into the >>> repository. (in this case, that’s through CommCare) >>> >>> Like to Have: >>> Ability to create analysis that draws on data from across several data >>> sets in the system >>> Ability to generate and share tables, graphs, and maps that draw on data >>> from across several data sets in the system >>> Ability to create organizational accounts with individual projects >>> within and establish robust permissions >>> Ability to draw on data stored in the repository into another system >>> system for further reporting via an API (future need). >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "commcare-users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to commcare-users+unsubscribe@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to a topic in the >> Google Groups "commcare-users" group. >> To unsubscribe from this topic, visit >> https://groups.google.com/d/topic/commcare-users/OQSidxivqx8/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> commcare-users+unsubscribe@googlegroups.com. >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Eric A. Couper > m. +1 504 478 9954 > e. eric.couper@gmail.com > w. www.ericcouper.com > t. @_couper > > -- > You received this message because you are subscribed to the Google Groups > "commcare-users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to commcare-users+unsubscribe@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. >

Hey Eric

Cory,

Thanks for the ideas! A few questions.

Can Commcare allow manual data uploads from excel file?!? We need a
central store of our data collected on mobile and stuff collected on paper
and then later digitized. Also, some of it coming from other sources
already in excel.

You can use the case importer
https://confluence.dimagi.com/display/commcarepublic/Importing+Cases+Using+Excel
to do this.

Eric: Awesome I’ll take a look!

Also, can you point me to where I can associate metadata and related
documented to a CommCare app? I’d like to at minimum include links to data
dictionary, methodology, use agreements for each application or form.

Ah, I misunderstood this requirement. This is not currently possible in
CommCare. Is this basically just a file repository? It seems like you could
easily just manage this in a second service for now, though not sure if
that’s a dealbreaker for you.

Eric: Actually just a text field where we can dump info about a form is
what we are looking for. Ona.io has this with a text field in the web
interface where you can add notes about a form. That way is some different
comes to look at it later they have some background or a message from the
creator.

As an FYI, the best option I’ve found so far is a tool called aWhere, and
it has ODK Aggregate tie-ins, but not CommCare. I’ll definitely check-out
MOTECH, but I’m looking for an off-the-shelf SaaS, something I could
connect CommCare to and get my existing excel files imported to within a
day or two even if there was a moderate price tag. My understanding is that
I’d need a third party or our developers to customize and stand-up an
instance. Is that right?

Yeah, that’s right. Not familiar with awhere and took a quick look at
their website to see if it looked like we might be able to integrate but it
wasn’t obvious how the ODK stuff worked.

Eric: No problem. They are currently planning a new tool, and I think
greater integration will be part of that.

··· On Thu, Jul 2, 2015 at 11:43 AM, Cory Zue wrote:

Cory

On Wed, Jul 1, 2015 at 11:46 AM, Cory Zue czue@dimagi.com wrote:

Hey Eric,

Any reason to not just make CommCare HQ the data repository? I believe
that it would meet all of your “must haves” and many of your “like to
haves”.

That said, if you need them - we do have a number of ways of pulling
data out of CommCare using the APIs
https://confluence.dimagi.com/display/commcarepublic/CommCare+HQ+APIs
or the data export tool
https://confluence.dimagi.com/display/commcarepublic/CommCare+Data+Export+Tool.
There are also things like MOTECH
http://docs.motechproject.org/en/latest/ which can pull data out of
CommCare (and many other data sources) and serve as a central repository or
an integration hub.

thanks,
Cory

On Wed, Jul 1, 2015 at 9:23 AM, Eric Couper eric.couper@gmail.com wrote:

The holy grail for my project right now would be a software that meets
the following criteria. Because the criteria includes “directly
link/refresh data from CommCare,” I thought it’s be appropriate to ask in
this forum.

Thanks for any leads!

(in order of priority)

Must have:
Centralized, secure repository of all project data in a single
web-based interface both data from Commcare and data manually uploaded from
excel
Ability to append metadata and related documents to a data set
Automated piping (via an API) of data collected over mobiles into the
repository. (in this case, that’s through CommCare)

Like to Have:
Ability to create analysis that draws on data from across several data
sets in the system
Ability to generate and share tables, graphs, and maps that draw on
data from across several data sets in the system
Ability to create organizational accounts with individual projects
within and establish robust permissions
Ability to draw on data stored in the repository into another system
system for further reporting via an API (future need).


You received this message because you are subscribed to the Google
Groups “commcare-users” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to a topic in the
Google Groups “commcare-users” group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/commcare-users/OQSidxivqx8/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Eric A. Couper
m. +1 504 478 9954
e. eric.couper@gmail.com
w. www.ericcouper.com
t. @_couper https://twitter.com/_couper


You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to a topic in the
Google Groups “commcare-users” group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/commcare-users/OQSidxivqx8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Eric A. Couper
m. +1 504 478 9954
e. eric.couper@gmail.com
w. www.ericcouper.com
t. @_couper https://twitter.com/_couper

As an FYI for all, I’m going to try out ZohoReports and use our developers
to create the tie-in. It looks very promising, but it sadly doesn’t have a
mapping component. I’ll handle that separately.

https://www.zoho.com/reports/

-Eric

··· On Thu, Jul 2, 2015 at 11:48 AM, Eric Couper wrote:

On Thu, Jul 2, 2015 at 11:43 AM, Cory Zue czue@dimagi.com wrote:

Hey Eric

Cory,

Thanks for the ideas! A few questions.

Can Commcare allow manual data uploads from excel file?!? We need a
central store of our data collected on mobile and stuff collected on paper
and then later digitized. Also, some of it coming from other sources
already in excel.

You can use the case importer
https://confluence.dimagi.com/display/commcarepublic/Importing+Cases+Using+Excel
to do this.

Eric: Awesome I’ll take a look!

Also, can you point me to where I can associate metadata and related
documented to a CommCare app? I’d like to at minimum include links to data
dictionary, methodology, use agreements for each application or form.

Ah, I misunderstood this requirement. This is not currently possible in
CommCare. Is this basically just a file repository? It seems like you could
easily just manage this in a second service for now, though not sure if
that’s a dealbreaker for you.

Eric: Actually just a text field where we can dump info about a form is
what we are looking for. Ona.io has this with a text field in the web
interface where you can add notes about a form. That way is some different
comes to look at it later they have some background or a message from the
creator.

As an FYI, the best option I’ve found so far is a tool called aWhere,
and it has ODK Aggregate tie-ins, but not CommCare. I’ll definitely
check-out MOTECH, but I’m looking for an off-the-shelf SaaS, something I
could connect CommCare to and get my existing excel files imported to
within a day or two even if there was a moderate price tag. My
understanding is that I’d need a third party or our developers to customize
and stand-up an instance. Is that right?

Yeah, that’s right. Not familiar with awhere and took a quick look at
their website to see if it looked like we might be able to integrate but it
wasn’t obvious how the ODK stuff worked.

Eric: No problem. They are currently planning a new tool, and I think
greater integration will be part of that.

Cory

On Wed, Jul 1, 2015 at 11:46 AM, Cory Zue czue@dimagi.com wrote:

Hey Eric,

Any reason to not just make CommCare HQ the data repository? I believe
that it would meet all of your “must haves” and many of your “like to
haves”.

That said, if you need them - we do have a number of ways of pulling
data out of CommCare using the APIs
https://confluence.dimagi.com/display/commcarepublic/CommCare+HQ+APIs
or the data export tool
https://confluence.dimagi.com/display/commcarepublic/CommCare+Data+Export+Tool.
There are also things like MOTECH
http://docs.motechproject.org/en/latest/ which can pull data out of
CommCare (and many other data sources) and serve as a central repository or
an integration hub.

thanks,
Cory

On Wed, Jul 1, 2015 at 9:23 AM, Eric Couper eric.couper@gmail.com wrote:

The holy grail for my project right now would be a software that meets
the following criteria. Because the criteria includes “directly
link/refresh data from CommCare,” I thought it’s be appropriate to ask in
this forum.

Thanks for any leads!

(in order of priority)

Must have:
Centralized, secure repository of all project data in a single
web-based interface both data from Commcare and data manually uploaded from
excel
Ability to append metadata and related documents to a data set
Automated piping (via an API) of data collected over mobiles into the
repository. (in this case, that’s through CommCare)

Like to Have:
Ability to create analysis that draws on data from across several data
sets in the system
Ability to generate and share tables, graphs, and maps that draw on
data from across several data sets in the system
Ability to create organizational accounts with individual projects
within and establish robust permissions
Ability to draw on data stored in the repository into another system
system for further reporting via an API (future need).


You received this message because you are subscribed to the Google
Groups “commcare-users” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to a topic in the
Google Groups “commcare-users” group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/commcare-users/OQSidxivqx8/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Eric A. Couper
m. +1 504 478 9954
e. eric.couper@gmail.com
w. www.ericcouper.com
t. @_couper https://twitter.com/_couper


You received this message because you are subscribed to the Google
Groups “commcare-users” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to a topic in the
Google Groups “commcare-users” group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/commcare-users/OQSidxivqx8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Eric A. Couper
m. +1 504 478 9954
e. eric.couper@gmail.com
w. www.ericcouper.com
t. @_couper https://twitter.com/_couper


Eric A. Couper
m. +1 504 478 9954
e. eric.couper@gmail.com
w. www.ericcouper.com
t. @_couper https://twitter.com/_couper

Hi,
I would like to follow-regarding Eric’s question on being able to download/ access the data dictionary was address. I mean is a there a procedure for downloading the data dictionary for an existing project?
Regards