I've never used the CommCare Data Export Tool, but I'm thinking about how
to set up a system around it. The plan is to have a database server remote
from the system running the data export tool, and having the tool populate
a database on that server. In this scenario, does the CommCare server talk
directly to the remote database server to provide data, or does all data
flow through the system running the export tool?
There are two reasons for asking this question (a), consideration of the
network load on the system running the export tool (which might be in an
area of poor Internet bandwidth), and (b) that the database server might be
only accessible from the system running the export tool via a VPN, and
would therefore be inaccessible to the CommCare server. Of course, for (a)
I would rather the CommCare server talked directly to the database server,
but for (b) I would rather it didn't!
Thanks for any advice.
Hi James
The export tool is a pull system so your DB server would connect to the
CommCare server and download the data. The other option is to the the data
forwarding API's which will send any case or form changes to a URL that you
specify. Obviously the second option requires that there be a web
accessible URL that CommCare can push the data to.It also means that the
onus is on you to managed putting the data in your database.
From a bandwidth perspective there shouldn't be too much difference
provided you run the data export tool on a regular schedule to ensure that
there isn't a large backlog of data to fetch.
I hope that answers your questions.
Simon
···
On 20 March 2014 05:36, james beard wrote:
I've never used the CommCare Data Export Tool, but I'm thinking about how
to set up a system around it. The plan is to have a database server remote
from the system running the data export tool, and having the tool populate
a database on that server. In this scenario, does the CommCare server talk
directly to the remote database server to provide data, or does all data
flow through the system running the export tool?
There are two reasons for asking this question (a), consideration of the
network load on the system running the export tool (which might be in an
area of poor Internet bandwidth), and (b) that the database server might be
only accessible from the system running the export tool via a VPN, and
would therefore be inaccessible to the CommCare server. Of course, for (a)
I would rather the CommCare server talked directly to the database server,
but for (b) I would rather it didn't!
Thanks for any advice.
--
You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
Simon Kelly
Senior Engineer | Dimagi South Africa
Hi James
To add one more point, you can also create saved data exports in
CommCareHQ, and then use the web url of your export to get that data into
your system (into excel for example). Instructions for doing so can be
found here (mainly Steps 1 and 2):
https://wiki.commcarehq.org/display/commcarepublic/Tutorial%3A+Create+an+Excel+Dashboard
Thanks!
Abhishek
···
On Thu, Mar 20, 2014 at 1:11 PM, Simon Kelly wrote:
Hi James
The export tool is a pull system so your DB server would connect to the
CommCare server and download the data. The other option is to the the data
forwarding API's which will send any case or form changes to a URL that you
specify. Obviously the second option requires that there be a web
accessible URL that CommCare can push the data to.It also means that the
onus is on you to managed putting the data in your database.
From a bandwidth perspective there shouldn't be too much difference
provided you run the data export tool on a regular schedule to ensure that
there isn't a large backlog of data to fetch.
I hope that answers your questions.
Simon
On 20 March 2014 05:36, james beard james.beard.tz@gmail.com wrote:
I've never used the CommCare Data Export Tool, but I'm thinking about how
to set up a system around it. The plan is to have a database server remote
from the system running the data export tool, and having the tool populate
a database on that server. In this scenario, does the CommCare server talk
directly to the remote database server to provide data, or does all data
flow through the system running the export tool?
There are two reasons for asking this question (a), consideration of the
network load on the system running the export tool (which might be in an
area of poor Internet bandwidth), and (b) that the database server might be
only accessible from the system running the export tool via a VPN, and
would therefore be inaccessible to the CommCare server. Of course, for (a)
I would rather the CommCare server talked directly to the database server,
but for (b) I would rather it didn't!
Thanks for any advice.
--
You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
Simon Kelly
Senior Engineer | Dimagi South Africa
--
You received this message because you are subscribed to the Google Groups
"commcare-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Thanks for the quick responses. I can see my way forward now...
···
On Thursday, March 20, 2014 7:54:31 AM UTC, Abhishek Prateek wrote:
>
> Hi James
>
> To add one more point, you can also create saved data exports in
> CommCareHQ, and then use the web url of your export to get that data into
> your system (into excel for example). Instructions for doing so can be
> found here (mainly Steps 1 and 2):
>
> https://wiki.commcarehq.org/display/commcarepublic/Tutorial%3A+Create+an+Excel+Dashboard
>
> Thanks!
> Abhishek
>
>
> On Thu, Mar 20, 2014 at 1:11 PM, Simon Kelly <ske...@dimagi.com wrote:
>
>> Hi James
>>
>> The export tool is a pull system so your DB server would connect to the
>> CommCare server and download the data. The other option is to the the data
>> forwarding API's which will send any case or form changes to a URL that you
>> specify. Obviously the second option requires that there be a web
>> accessible URL that CommCare can push the data to.It also means that the
>> onus is on you to managed putting the data in your database.
>>
>> From a bandwidth perspective there shouldn't be too much difference
>> provided you run the data export tool on a regular schedule to ensure that
>> there isn't a large backlog of data to fetch.
>>
>> I hope that answers your questions.
>> Simon
>>
>>
>> On 20 March 2014 05:36, james beard <james.b...@gmail.com >wrote:
>>
>>> I've never used the CommCare Data Export Tool, but I'm thinking about
>>> how to set up a system around it. The plan is to have a database server
>>> remote from the system running the data export tool, and having the tool
>>> populate a database on that server. In this scenario, does the CommCare
>>> server talk directly to the remote database server to provide data, or does
>>> all data flow through the system running the export tool?
>>>
>>> There are two reasons for asking this question (a), consideration of the
>>> network load on the system running the export tool (which might be in an
>>> area of poor Internet bandwidth), and (b) that the database server might be
>>> only accessible from the system running the export tool via a VPN, and
>>> would therefore be inaccessible to the CommCare server. Of course, for (a)
>>> I would rather the CommCare server talked directly to the database server,
>>> but for (b) I would rather it didn't!
>>>
>>> Thanks for any advice.
>>>
>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "commcare-users" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to commcare-user...@googlegroups.com .
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>
>>
>> --
>> Simon Kelly
>> Senior Engineer | Dimagi South Africa
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "commcare-users" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to commcare-user...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>