CommCare Export Tool queries

Hi Group,

I am working on the CommCare Export Tool for some data export requirement.
I go succeeded to export plain form’s data from this tool. Now I have
following queries for this tool.

we have installed/configured commcare-export tool at our test
environment, and got succeeded to export plain form’s data as per the
details shared at
https://confluence.dimagi.com/display/commcarepublic/CommCare+Data+Export+Tool
.

Further, we have some queries regarding commcare-export tool, and it
would be your great help for us by answering these:

  1. From commcare-export tool’s, export options, I am not seeing any
    parameter/options to specify date range to get monthly data. It will
    require to export monthly data from commcare-export

  2. How can I export data directly to local database of MySQL. It has
    database export option, but that is URL based. My question is lies with
    local instance of MySQL, i.e. local IP and port based installation.

  3. How query file is related with form data? Refer “–query” parameter of
    commcare-export tool.

  4. Should I need to first ‘create export’ in CommCare Web UI, then use
    commcare-export tool?

  5. Is there any documentation/blog to explore all options/parameters of
    commcare-export command. If so, please share.

  6. How to export data (using commcare-export tool), if I have multiple
    applications, multiple modules and multiple forms in each module, in my
    project.

··· -- Ajay

Hi Group,

Your reply will be highly appreciated.

Please help on following queries regarding CommCare Export tool.

··· On Friday, November 18, 2016 at 7:20:19 PM UTC+5:30, Ajay Singh wrote: > > Hi Group, > > I am working on the CommCare Export Tool for some data export requirement. > I go succeeded to export plain form's data from this tool. Now I have > following queries for this tool. > > we have installed/configured *commcare-export* *tool* at our test > environment, and got succeeded to export plain form's data as per the > details shared at > https://confluence.dimagi.com/display/commcarepublic/CommCare+Data+Export+Tool > . > > Further, we have some queries regarding *commcare-export* tool, and it > would be your great help for us by answering these: > > 1) From *commcare-export* tool's, export options, I am not seeing any > parameter/options to specify *date range* to get monthly data. It will > require to export monthly data from commcare-export > > 2) How can I export data directly to local database of MySQL. It has > database export option, but that is URL based. My question is lies with > local instance of MySQL, i.e. local IP and port based installation. > > 3) How query file is related with form data? Refer "--query" parameter of > commcare-export tool. > > 4) Should I need to first 'create export' in CommCare Web UI, then use > commcare-export tool? > > 5) Is there any documentation/blog to explore all options/parameters of > commcare-export command. If so, please share. > > 6) How to export data (using commcare-export tool), if I have multiple > applications, multiple modules and multiple forms in each module, in my > project. > > -- > Ajay >

Hi Ajay,

Responses inline, hope that helps.

Ben

Hi Group,

I am working on the CommCare Export Tool for some data export requirement.
I go succeeded to export plain form’s data from this tool. Now I have
following queries for this tool.

we have installed/configured commcare-export tool at our test
environment, and got succeeded to export plain form’s data as per the
details shared at https://confluence.dimagi.c
om/display/commcarepublic/CommCare+Data+Export+Tool.

Further, we have some queries regarding commcare-export tool, and it
would be your great help for us by answering these:

  1. From commcare-export tool’s, export options, I am not seeing any
    parameter/options to specify date range to get monthly data. It will
    require to export monthly data from commcare-export

You can specify a --since parameter to get all forms from a certain
submission date (
https://github.com/dimagi/commcare-export#installation--quick-start)

  1. How can I export data directly to local database of MySQL. It has
    database export option, but that is URL based. My question is lies with
    local instance of MySQL, i.e. local IP and port based installation.

You should still be able to export to a local database using the --output
parameter. All mysql instances should have a URL that you can connect
trying looking up some information on MySQL connection string.

  1. How query file is related with form data? Refer “–query” parameter of
    commcare-export tool.

I’m not exactly sure what you mean by this, but you can check out some
examples here:
https://github.com/dimagi/commcare-export/tree/master/examples. The query
file dictates which properties to include and how to map them.

  1. Should I need to first ‘create export’ in CommCare Web UI, then use
    commcare-export tool?

No

  1. Is there any documentation/blog to explore all options/parameters of
    commcare-export command. If so, please share.

We have a page here you can look at:
https://confluence.dimagi.com/display/commcarepublic/CommCare+Data+Export+Tool.
You can also check out the readme on the github page:
https://github.com/dimagi/commcare-export

  1. How to export data (using commcare-export tool), if I have multiple
    applications, multiple modules and multiple forms in each module, in my
    project.

Please see documentation from the links pasted above

··· On Fri, Nov 18, 2016 at 8:50 AM, Ajay Singh wrote:


Ajay


You received this message because you are subscribed to the Google Groups
"CommCare Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Hi Ben,

The --since parameter is clear now, however still there is no option for
specifying Date Range.
Also, MySQL DB URL is not much clear. Can you please give some detail on
this context.

··· -- Thanks, *Ajay Singh* *Corporate** Renaissance **Group* Cell (India): +91-9711628763​ Email: ajay.singh@crgoup.co.in

[image: CR Group] http://www.crgroup.com/[image: Rapid-Fire Business
Intelligence & Analytics] http://www.tableau.com/

On Wed, Nov 23, 2016 at 12:27 AM, Ajay Singh ajay.singh@crgroup.co.in wrote:

Thanks Ben,

I will check and update you.

On Wednesday, November 23, 2016 at 12:02:03 AM UTC+5:30, Ben Rudolph wrote:

Hi Ajay,

Responses inline, hope that helps.

Ben

On Fri, Nov 18, 2016 at 8:50 AM, Ajay Singh ajay....@crgroup.co.in wrote:

Hi Group,

I am working on the CommCare Export Tool for some data export
requirement. I go succeeded to export plain form’s data from this tool. Now
I have following queries for this tool.

we have installed/configured commcare-export tool at our test
environment, and got succeeded to export plain form’s data as per the
details shared at https://confluence.dimagi.c
om/display/commcarepublic/CommCare+Data+Export+Tool.

Further, we have some queries regarding commcare-export tool, and it
would be your great help for us by answering these:

  1. From commcare-export tool’s, export options, I am not seeing any
    parameter/options to specify date range to get monthly data. It will
    require to export monthly data from commcare-export

You can specify a --since parameter to get all forms from a certain
submission date (https://github.com/dimagi/com
mcare-export#installation–quick-start)

  1. How can I export data directly to local database of MySQL. It has
    database export option, but that is URL based. My question is lies with
    local instance of MySQL, i.e. local IP and port based installation.

You should still be able to export to a local database using the --output
parameter. All mysql instances should have a URL that you can connect
trying looking up some information on MySQL connection string.

  1. How query file is related with form data? Refer “–query” parameter
    of commcare-export tool.

I’m not exactly sure what you mean by this, but you can check out some
examples here: https://github.com/dimagi/comm
care-export/tree/master/examples. The query file dictates which
properties to include and how to map them.

  1. Should I need to first ‘create export’ in CommCare Web UI, then use
    commcare-export tool?

No

  1. Is there any documentation/blog to explore all options/parameters of
    commcare-export command. If so, please share.

We have a page here you can look at: https://confluence.dimagi.com/
display/commcarepublic/CommCare+Data+Export+Tool. You can also check out
the readme on the github page: https://github.com/dimagi/commcare-export

  1. How to export data (using commcare-export tool), if I have multiple
    applications, multiple modules and multiple forms in each module, in my
    project.

Please see documentation from the links pasted above


Ajay


You received this message because you are subscribed to the Google
Groups “CommCare Developers” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to commcare-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Hi Ajay

There is no way to specify a date range however if you are exporting to
MySQL then the export tool will maintain it’s own state and only fetch data
since the previous time it was run.

The format of the MySQL URL is: 'mysql://username:password@host
/database_name

··· On 23 November 2016 at 21:16, Ajay Singh wrote:

Hi Ben,

The --since parameter is clear now, however still there is no option for
specifying Date Range.
Also, MySQL DB URL is not much clear. Can you please give some detail on
this context.


Thanks,
Ajay Singh
Corporate* Renaissance *Group
Cell (India): +91-9711628763​
Email: ajay.singh@crgoup.co.in

[image: CR Group] http://www.crgroup.com/[image: Rapid-Fire Business
Intelligence & Analytics] http://www.tableau.com/

On Wed, Nov 23, 2016 at 12:27 AM, Ajay Singh ajay.singh@crgroup.co.in wrote:

Thanks Ben,

I will check and update you.

On Wednesday, November 23, 2016 at 12:02:03 AM UTC+5:30, Ben Rudolph wrote:

Hi Ajay,

Responses inline, hope that helps.

Ben

On Fri, Nov 18, 2016 at 8:50 AM, Ajay Singh ajay....@crgroup.co.in wrote:

Hi Group,

I am working on the CommCare Export Tool for some data export
requirement. I go succeeded to export plain form’s data from this tool. Now
I have following queries for this tool.

we have installed/configured commcare-export tool at our test
environment, and got succeeded to export plain form’s data as per the
details shared at https://confluence.dimagi.c
om/display/commcarepublic/CommCare+Data+Export+Tool.

Further, we have some queries regarding commcare-export tool, and it
would be your great help for us by answering these:

  1. From commcare-export tool’s, export options, I am not seeing any
    parameter/options to specify date range to get monthly data. It will
    require to export monthly data from commcare-export

You can specify a --since parameter to get all forms from a certain
submission date (https://github.com/dimagi/com
mcare-export#installation–quick-start)

  1. How can I export data directly to local database of MySQL. It has
    database export option, but that is URL based. My question is lies with
    local instance of MySQL, i.e. local IP and port based installation.

You should still be able to export to a local database using the
–output parameter. All mysql instances should have a URL that you can
connect trying looking up some information on MySQL connection string.

  1. How query file is related with form data? Refer “–query” parameter
    of commcare-export tool.

I’m not exactly sure what you mean by this, but you can check out some
examples here: https://github.com/dimagi/comm
care-export/tree/master/examples. The query file dictates which
properties to include and how to map them.

  1. Should I need to first ‘create export’ in CommCare Web UI, then use
    commcare-export tool?

No

  1. Is there any documentation/blog to explore all options/parameters of
    commcare-export command. If so, please share.

We have a page here you can look at: https://confluence.dimagi.com/
display/commcarepublic/CommCare+Data+Export+Tool. You can also check
out the readme on the github page: https://github.com/dimag
i/commcare-export

  1. How to export data (using commcare-export tool), if I have multiple
    applications, multiple modules and multiple forms in each module, in my
    project.

Please see documentation from the links pasted above


Ajay


You received this message because you are subscribed to the Google
Groups “CommCare Developers” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to commcare-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"CommCare Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Simon Kelly
Senior Engineer | Dimagi South Africa

Thanks Simon,

We will check and update you accordingly.

Thanks for your support.

··· -- Thanks, *Ajay Singh* *Corporate** Renaissance **Group* Cell (India): +91-9711628763​ Email: ajay.singh@crgoup.co.in

[image: CR Group] http://www.crgroup.com/[image: Rapid-Fire Business
Intelligence & Analytics] http://www.tableau.com/

On Mon, Nov 28, 2016 at 1:32 PM, ​​ Simon Kelly skelly@dimagi.com wrote:

Hi Ajay

There is no way to specify a date range however if you are exporting to
MySQL then the export tool will maintain it’s own state and only fetch data
since the previous time it was run.

The format of the MySQL URL is: 'mysql://username:password@host
/database_name

On 23 November 2016 at 21:16, Ajay Singh ajay.singh@crgroup.co.in wrote:

Hi Ben,

The --since parameter is clear now, however still there is no option for
specifying Date Range.
Also, MySQL DB URL is not much clear. Can you please give some detail on
this context.


Thanks,
Ajay Singh
Corporate* Renaissance *Group
Cell (India): +91-9711628763​
Email: ajay.singh@crgoup.co.in

[image: CR Group] http://www.crgroup.com/[image: Rapid-Fire Business
Intelligence & Analytics] http://www.tableau.com/

On Wed, Nov 23, 2016 at 12:27 AM, Ajay Singh ajay.singh@crgroup.co.in wrote:

Thanks Ben,

I will check and update you.

On Wednesday, November 23, 2016 at 12:02:03 AM UTC+5:30, Ben Rudolph wrote:

Hi Ajay,

Responses inline, hope that helps.

Ben

On Fri, Nov 18, 2016 at 8:50 AM, Ajay Singh ajay....@crgroup.co.in wrote:

Hi Group,

I am working on the CommCare Export Tool for some data export
requirement. I go succeeded to export plain form’s data from this tool. Now
I have following queries for this tool.

we have installed/configured commcare-export tool at our test
environment, and got succeeded to export plain form’s data as per the
details shared at https://confluence.dimagi.c
om/display/commcarepublic/CommCare+Data+Export+Tool.

Further, we have some queries regarding commcare-export tool, and
it would be your great help for us by answering these:

  1. From commcare-export tool’s, export options, I am not seeing any
    parameter/options to specify date range to get monthly data. It
    will require to export monthly data from commcare-export

You can specify a --since parameter to get all forms from a certain
submission date (https://github.com/dimagi/com
mcare-export#installation–quick-start)

  1. How can I export data directly to local database of MySQL. It has
    database export option, but that is URL based. My question is lies with
    local instance of MySQL, i.e. local IP and port based installation.

You should still be able to export to a local database using the
–output parameter. All mysql instances should have a URL that you can
connect trying looking up some information on MySQL connection string.

  1. How query file is related with form data? Refer “–query” parameter
    of commcare-export tool.

I’m not exactly sure what you mean by this, but you can check out some
examples here: https://github.com/dimagi/comm
care-export/tree/master/examples. The query file dictates which
properties to include and how to map them.

  1. Should I need to first ‘create export’ in CommCare Web UI, then use
    commcare-export tool?

No

  1. Is there any documentation/blog to explore all options/parameters
    of commcare-export command. If so, please share.

We have a page here you can look at: https://confluence.dimagi.com/
display/commcarepublic/CommCare+Data+Export+Tool. You can also check
out the readme on the github page: https://github.com/dimag
i/commcare-export

  1. How to export data (using commcare-export tool), if I have
    multiple applications, multiple modules and multiple forms in each module,
    in my project.

Please see documentation from the links pasted above


Ajay


You received this message because you are subscribed to the Google
Groups “CommCare Developers” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to commcare-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"CommCare Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to commcare-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Simon Kelly
Senior Engineer | Dimagi South Africa


You received this message because you are subscribed to a topic in the
Google Groups “CommCare Developers” group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/commcare-developers/uyw4R85DgQw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
commcare-developers+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.