List Forms API Dropping a lot of Columns

Developers
1

Dear Team,

I have been using the List Forms API to download commcare data and it has been working well. However recently I realized that the API is dropping a lot of columns.

Kindly help.
Thanks!

2

Hi @JaneIgoki, sorry to hear it!

Do you have an example of which columns are being dropped, and in what scenario? This will help us better understand the issue.

Thanks!

-Farid

1 Like
3

Dear Farid,

Thanks for reaching out, I really appreciate it!
This url:
https://www.commcarehq.org/a/pula-advisors/api/v0.5/form/?xmlns=http://openrosa.org/formdesigner/0EC525F3-AD28-42D6-9473-CD431A5AC1A7&app_id=365d3a76ca4d4e10a1abc5e833f90542&limit=1&offset=0

Is dropping roughly 48 columns as shown below:
{'box1_animal_encroachment_date',
'box1_corner1_total_loss_photo',
'box1_corner2_total_loss_photo',
'box1_corner3_total_loss_photo',
'box1_corner4_total_loss_photo',
'box1_drought_occurence_date',
'box1_flood_causes',
'box1_flood_occurence_date',
'box1_harvests_no.box_1_non_compliance_confirmation',
'box1_harvests_no.other_reason_why_no_crop_survived_in_box_1',
'box1_harvests_no.why_no_crop_survived_in_box1',
'box1_harvests_no.why_unable_to_capture_box1_weight',
'box1_locust_infestation_date',
'box1_other_issues_occurrence_date',
'box1_other_pest_disease_occurence_date',
'box1_pest_or_disease_mitigation',
'box1_pests_and_diseases_evidence',
'box1_pests_and_diseases_evidence_photo',
'box1_type_of_pests_or_diseases',
'box2_animal_encroachment_date',
'box2_corner1_total_loss_photo',
'box2_corner2_total_loss_photo',
'box2_corner3_total_loss_photo',
'box2_corner4_total_loss_photo',
'box2_drought_occurence_date',
'box2_flood_causes',
'box2_flood_name_of_river_or_dam',
'box2_flood_occurence_date',
'box2_harvests_no.box_2_non_compliance_confirmation',
'box2_harvests_no.other_reason_why_no_crop_survived_in_box_2',
'box2_harvests_no.why_no_crop_survived_in_box2',
'box2_harvests_no.why_unable_to_capture_box2_weight',
'box2_locust_infestation_date',
'box2_other_issues_occurrence_date',
'box2_other_pest_disease_occurence_date',
'box2_pests_and_diseases_evidence',
'box2_pests_and_diseases_evidence_photo',
'box2_pests_and_diseases_mitigation',
'box2_type_of_pests_or_diseases',
'completed_time',
'formid',
'hq_user',
'number',
'received_on',
'started_time',
'total_loss_video_box1',
'total_loss_video_box2',
'what_is_the_name_of_the_river_or_dam_that_cause_the_flooding'}

Thanks again for your support!

Kind regards,
Jane

4

Hi Jane,

If the form submission doesn't contain those properties (e.g. if the question wasn't answered or didn't meet the display condition), it won't be shown. You can see examples of individual form submissions in the Submit History report.

For other metadata properties, you can find most of these in the meta block in the API response:

completed_time: "meta.timeEnd"
formid: "meta.instanceID"
hq_user: "meta.userID"
received_on: "received_on"
etc.

Thanks,