CommCareHQ Interaction Log

Hey CC Users,

I just wanted to share this Interaction Log that I’ve been doing over the
last month or so. An idea from Jon, the point of this log is to document
user interaction while using the new CCHQ so the devs can understand how
users currently *use *and how they would like to *use *the new HQ. From
this, devs can figure out how HQ can best serve the needs of users.

So, I quickly logged some interactions with HQ, and now I’m sharing with you
guys. Anyone have thoughts/agree/disagree on some of the things I mention,
on other interactions/experiences you’ve had, etc.

Thanks!
Nick

Nick P. Amland

CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.com namland08@gmail.com

Log of CommCare HQ Interaction.docx (13.4 KB)

Nick,

This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I’ve had a chance to read it more thoroughly.

-Clayton

··· On Thu, May 5, 2011 at 12:59 PM, Nick Amland wrote:

Hey CC Users,

I just wanted to share this Interaction Log that I’ve been doing over the
last month or so. An idea from Jon, the point of this log is to document
user interaction while using the new CCHQ so the devs can understand how
users currently *use *and how they would like to *use *the new HQ. From
this, devs can figure out how HQ can best serve the needs of users.

So, I quickly logged some interactions with HQ, and now I’m sharing with
you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you’ve had, etc.

Thanks!
Nick

Nick P. Amland

CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.com namland08@gmail.com

Hi Nick,

Chiming in here because I think this is really interesting. You’ve echoed a
few things I definitely thought about in Dodoma.

A few questions, for whomever can/wants to answer:

  1. “Form Completion Report”: I’ve never seen what this looks like. Does it
    actually log the time the form is closed and saved, rather than when it is
    submitted? I know that some of the CHVs store up their forms and wait til
    they know they have good GPRS to send.

  2. If it is—this could be useful for flagging for data quality. I wonder
    if there could be a way to flag or trigger an alert for submitted forms that
    have a completion time outside of when we expect CHVs to be making visits?

  3. As for a ‘by the hour’ report----I feel like this is less useful than a
    side-by-side completion versus submission stats report. I know that each CHV
    has her own modus operandi for whether she submits right away, or saves and
    submits all the forms later. If we could look and see (“Oh, okay, she
    collected data throughout the week and then submitted all at once”) if this
    were the case, or if it truly is an anomaly, that would be so helpful.

  4. The fact that for one CHV, most of the 25 submitted forms were visits to
    clients who were not at home—this is interesting, and you’re right,
    something to watch. But difficult to definitively call a problem—not as if
    we can make them prove that a client wasn’t actually at home…

In any case, a useful log. Thanks for the thoughts!

Cheers,
Sarah

··· On Thu, May 5, 2011 at 1:39 PM, Clayton Sims wrote:

Nick,

This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I’ve had a chance to read it more thoroughly.

-Clayton

On Thu, May 5, 2011 at 12:59 PM, Nick Amland namland@dimagi.com wrote:

Hey CC Users,

I just wanted to share this Interaction Log that I’ve been doing over the
last month or so. An idea from Jon, the point of this log is to document
user interaction while using the new CCHQ so the devs can understand how
users currently *use *and how they would like to *use *the new HQ. From
this, devs can figure out how HQ can best serve the needs of users.

So, I quickly logged some interactions with HQ, and now I’m sharing with
you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you’ve had, etc.

Thanks!
Nick

Nick P. Amland

CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.com namland08@gmail.com

Hi Nick

Thank you for sharing this out, actually it is useful to know such
information.

Gayo

··· From: commcare-users@googlegroups.com [mailto:commcare-users@googlegroups.com] On Behalf Of Nick Amland Sent: Thursday, May 05, 2011 7:59 PM To: commcare-users Subject: CommCareHQ Interaction Log

Hey CC Users,

I just wanted to share this Interaction Log that I’ve been doing over the
last month or so. An idea from Jon, the point of this log is to document
user interaction while using the new CCHQ so the devs can understand how
users currently use and how they would like to use the new HQ. From this,
devs can figure out how HQ can best serve the needs of users.

So, I quickly logged some interactions with HQ, and now I’m sharing with you
guys. Anyone have thoughts/agree/disagree on some of the things I mention,
on other interactions/experiences you’ve had, etc.

Thanks!

Nick

Nick P. Amland

CommCare Field Fellow

Dimagi, Inc.

Dodoma, Tanzania

Google Voice: 253.642.7790

TZ Mobile: +255 762 740 996 tel:%2B255%20762%20740%20996
Email: namland@dimagi.com mailto:namland08@gmail.com

does cchq have some report that shows ‘bubbles’ for each hour of the day to
show relative levels of commcare activity?

for forms filled-out during non-standard times, is it possible they’re
practicing?

··· On Fri, May 6, 2011 at 12:18 AM, Sarah Searle wrote:

Hi Nick,

Chiming in here because I think this is really interesting. You’ve echoed a
few things I definitely thought about in Dodoma.

A few questions, for whomever can/wants to answer:

  1. “Form Completion Report”: I’ve never seen what this looks like. Does it
    actually log the time the form is closed and saved, rather than when it is
    submitted? I know that some of the CHVs store up their forms and wait til
    they know they have good GPRS to send.

  2. If it is—this could be useful for flagging for data quality. I wonder
    if there could be a way to flag or trigger an alert for submitted forms that
    have a completion time outside of when we expect CHVs to be making visits?

  3. As for a ‘by the hour’ report----I feel like this is less useful than a
    side-by-side completion versus submission stats report. I know that each CHV
    has her own modus operandi for whether she submits right away, or saves and
    submits all the forms later. If we could look and see (“Oh, okay, she
    collected data throughout the week and then submitted all at once”) if this
    were the case, or if it truly is an anomaly, that would be so helpful.

  4. The fact that for one CHV, most of the 25 submitted forms were visits to
    clients who were not at home—this is interesting, and you’re right,
    something to watch. But difficult to definitively call a problem—not as if
    we can make them prove that a client wasn’t actually at home…

In any case, a useful log. Thanks for the thoughts!

Cheers,
Sarah

On Thu, May 5, 2011 at 1:39 PM, Clayton Sims csims@dimagi.com wrote:

Nick,

This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I’ve had a chance to read it more thoroughly.

-Clayton

On Thu, May 5, 2011 at 12:59 PM, Nick Amland namland@dimagi.com wrote:

Hey CC Users,

I just wanted to share this Interaction Log that I’ve been doing over the
last month or so. An idea from Jon, the point of this log is to document
user interaction while using the new CCHQ so the devs can understand how
users currently *use *and how they would like to *use *the new HQ. From
this, devs can figure out how HQ can best serve the needs of users.

So, I quickly logged some interactions with HQ, and now I’m sharing with
you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you’ve had, etc.

Thanks!
Nick

Nick P. Amland

CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.com namland08@gmail.com

Hey Drew,

Yeah, I’ve looked at the submit time bubble report a few times. I don’t
find it as helpful because those are submit times, not form completion
times. CHVs aren’t in the habit of submitting immediately after they
complete a form. Many CHVs send at another time so that time isn’t very
valuable.

Having this bubble report reflecting, instead, form completion times would
be a good way to get a general impression and idea of when users are doing
their CC related activities. However, I don’t think it really provides any
actionable information because it’s at a very high level.

As for potentially being practice forms, in our particular case (dodoma
program), most of our users are pretty experienced with our
forms/process/etc now and aren’t practicing any more. So, it’s unlikely
though a good thought.

Thanks,
Nick

Nick P. Amland

CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.com namland08@gmail.com

··· On Fri, May 6, 2011 at 12:52 PM, Drew Roos wrote:

does cchq have some report that shows ‘bubbles’ for each hour of the day to
show relative levels of commcare activity?

for forms filled-out during non-standard times, is it possible they’re
practicing?

On Fri, May 6, 2011 at 12:18 AM, Sarah Searle searle.sarah@gmail.comwrote:

Hi Nick,

Chiming in here because I think this is really interesting. You’ve echoed
a few things I definitely thought about in Dodoma.

A few questions, for whomever can/wants to answer:

  1. “Form Completion Report”: I’ve never seen what this looks like. Does it
    actually log the time the form is closed and saved, rather than when it is
    submitted? I know that some of the CHVs store up their forms and wait til
    they know they have good GPRS to send.

  2. If it is—this could be useful for flagging for data quality. I wonder
    if there could be a way to flag or trigger an alert for submitted forms that
    have a completion time outside of when we expect CHVs to be making visits?

  3. As for a ‘by the hour’ report----I feel like this is less useful than a
    side-by-side completion versus submission stats report. I know that each CHV
    has her own modus operandi for whether she submits right away, or saves and
    submits all the forms later. If we could look and see (“Oh, okay, she
    collected data throughout the week and then submitted all at once”) if this
    were the case, or if it truly is an anomaly, that would be so helpful.

  4. The fact that for one CHV, most of the 25 submitted forms were visits
    to clients who were not at home—this is interesting, and you’re right,
    something to watch. But difficult to definitively call a problem—not as if
    we can make them prove that a client wasn’t actually at home…

In any case, a useful log. Thanks for the thoughts!

Cheers,
Sarah

On Thu, May 5, 2011 at 1:39 PM, Clayton Sims csims@dimagi.com wrote:

Nick,

This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I’ve had a chance to read it more thoroughly.

-Clayton

On Thu, May 5, 2011 at 12:59 PM, Nick Amland namland@dimagi.com wrote:

Hey CC Users,

I just wanted to share this Interaction Log that I’ve been doing over
the last month or so. An idea from Jon, the point of this log is to
document user interaction while using the new CCHQ so the devs can
understand how users currently *use *and how they would like to *use *the
new HQ. From this, devs can figure out how HQ can best serve the needs of
users.

So, I quickly logged some interactions with HQ, and now I’m sharing with
you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you’ve had, etc.

Thanks!
Nick

Nick P. Amland

CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.com namland08@gmail.com

ah, yeah. start time would be a more useful metric. but it’s complicated by
the fact that the phone’s time is often wrong. i think we have the
capability to apply some skew correction now, but it’s not foolproof.

session duration (end time - start time) could also be a useful metric.

··· On Fri, May 6, 2011 at 3:37 PM, Nick Amland wrote:

Hey Drew,

Yeah, I’ve looked at the submit time bubble report a few times. I don’t
find it as helpful because those are submit times, not form completion
times. CHVs aren’t in the habit of submitting immediately after they
complete a form. Many CHVs send at another time so that time isn’t very
valuable.

Having this bubble report reflecting, instead, form completion times would
be a good way to get a general impression and idea of when users are doing
their CC related activities. However, I don’t think it really provides any
actionable information because it’s at a very high level.

As for potentially being practice forms, in our particular case (dodoma
program), most of our users are pretty experienced with our
forms/process/etc now and aren’t practicing any more. So, it’s unlikely
though a good thought.

Thanks,
Nick

Nick P. Amland

CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.com namland08@gmail.com

On Fri, May 6, 2011 at 12:52 PM, Drew Roos droos@dimagi.com wrote:

does cchq have some report that shows ‘bubbles’ for each hour of the day
to show relative levels of commcare activity?

for forms filled-out during non-standard times, is it possible they’re
practicing?

On Fri, May 6, 2011 at 12:18 AM, Sarah Searle searle.sarah@gmail.comwrote:

Hi Nick,

Chiming in here because I think this is really interesting. You’ve echoed
a few things I definitely thought about in Dodoma.

A few questions, for whomever can/wants to answer:

  1. “Form Completion Report”: I’ve never seen what this looks like. Does
    it actually log the time the form is closed and saved, rather than when it
    is submitted? I know that some of the CHVs store up their forms and wait til
    they know they have good GPRS to send.

  2. If it is—this could be useful for flagging for data quality. I
    wonder if there could be a way to flag or trigger an alert for submitted
    forms that have a completion time outside of when we expect CHVs to be
    making visits?

  3. As for a ‘by the hour’ report----I feel like this is less useful than
    a side-by-side completion versus submission stats report. I know that each
    CHV has her own modus operandi for whether she submits right away, or saves
    and submits all the forms later. If we could look and see (“Oh, okay, she
    collected data throughout the week and then submitted all at once”) if this
    were the case, or if it truly is an anomaly, that would be so helpful.

  4. The fact that for one CHV, most of the 25 submitted forms were visits
    to clients who were not at home—this is interesting, and you’re right,
    something to watch. But difficult to definitively call a problem—not as if
    we can make them prove that a client wasn’t actually at home…

In any case, a useful log. Thanks for the thoughts!

Cheers,
Sarah

On Thu, May 5, 2011 at 1:39 PM, Clayton Sims csims@dimagi.com wrote:

Nick,

This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I’ve had a chance to read it more thoroughly.

-Clayton

On Thu, May 5, 2011 at 12:59 PM, Nick Amland namland@dimagi.comwrote:

Hey CC Users,

I just wanted to share this Interaction Log that I’ve been doing over
the last month or so. An idea from Jon, the point of this log is to
document user interaction while using the new CCHQ so the devs can
understand how users currently *use *and how they would like to *use *the
new HQ. From this, devs can figure out how HQ can best serve the needs of
users.

So, I quickly logged some interactions with HQ, and now I’m sharing
with you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you’ve had, etc.

Thanks!
Nick

Nick P. Amland

CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.com namland08@gmail.com

CC1.1 provides some good skew correction, and having the jar signed also
does. We discussed adding a report that lets you know what people’s skew
times look like at a glance which should hopefully be in this month.

And definitely agreed on session duration per chw.

-Clayton

··· On Fri, May 6, 2011 at 8:15 AM, Drew Roos wrote:

ah, yeah. start time would be a more useful metric. but it’s complicated by
the fact that the phone’s time is often wrong. i think we have the
capability to apply some skew correction now, but it’s not foolproof.

session duration (end time - start time) could also be a useful metric.

On Fri, May 6, 2011 at 3:37 PM, Nick Amland namland@dimagi.com wrote:

Hey Drew,

Yeah, I’ve looked at the submit time bubble report a few times. I don’t
find it as helpful because those are submit times, not form completion
times. CHVs aren’t in the habit of submitting immediately after they
complete a form. Many CHVs send at another time so that time isn’t very
valuable.

Having this bubble report reflecting, instead, form completion times would
be a good way to get a general impression and idea of when users are doing
their CC related activities. However, I don’t think it really provides any
actionable information because it’s at a very high level.

As for potentially being practice forms, in our particular case (dodoma
program), most of our users are pretty experienced with our
forms/process/etc now and aren’t practicing any more. So, it’s unlikely
though a good thought.

Thanks,
Nick

Nick P. Amland

CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.com namland08@gmail.com

On Fri, May 6, 2011 at 12:52 PM, Drew Roos droos@dimagi.com wrote:

does cchq have some report that shows ‘bubbles’ for each hour of the day
to show relative levels of commcare activity?

for forms filled-out during non-standard times, is it possible they’re
practicing?

On Fri, May 6, 2011 at 12:18 AM, Sarah Searle searle.sarah@gmail.comwrote:

Hi Nick,

Chiming in here because I think this is really interesting. You’ve
echoed a few things I definitely thought about in Dodoma.

A few questions, for whomever can/wants to answer:

  1. “Form Completion Report”: I’ve never seen what this looks like. Does
    it actually log the time the form is closed and saved, rather than when it
    is submitted? I know that some of the CHVs store up their forms and wait til
    they know they have good GPRS to send.

  2. If it is—this could be useful for flagging for data quality. I
    wonder if there could be a way to flag or trigger an alert for submitted
    forms that have a completion time outside of when we expect CHVs to be
    making visits?

  3. As for a ‘by the hour’ report----I feel like this is less useful than
    a side-by-side completion versus submission stats report. I know that each
    CHV has her own modus operandi for whether she submits right away, or saves
    and submits all the forms later. If we could look and see (“Oh, okay, she
    collected data throughout the week and then submitted all at once”) if this
    were the case, or if it truly is an anomaly, that would be so helpful.

  4. The fact that for one CHV, most of the 25 submitted forms were visits
    to clients who were not at home—this is interesting, and you’re right,
    something to watch. But difficult to definitively call a problem—not as if
    we can make them prove that a client wasn’t actually at home…

In any case, a useful log. Thanks for the thoughts!

Cheers,
Sarah

On Thu, May 5, 2011 at 1:39 PM, Clayton Sims csims@dimagi.com wrote:

Nick,

This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I’ve had a chance to read it more thoroughly.

-Clayton

On Thu, May 5, 2011 at 12:59 PM, Nick Amland namland@dimagi.comwrote:

Hey CC Users,

I just wanted to share this Interaction Log that I’ve been doing over
the last month or so. An idea from Jon, the point of this log is to
document user interaction while using the new CCHQ so the devs can
understand how users currently *use *and how they would like to *use
*the new HQ. From this, devs can figure out how HQ can best serve
the needs of users.

So, I quickly logged some interactions with HQ, and now I’m sharing
with you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you’ve had, etc.

Thanks!
Nick

Nick P. Amland

CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.com namland08@gmail.com