I just wanted to share this Interaction Log that I've been doing over the
last month or so. An idea from Jon, the point of this log is to document
user interaction while using the new CCHQ so the devs can understand how
users currently *use *and how they would like to *use *the new HQ. From
this, devs can figure out how HQ can best serve the needs of users.
So, I quickly logged some interactions with HQ, and now I'm sharing with you
guys. Anyone have thoughts/agree/disagree on some of the things I mention,
on other interactions/experiences you've had, etc.
Thanks!
Nick
Nick P. Amland
CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.comnamland08@gmail.com
This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I've had a chance to read it more thoroughly.
-Clayton
···
On Thu, May 5, 2011 at 12:59 PM, Nick Amland wrote:
Hey CC Users,
I just wanted to share this Interaction Log that I've been doing over the
last month or so. An idea from Jon, the point of this log is to document
user interaction while using the new CCHQ so the devs can understand how
users currently *use *and how they would like to *use *the new HQ. From
this, devs can figure out how HQ can best serve the needs of users.
So, I quickly logged some interactions with HQ, and now I'm sharing with
you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you've had, etc.
Thanks!
Nick
Nick P. Amland
CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.comnamland08@gmail.com
Chiming in here because I think this is really interesting. You've echoed a
few things I definitely thought about in Dodoma.
A few questions, for whomever can/wants to answer:
"Form Completion Report": I've never seen what this looks like. Does it
actually log the time the form is closed and saved, rather than when it is
submitted? I know that some of the CHVs store up their forms and wait til
they know they have good GPRS to send.
If it is---this could be useful for flagging for data quality. I wonder
if there could be a way to flag or trigger an alert for submitted forms that
have a completion time outside of when we expect CHVs to be making visits?
As for a 'by the hour' report----I feel like this is less useful than a
side-by-side completion versus submission stats report. I know that each CHV
has her own modus operandi for whether she submits right away, or saves and
submits all the forms later. If we could look and see ("Oh, okay, she
collected data throughout the week and then submitted all at once") if this
were the case, or if it truly is an anomaly, that would be so helpful.
The fact that for one CHV, most of the 25 submitted forms were visits to
clients who were not at home---this is interesting, and you're right,
something to watch. But difficult to definitively call a problem---not as if
we can make them prove that a client wasn't actually at home...
In any case, a useful log. Thanks for the thoughts!
Cheers,
Sarah
···
On Thu, May 5, 2011 at 1:39 PM, Clayton Sims wrote:
Nick,
This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I've had a chance to read it more thoroughly.
I just wanted to share this Interaction Log that I've been doing over the
last month or so. An idea from Jon, the point of this log is to document
user interaction while using the new CCHQ so the devs can understand how
users currently *use *and how they would like to *use *the new HQ. From
this, devs can figure out how HQ can best serve the needs of users.
So, I quickly logged some interactions with HQ, and now I'm sharing with
you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you've had, etc.
Thanks!
Nick
Nick P. Amland
CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.comnamland08@gmail.com
Thank you for sharing this out, actually it is useful to know such
information.
Gayo
···
From: commcare-users@googlegroups.com
[mailto:commcare-users@googlegroups.com] On Behalf Of Nick Amland
Sent: Thursday, May 05, 2011 7:59 PM
To: commcare-users
Subject: CommCareHQ Interaction Log
Hey CC Users,
I just wanted to share this Interaction Log that I've been doing over the
last month or so. An idea from Jon, the point of this log is to document
user interaction while using the new CCHQ so the devs can understand how
users currently use and how they would like to use the new HQ. From this,
devs can figure out how HQ can best serve the needs of users.
So, I quickly logged some interactions with HQ, and now I'm sharing with you
guys. Anyone have thoughts/agree/disagree on some of the things I mention,
on other interactions/experiences you've had, etc.
does cchq have some report that shows 'bubbles' for each hour of the day to
show relative levels of commcare activity?
for forms filled-out during non-standard times, is it possible they're
practicing?
···
On Fri, May 6, 2011 at 12:18 AM, Sarah Searle wrote:
Hi Nick,
Chiming in here because I think this is really interesting. You've echoed a
few things I definitely thought about in Dodoma.
A few questions, for whomever can/wants to answer:
"Form Completion Report": I've never seen what this looks like. Does it
actually log the time the form is closed and saved, rather than when it is
submitted? I know that some of the CHVs store up their forms and wait til
they know they have good GPRS to send.
If it is---this could be useful for flagging for data quality. I wonder
if there could be a way to flag or trigger an alert for submitted forms that
have a completion time outside of when we expect CHVs to be making visits?
As for a 'by the hour' report----I feel like this is less useful than a
side-by-side completion versus submission stats report. I know that each CHV
has her own modus operandi for whether she submits right away, or saves and
submits all the forms later. If we could look and see ("Oh, okay, she
collected data throughout the week and then submitted all at once") if this
were the case, or if it truly is an anomaly, that would be so helpful.
The fact that for one CHV, most of the 25 submitted forms were visits to
clients who were not at home---this is interesting, and you're right,
something to watch. But difficult to definitively call a problem---not as if
we can make them prove that a client wasn't actually at home...
In any case, a useful log. Thanks for the thoughts!
Cheers,
Sarah
On Thu, May 5, 2011 at 1:39 PM, Clayton Sims csims@dimagi.com wrote:
Nick,
This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I've had a chance to read it more thoroughly.
I just wanted to share this Interaction Log that I've been doing over the
last month or so. An idea from Jon, the point of this log is to document
user interaction while using the new CCHQ so the devs can understand how
users currently *use *and how they would like to *use *the new HQ. From
this, devs can figure out how HQ can best serve the needs of users.
So, I quickly logged some interactions with HQ, and now I'm sharing with
you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you've had, etc.
Thanks!
Nick
Nick P. Amland
CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.comnamland08@gmail.com
Yeah, I've looked at the submit time bubble report a few times. I don't
find it as helpful because those are submit times, not form completion
times. CHVs aren't in the habit of submitting immediately after they
complete a form. Many CHVs send at another time so that time isn't very
valuable.
Having this bubble report reflecting, instead, form completion times would
be a good way to get a general impression and idea of when users are doing
their CC related activities. However, I don't think it really provides any
actionable information because it's at a very high level.
As for potentially being practice forms, in our particular case (dodoma
program), most of our users are pretty experienced with our
forms/process/etc now and aren't practicing any more. So, it's unlikely
though a good thought.
Thanks,
Nick
Nick P. Amland
CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.comnamland08@gmail.com
···
On Fri, May 6, 2011 at 12:52 PM, Drew Roos wrote:
does cchq have some report that shows 'bubbles' for each hour of the day to
show relative levels of commcare activity?
for forms filled-out during non-standard times, is it possible they're
practicing?
Chiming in here because I think this is really interesting. You've echoed
a few things I definitely thought about in Dodoma.
A few questions, for whomever can/wants to answer:
"Form Completion Report": I've never seen what this looks like. Does it
actually log the time the form is closed and saved, rather than when it is
submitted? I know that some of the CHVs store up their forms and wait til
they know they have good GPRS to send.
If it is---this could be useful for flagging for data quality. I wonder
if there could be a way to flag or trigger an alert for submitted forms that
have a completion time outside of when we expect CHVs to be making visits?
As for a 'by the hour' report----I feel like this is less useful than a
side-by-side completion versus submission stats report. I know that each CHV
has her own modus operandi for whether she submits right away, or saves and
submits all the forms later. If we could look and see ("Oh, okay, she
collected data throughout the week and then submitted all at once") if this
were the case, or if it truly is an anomaly, that would be so helpful.
The fact that for one CHV, most of the 25 submitted forms were visits
to clients who were not at home---this is interesting, and you're right,
something to watch. But difficult to definitively call a problem---not as if
we can make them prove that a client wasn't actually at home...
In any case, a useful log. Thanks for the thoughts!
Cheers,
Sarah
On Thu, May 5, 2011 at 1:39 PM, Clayton Sims csims@dimagi.com wrote:
Nick,
This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I've had a chance to read it more thoroughly.
I just wanted to share this Interaction Log that I've been doing over
the last month or so. An idea from Jon, the point of this log is to
document user interaction while using the new CCHQ so the devs can
understand how users currently *use *and how they would like to *use *the
new HQ. From this, devs can figure out how HQ can best serve the needs of
users.
So, I quickly logged some interactions with HQ, and now I'm sharing with
you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you've had, etc.
Thanks!
Nick
Nick P. Amland
CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.comnamland08@gmail.com
ah, yeah. start time would be a more useful metric. but it's complicated by
the fact that the phone's time is often wrong. i think we have the
capability to apply some skew correction now, but it's not foolproof.
session duration (end time - start time) could also be a useful metric.
···
On Fri, May 6, 2011 at 3:37 PM, Nick Amland wrote:
Hey Drew,
Yeah, I've looked at the submit time bubble report a few times. I don't
find it as helpful because those are submit times, not form completion
times. CHVs aren't in the habit of submitting immediately after they
complete a form. Many CHVs send at another time so that time isn't very
valuable.
Having this bubble report reflecting, instead, form completion times would
be a good way to get a general impression and idea of when users are doing
their CC related activities. However, I don't think it really provides any
actionable information because it's at a very high level.
As for potentially being practice forms, in our particular case (dodoma
program), most of our users are pretty experienced with our
forms/process/etc now and aren't practicing any more. So, it's unlikely
though a good thought.
Thanks,
Nick
Nick P. Amland
CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.comnamland08@gmail.com
On Fri, May 6, 2011 at 12:52 PM, Drew Roos droos@dimagi.com wrote:
does cchq have some report that shows 'bubbles' for each hour of the day
to show relative levels of commcare activity?
for forms filled-out during non-standard times, is it possible they're
practicing?
Chiming in here because I think this is really interesting. You've echoed
a few things I definitely thought about in Dodoma.
A few questions, for whomever can/wants to answer:
"Form Completion Report": I've never seen what this looks like. Does
it actually log the time the form is closed and saved, rather than when it
is submitted? I know that some of the CHVs store up their forms and wait til
they know they have good GPRS to send.
If it is---this could be useful for flagging for data quality. I
wonder if there could be a way to flag or trigger an alert for submitted
forms that have a completion time outside of when we expect CHVs to be
making visits?
As for a 'by the hour' report----I feel like this is less useful than
a side-by-side completion versus submission stats report. I know that each
CHV has her own modus operandi for whether she submits right away, or saves
and submits all the forms later. If we could look and see ("Oh, okay, she
collected data throughout the week and then submitted all at once") if this
were the case, or if it truly is an anomaly, that would be so helpful.
The fact that for one CHV, most of the 25 submitted forms were visits
to clients who were not at home---this is interesting, and you're right,
something to watch. But difficult to definitively call a problem---not as if
we can make them prove that a client wasn't actually at home...
In any case, a useful log. Thanks for the thoughts!
Cheers,
Sarah
On Thu, May 5, 2011 at 1:39 PM, Clayton Sims csims@dimagi.com wrote:
Nick,
This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I've had a chance to read it more thoroughly.
I just wanted to share this Interaction Log that I've been doing over
the last month or so. An idea from Jon, the point of this log is to
document user interaction while using the new CCHQ so the devs can
understand how users currently *use *and how they would like to *use *the
new HQ. From this, devs can figure out how HQ can best serve the needs of
users.
So, I quickly logged some interactions with HQ, and now I'm sharing
with you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you've had, etc.
Thanks!
Nick
Nick P. Amland
CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.comnamland08@gmail.com
CC1.1 provides some good skew correction, and having the jar signed also
does. We discussed adding a report that lets you know what people's skew
times look like at a glance which should hopefully be in this month.
And definitely agreed on session duration per chw.
-Clayton
···
On Fri, May 6, 2011 at 8:15 AM, Drew Roos wrote:
ah, yeah. start time would be a more useful metric. but it's complicated by
the fact that the phone's time is often wrong. i think we have the
capability to apply some skew correction now, but it's not foolproof.
session duration (end time - start time) could also be a useful metric.
Yeah, I've looked at the submit time bubble report a few times. I don't
find it as helpful because those are submit times, not form completion
times. CHVs aren't in the habit of submitting immediately after they
complete a form. Many CHVs send at another time so that time isn't very
valuable.
Having this bubble report reflecting, instead, form completion times would
be a good way to get a general impression and idea of when users are doing
their CC related activities. However, I don't think it really provides any
actionable information because it's at a very high level.
As for potentially being practice forms, in our particular case (dodoma
program), most of our users are pretty experienced with our
forms/process/etc now and aren't practicing any more. So, it's unlikely
though a good thought.
Thanks,
Nick
Nick P. Amland
CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.comnamland08@gmail.com
On Fri, May 6, 2011 at 12:52 PM, Drew Roos droos@dimagi.com wrote:
does cchq have some report that shows 'bubbles' for each hour of the day
to show relative levels of commcare activity?
for forms filled-out during non-standard times, is it possible they're
practicing?
Chiming in here because I think this is really interesting. You've
echoed a few things I definitely thought about in Dodoma.
A few questions, for whomever can/wants to answer:
"Form Completion Report": I've never seen what this looks like. Does
it actually log the time the form is closed and saved, rather than when it
is submitted? I know that some of the CHVs store up their forms and wait til
they know they have good GPRS to send.
If it is---this could be useful for flagging for data quality. I
wonder if there could be a way to flag or trigger an alert for submitted
forms that have a completion time outside of when we expect CHVs to be
making visits?
As for a 'by the hour' report----I feel like this is less useful than
a side-by-side completion versus submission stats report. I know that each
CHV has her own modus operandi for whether she submits right away, or saves
and submits all the forms later. If we could look and see ("Oh, okay, she
collected data throughout the week and then submitted all at once") if this
were the case, or if it truly is an anomaly, that would be so helpful.
The fact that for one CHV, most of the 25 submitted forms were visits
to clients who were not at home---this is interesting, and you're right,
something to watch. But difficult to definitively call a problem---not as if
we can make them prove that a client wasn't actually at home...
In any case, a useful log. Thanks for the thoughts!
Cheers,
Sarah
On Thu, May 5, 2011 at 1:39 PM, Clayton Sims csims@dimagi.com wrote:
Nick,
This is tremendously useful, thanks for sharing it! No thoughts yet,
possibly after I've had a chance to read it more thoroughly.
I just wanted to share this Interaction Log that I've been doing over
the last month or so. An idea from Jon, the point of this log is to
document user interaction while using the new CCHQ so the devs can
understand how users currently *use *and how they would like to *use
*the new HQ. From this, devs can figure out how HQ can best serve
the needs of users.
So, I quickly logged some interactions with HQ, and now I'm sharing
with you guys. Anyone have thoughts/agree/disagree on some of the things I
mention, on other interactions/experiences you've had, etc.
Thanks!
Nick
Nick P. Amland
CommCare Field Fellow
Dimagi, Inc.
Dodoma, Tanzania
Google Voice: 253.642.7790
TZ Mobile: +255 762 740 996
Email: namland@dimagi.comnamland08@gmail.com