Program Evaluation
Hi all,
The Bike Depot is trying to come up with an evaluation tool for our Earn A Bike (and eventually Fix Your Bike, classes, and volunteers) program and I was just wondering if anyone else out there has a format and system that works. I looked around on the Wiki but couldn't find much. We are working on a simple pre and post program survey to start with, but with our EAB population are wondering how best to reach them after they have left our program and their probability of them actually following up with us.
Also, for any group that is successfully using surveys, what questions are you using? We are looking mostly at health impact and quality of life improvement (able to get a job because of bike, etc.). Are there other evaluation systems you are using that work well? What do you then do with that information? Has it spurred you to change aspects of your program to have a greater effect?
As we develop our evaluation system I will be sure to share and post what we have created on the wiki site.
Here's a questionaire i came up with to be handed out and completed during the last class of a session. it was more focused on a specific Mechanics class we offered.
http://docs.google.com/View?id=dg3nckmj_176gt8tqtdh
Mechanics 101 Class Evaluation Thanks so much for joining us for this class. As you can probably tell, we love bicycles. We want to share that love with as many people as possible. This class is but one way for us to make folks know how easy bike maintenance is once you understand it. In an effort to continually improve and evolve the class, please take a minute or two to give us some feedback on your experience in the class. Thanks again for your time, and allowing us to share what we know.
- What was your most rewarding experience in the class?
- Which areas of bike mechanics/discussion would you have liked to see *
more* of in class? 3. Which areas of bike mechanics/discussion would you have liked to see * less* of in class? 4. Were the topics covered in a way that was meaningful, and easy to understand? If not, which topics, and what could we do to make them better? 5. What was your impression of the handouts given out in class? 6. What was your impression of the instructors? How well did they know their materials? 7. Do you feel the instructors created an environment which encouraged questions, exploration of ideas, and thoughtfulness? If not, what could we do different to make this so? 8. Now that you've taken this class, would you take another (presumably more advanced class) through Community Cycles? If not, please elaborate. 9. Would you recommend this class to a friend? If so, please do! If not, please let us know what we could do to encourage this. 10. Which of the following was most beneficial to you in learning bicycle mechanics in this class: A>Instructor lecturing about a system or part, B>handouts showing exploded drawings of a system or part, C> the system or part passed around for you to hold and examine not installed on a bicycle, D>the system or part installed on a bicycle, for you to examine/touch?
After using that evaluation form for a few sessions, we figured out that we needed a more general survey that we could use for any event, and not have to keep track of 14 different surveys for 14 different programs, specific workshops, etc.
http://docs.google.com/View?id=dg3nckmj_166dgrwvzgb
*Class ___________________ Instructor ________________________ Date
______________________*
Please give us your opinion of today's session. Your comments will help us improve future sessions. Please *circle* the number that corresponds with your level of agreement with each statement, with 1=strongly agree, 2=agree, 3=disagree, and 4=strongly disagree.
Strongly Strongly*
Agree Agree DisagreeDisagree*
- The class session was well organized
............................1......................2......................3......................4 2 The class session was just the right length.......................1......................2......................3......................4 3. The class content was too elementary ............................1......................2......................3......................4 4. The presentation was clear and understandable ...............1......................2......................3......................4 5. The instructor was well prepared .....................................1......................2......................3......................4 6. The instructor encouraged questions ...............................1......................2......................3......................4 7. The handouts were useful ...............................................1......................2......................3......................4 8. The class examples helped clarify the instruction .............1......................2......................3......................4 9. I feel this class was well worth my time ..........................1......................2......................3......................4
*Please comment* Was there any aspect you were interested in, that was not covered in today's class? How could the class have been better or more helpful? Any other comments? Community Cycles relies a lot on word-of-mouth advertising. Please help us get the word out about our work by telling your friends about what we have coming up. If there's any reason you would not recommend this class to a friend, what's that reason? Do we have your permission to use your comments in future promotional materials, online, etc, using only your first name? YES NO
Both of these questionnaires are loosely based on generic templates I found online plus what I thought might be helpful to learn from students about how a class went.
The first time I tried using the first questionnaire after a class, I told the students they could drop them back off later, filled out, or drop them in the mail. I'll let you guess how many I got back.
On Fri, Dec 10, 2010 at 12:24 PM, Laurie Hanselmann <laurie@thebikedepot.org
wrote:
Hi all,
The Bike Depot is trying to come up with an evaluation tool for our Earn A Bike (and eventually Fix Your Bike, classes, and volunteers) program and I was just wondering if anyone else out there has a format and system that works. I looked around on the Wiki but couldn't find much. We are working on a simple pre and post program survey to start with, but with our EAB population are wondering how best to reach them after they have left our program and their probability of them actually following up with us.
Also, for any group that is successfully using surveys, what questions are you using? We are looking mostly at health impact and quality of life improvement (able to get a job because of bike, etc.). Are there other evaluation systems you are using that work well? What do you then do with that information? Has it spurred you to change aspects of your program to have a greater effect?
As we develop our evaluation system I will be sure to share and post what we have created on the wiki site.
-- Laurie Hanselmann Managing Director The Bike Depot 2825 Fairfax St. Denver, CO 80207 Office: 303-393-1963 Fax: 303-393-2607 Laurie@thebikedepot.org
Find us on Facebook at http://www.facebook.com/TheBikeDepot
*The Bike Depot is a nonprofit community bike shop that offers a wide range of bicycling programs, services and products. Visit us online at www.thebikedepot.org or come by the shop at 2825 Fairfax St. in Denver, CO 80207.*
Thethinktank mailing list Thethinktank@lists.bikecollectives.org To unsubscribe, send a blank email to TheThinkTank-leave@bikecollectives.org To manage your subscription, plase visit:
http://lists.bikecollectives.org/listinfo.cgi/thethinktank-bikecollectives.o...
Hello, we have a short questionnaire thats a half sheet of paper.
Here's the electronic version: https://spreadsheets.google.com/viewform?hl=en&formkey=dEp5OGNiaTFCQ1VaM...
Best, -Dave
On Fri, Dec 10, 2010 at 2:44 PM, veganboyjosh@gmail.com wrote:
Here's a questionaire i came up with to be handed out and completed during the last class of a session. it was more focused on a specific Mechanics class we offered.
http://docs.google.com/View?id=dg3nckmj_176gt8tqtdh
Mechanics 101 Class Evaluation Thanks so much for joining us for this class. As you can probably tell, we love bicycles. We want to share that love with as many people as possible. This class is but one way for us to make folks know how easy bike maintenance is once you understand it. In an effort to continually improve and evolve the class, please take a minute or two to give us some feedback on your experience in the class. Thanks again for your time, and allowing us to share what we know.
- What was your most rewarding experience in the class?
- Which areas of bike mechanics/discussion would you have liked to see more
of in class? 3. Which areas of bike mechanics/discussion would you have liked to see less of in class? 4. Were the topics covered in a way that was meaningful, and easy to understand? If not, which topics, and what could we do to make them better? 5. What was your impression of the handouts given out in class? 6. What was your impression of the instructors? How well did they know their materials? 7. Do you feel the instructors created an environment which encouraged questions, exploration of ideas, and thoughtfulness? If not, what could we do different to make this so? 8. Now that you've taken this class, would you take another (presumably more advanced class) through Community Cycles? If not, please elaborate. 9. Would you recommend this class to a friend? If so, please do! If not, please let us know what we could do to encourage this. 10. Which of the following was most beneficial to you in learning bicycle mechanics in this class: A>Instructor lecturing about a system or part, B>handouts showing exploded drawings of a system or part, C> the system or part passed around for you to hold and examine not installed on a bicycle, D>the system or part installed on a bicycle, for you to examine/touch?
After using that evaluation form for a few sessions, we figured out that we needed a more general survey that we could use for any event, and not have to keep track of 14 different surveys for 14 different programs, specific workshops, etc.
http://docs.google.com/View?id=dg3nckmj_166dgrwvzgb
Class ___________________ Instructor ________________________ Date ______________________
Please give us your opinion of today's session. Your comments will help us improve future sessions. Please circle the number that corresponds with your level of agreement with each statement, with 1=strongly agree, 2=agree, 3=disagree, and 4=strongly disagree.
Strongly Strongly
Agree Agree Disagree Disagree
- The class session was well organized
............................1......................2......................3......................4 2 The class session was just the right length.......................1......................2......................3......................4 3. The class content was too elementary ............................1......................2......................3......................4 4. The presentation was clear and understandable ...............1......................2......................3......................4 5. The instructor was well prepared .....................................1......................2......................3......................4 6. The instructor encouraged questions ...............................1......................2......................3......................4 7. The handouts were useful ...............................................1......................2......................3......................4 8. The class examples helped clarify the instruction .............1......................2......................3......................4 9. I feel this class was well worth my time ..........................1......................2......................3......................4
Please comment Was there any aspect you were interested in, that was not covered in today's class? How could the class have been better or more helpful? Any other comments? Community Cycles relies a lot on word-of-mouth advertising. Please help us get the word out about our work by telling your friends about what we have coming up. If there's any reason you would not recommend this class to a friend, what's that reason? Do we have your permission to use your comments in future promotional materials, online, etc, using only your first name? YES NO
Both of these questionnaires are loosely based on generic templates I found online plus what I thought might be helpful to learn from students about how a class went.
The first time I tried using the first questionnaire after a class, I told the students they could drop them back off later, filled out, or drop them in the mail. I'll let you guess how many I got back.
On Fri, Dec 10, 2010 at 12:24 PM, Laurie Hanselmann laurie@thebikedepot.org wrote:
Hi all, The Bike Depot is trying to come up with an evaluation tool for our Earn A Bike (and eventually Fix Your Bike, classes, and volunteers) program and I was just wondering if anyone else out there has a format and system that works. I looked around on the Wiki but couldn't find much. We are working on a simple pre and post program survey to start with, but with our EAB population are wondering how best to reach them after they have left our program and their probability of them actually following up with us. Also, for any group that is successfully using surveys, what questions are you using? We are looking mostly at health impact and quality of life improvement (able to get a job because of bike, etc.). Are there other evaluation systems you are using that work well? What do you then do with that information? Has it spurred you to change aspects of your program to have a greater effect? As we develop our evaluation system I will be sure to share and post what we have created on the wiki site.
-- Laurie Hanselmann Managing Director The Bike Depot 2825 Fairfax St. Denver, CO 80207 Office: 303-393-1963 Fax: 303-393-2607 Laurie@thebikedepot.org
Find us on Facebook at http://www.facebook.com/TheBikeDepot
The Bike Depot is a nonprofit community bike shop that offers a wide range of bicycling programs, services and products. Visit us online at www.thebikedepot.org or come by the shop at 2825 Fairfax St. in Denver, CO 80207.
Thethinktank mailing list Thethinktank@lists.bikecollectives.org To unsubscribe, send a blank email to TheThinkTank-leave@bikecollectives.org To manage your subscription, plase visit:
http://lists.bikecollectives.org/listinfo.cgi/thethinktank-bikecollectives.o...
Thethinktank mailing list Thethinktank@lists.bikecollectives.org To unsubscribe, send a blank email to TheThinkTank-leave@bikecollectives.org To manage your subscription, plase visit: http://lists.bikecollectives.org/listinfo.cgi/thethinktank-bikecollectives.o...
Hi
In another life, I worked a lot with these folks: http://www.worldbridgeevaluation.com/
They make social change evaluation their top priority and have a lot of good advice about non-hierarchical consensus based work.
~c
www.troybikerescue.org
"When shall we live if not now?" - M.F.K. Fisher
From: Laurie Hanselmann laurie@thebikedepot.org To: The Think Tank thethinktank@lists.bikecollectives.org Sent: Fri, December 10, 2010 2:24:07 PM Subject: [TheThinkTank] Program Evaluation
Hi all,
The Bike Depot is trying to come up with an evaluation tool for our Earn A Bike (and eventually Fix Your Bike, classes, and volunteers) program and I was just wondering if anyone else out there has a format and system that works. I looked around on the Wiki but couldn't find much. We are working on a simple pre and post program survey to start with, but with our EAB population are wondering how best to reach them after they have left our program and their probability of them actually following up with us.
Also, for any group that is successfully using surveys, what questions are you using? We are looking mostly at health impact and quality of life improvement (able to get a job because of bike, etc.). Are there other evaluation systems you are using that work well? What do you then do with that information? Has it spurred you to change aspects of your program to have a greater effect?
As we develop our evaluation system I will be sure to share and post what we have created on the wiki site.
We do a simple survey 30-60 days after participation in our class (we connect the bike with education)
- do you still use your bike?
-if yes, what do you use it for?
-if no, why not?
- do you wear a helmet?
That is enough info to get a rough estimate of continued behavior. We use personal interviews and stories from those who come to our shop for more detailed descriptions of the impact of our program. We also struggle with finding the people who did the class 30 days later. We will probably add a question about using our open shop repair opportunities.
Scott TenBrink
Executive Director
Fitness Council of Jackson
225 North Jackson St.
Jackson, MI 49201
(517) 990-9798
scott@fitnesscouncil.org
www.fitnesscouncil.org
From: thethinktank-bounces@lists.bikecollectives.org [mailto:thethinktank-bounces@lists.bikecollectives.org] On Behalf Of Carolyn Braunius Sent: Friday, December 10, 2010 4:42 PM To: The Think Tank Subject: Re: [TheThinkTank] Program Evaluation
Hi
In another life, I worked a lot with these folks: http://www.worldbridgeevaluation.com/
They make social change evaluation their top priority and have a lot of good advice about non-hierarchical consensus based work.
~c
http://www.troybikerescue.org www.troybikerescue.org
"When shall we live if not now?" - M.F.K. Fisher
From: Laurie Hanselmann laurie@thebikedepot.org To: The Think Tank thethinktank@lists.bikecollectives.org Sent: Fri, December 10, 2010 2:24:07 PM Subject: [TheThinkTank] Program Evaluation
Hi all,
The Bike Depot is trying to come up with an evaluation tool for our Earn A Bike (and eventually Fix Your Bike, classes, and volunteers) program and I was just wondering if anyone else out there has a format and system that works. I looked around on the Wiki but couldn't find much. We are working on a simple pre and post program survey to start with, but with our EAB population are wondering how best to reach them after they have left our program and their probability of them actually following up with us.
Also, for any group that is successfully using surveys, what questions are you using? We are looking mostly at health impact and quality of life improvement (able to get a job because of bike, etc.). Are there other evaluation systems you are using that work well? What do you then do with that information? Has it spurred you to change aspects of your program to have a greater effect?
As we develop our evaluation system I will be sure to share and post what we have created on the wiki site.
participants (5)
-
Carolyn Braunius -
David J. Zielinski -
Laurie Hanselmann -
Scott TenBrink -
veganboyjosh＠gmail.com