Annoto: Video Interaction Grade Passback to Canvas

Environment

Annoto
MiVideo
Canvas

Annoto is now available in all Canvas courses!
Quickly turn passive course videos into engaging and interactive experiences for students using Annoto! Annoto is an add-on to MiVideo in Canvas that allows students to collaborate within the video or audio player. 

Issue

How an instructor can use Annoto's Assessment Criteria to send a grade to Canvas Gradebook based on a student's interaction with the video.

  • The grade passed to Canvas can be based on:
    • In-video quiz score (Assignments)
    • % watched (Activity Completion)
    • Combination of in-video quiz score and % watched

Tip: because Annoto is interactive and collects user behavior, it is not recommended to use Annoto in public courses since public courses do not require authentication to access. 

Resolution

Videos must be added to the MiVideo service to use Annoto.

What Is Assessment Criteria?

Instructors can create different criteria to evaluate and grade student performance on various video assignments and activities. There are currently two types of assessment criteria; Assignments and Activity Completion.

Assignments

  • Create in-video quiz questions to test student knowledge of material covered in the video. 
  • How is the grade calculated: the quiz score is sent to Gradebook as soon as the quiz is complete. The score is calculated as the total points correct divided by the total points possible multiplied by the assignment points.
  • If you’ll only be using quizzing in your course do not enable Assessment Criteria. Follow the steps in the Quiz Students On Video Material In Canvas article instead.​​​

Activity Completion

  • Specify how much of the video must be watched (consumed) in order for a student to receive points.
  • Specify the number of points the activity is worth. 
  • How is the grade calculated: the score is sent to Gradebook as soon as the student watches the video to the pass level. The score is the full assignment points possible. There is no partial credit.

Percentage Points (pp)

  • Percentage Points (pp) is the ratio of each criteria to the overall assignment grade send to Gradebook. For example, you can create a criteria where the overall grade depends on both the student watching the video and their quiz score by creating a criteria with Activity Completion (% watched) = 25 pp and Assignments (quiz grade) = 75 pp. 

Assignments and Activity Completion

  • You can create criteria that includes both Activity Completion (% watched) and Assignments (quiz grade).
  • How is the grade calculated:
    • The quiz score is sent to Gradebook as soon as the quiz is complete. The score is calculated as the total points correct divided by the total points possible multiplied by the pp assigned to Assignments in the criteria multiplied by the assignment points.
    • The % watched score is sent to Gradebook once the student watches the video to the pass level. The score is calculated as the pp assigned to Activity Completion in the criteria multiplied by the assignment points.
  • Example assignment worth 10 points containing a quiz with 3 questions each worth one point.
    • Criteria rule: Activity Completion = 25% must watch 95% and Assignments = 75%.
    • If a student gets 2 out of 3 questions correct and has not finished watching the video their Gradebook grade is 5/10. Calculated as 2 divided by 3 multiplied by 0.75 multiplied by 10.
    • Once the student watches at least 95% of the video they will receive a final grade of 7.5/10. Calculated as 10 multiplied by 0.25 plus 5.

1. Create Custom Criteria

The default site criteria is an Assignment worth 100 percentage points (pp). This default criteria sends quiz scores to Gradebook. If you’ll only be using quizzing in your course do not enable Assessment Criteria. Follow the steps in the Quiz Students On Video Material In Canvas article instead.​​​

However, you can also create your own custom criteria. A criteria can be used on one or more videos.

Create Criteria

  1. Create custom criteria in the Assessment Criteria Library. Navigate to Annoto Dashboard >  Preferences > Assessment Criteria Library.
  2. The default site criteria (under the Site tab) send quiz scores to Gradebook. If you want to use Activity Completion in your course you'll need to create a new criteria.
  3. Click the + Create for course button.
  4. Enter a title and description (optional).
  5. Save Changes.
  6. Click Select a Criteria to Add button.
  7. Choose whether you want the criteria to include Activity Completion (% watched) or Assignments (quiz grade).
    • Activity Completion
      • Specify the minimum % of the video the student must watch to earn a grade. 
      • It is recommended to either enable Limit fast forwarding (in Preferences) especially if using a 100 completion rate, or use a lower completion rate (around 95) to allow for small rounding inaccuracies that occur when the video is paused and resumed.
      • Select what percentage (pp) the criteria is worth to the overall grade. If this is the only/first criteria you must set pp = 100.
    • Assignments
      • Select what percentage (pp) the criteria is worth to the overall grade. If this is the only/first criteria you must set pp = 100.
  8. Repeat step 7 for each criteria and set the pp as appropriate. 
  9. Click Done to save your criteria.
  10. Once your criteria is created you'll see it on the Course tab in the library and can apply it to videos. 

2. Create Canvas Assignment

Assignments only

The default site criteria is an Assignment worth 100 percentage points (pp). This default criteria sends quiz scores to Gradebook. If you’ll only be using quizzing in your course do not enable Assessment Criteria. Follow the steps in the Quiz Students On Video Material In Canvas article instead.​​​

Assignments and Activity

  1. Follow the steps in the Quiz Students On Video Material In Canvas article.
  2. Then return to this article and continue with step 3 below to enable Assessment Criteria.

Activity only

Note: you'll need to be the owner or co-publisher of the video to add the video to the assignment.

  1. Assignments > + Assignment.
  2. Enter the assignment instructions.
  3. Enter the Points for the assignment.
  4. Select how to display the grade (for example points or complete/incomplete checkmarks).
  5. Scroll down to the Submission Type drop-down list and select External Tool.
  6. Click the Find button.
  7. Select MiVideo In-Video Quizzing.
  8. By default only MiVideo IVQ Quizzes are shown, to see all your videos click "Quiz x" to remove the filter.

screenshot indicating how to remove the quiz filter

  1. Search for the video.
  2. Select the setting (gear) icon next to the video to embed.
  3. Select a Max Embed Size of 960 x 540 or larger.
  4. Click Embed.
  5. Click Select.
  6. Uncheck Load This Tool In A New Tab (if checked).
  7. Note: the assignment name will become the same name as the video. This can be changed.
  8. Complete all other assignment details.
  9. Click Save. Don't publish yet.

3. Enable Assessment Criteria

Enable assessment criteria for an individual video

  1. In the assignment, click the play button in the player to load the controls.
  2. Click the speech bubble or settings icon to open the Annoto widget.
  3. If the Dashboard does not load, click the Annoto menu (triple lines) in the upper left of the widget and select Dashboard.
  4. In the Features tab enable Assessment Criteria.
  5. ​​​​Tip: to prevent students from fast forwarding through the video, enable the Limit Fast Forwarding feature. Click the Options button to limit fast forwarding for mandatory quizzes, optional quizzes, and activity.
  6. Select the Assessment Setup tab.
  7. The default site criteria is automatically selected for the video.
  8. Click the Select custom assessment criteria for this activity to choose a different criteria.
  9. Click Apply.

Enable assessment criteria for all videos at the course level

  1. Annoto Dashboard >  Preferences > Features tab > enable Assessment Criteria.
  2. Select the Assessment Setup tab.
  3. The default site criteria is automatically selected for all videos.
  4. Click the Select custom assessment criteria for this activity to choose a different criteria.
  5. Click Apply.
  6. After applying a criteria to all videos, you can change the criteria for an individual video by following the steps in the section above. For example, if you set an Activity only criteria at the course level, you'll want to set a criteria that contains Assignment for an individual quiz.

4. Publish the Assignment

Once Annoto is configured publish the assignment so students can access it.

Annoto Guides

Additional Information

For additional questions, please contact the ITS Service Center

Print Article