Logo

PIE Virtual Workshop: Online Assessment: Exploring the Intricacies of Proctored Testing and Alternatives - Shared screen with speaker view
Fang Liang
32:00
Welcome to PIE Virtual Workshop.PIE Tip: Please use your First and Last Name as your username for this session so that we can properly address you.
Fang Liang
32:48
PIE Tip: To change your username, you can use your cursor to hover over your name. Click on ‘More’ to get the option of “rename” yourself.
Erika Fundelius
32:48
Erika Fundelius
Shana Carrington
32:55
Shana Carrington
Yu Lu
32:56
Yu Lu
SaulMV
32:56
Saul Moreno
Jorge Hernandez
33:04
Jorge Hernandez
Chelsea Casabona
33:17
Chelsea Casabona
Uju Aliche
33:22
Uju Aliche
jhsho
33:26
Justin Shows
AD Weber
33:27
Dana Weber
Uju Aliche
33:32
Obianuju Aliche
Danielle Krusemark
33:33
Danielle Krusemark
Junko Brudenell
33:36
Junko Brudenell
Nissi Supriya Konda
33:42
Nissi Supriya Konda
Daniel Sheikh
33:43
Daniel Sheikh
Wenshan Han
33:47
Wenshan Han
soniakiran
33:48
Sonia Kiran
Paul Trombley
34:00
Paul Trombley
Elaine Smith
34:14
Elaine Smith
Caity Kelly
34:27
Caitlin Kelly
Ann Clutter
34:44
Ann Clutter
Ana Sanchez
35:15
Ana Sánchez
Dongqi Li
36:41
Dongqi Li
Madhurima Bhattacharya
37:21
Madhurima Bhattacharya
loveYumji Kim
39:37
Claudia Kim
Lauren Willson
47:09
If you are allowing multiple attempts on a low stakes quiz, how does the time limit work? Is that a time limit per attempt, or must they complete all attempts within that limit?
Amanda Whitaker
47:45
That is a time limit per attempt.
Lauren Willson
47:54
Thank you!
Erika Fundelius (she/her)
48:43
Cool quiz idea!
Amanda Whitaker
51:23
15-30 minute window in addition to whatever time frame you had intended to accommodate for technical difficulties.
Debra Ann Fadool
51:32
what happens if only one student needs more time due to technical challenges
Junko Brudenell
52:22
So, possible answers are wrong answers, correct?
Amanda Whitaker
53:19
The "Until" time will always be a hard limit. If one, or a small number of students need accommodations, then you can add a second "assign" block. Then there would be one assign block for Amanda Whitaker, and then the "Everyone" assign block would automatically change into "Everyone Else"
Amanda Whitaker
53:37
Yes, possible answers are wrong answers or distractors.
Jorge Hernandez
55:37
fantastic walkthrough the exam creation process
Jorge Hernandez
55:42
:)
Lisa Liseno
56:01
We are recording this session. We'll send you all the link to the location on our PIE website where we'll have posted the recording , and also an invitation to this development Canvas site later today or tomorrow.
Jorge Hernandez
56:23
Sweet!
Amanda Whitaker
56:29
Thank you. If anyone misses any information, you can review the recording or contact us at testing@fsu.edu
Dan Scott
57:57
Does Canvas allow wildcard indicators for answers, e.g. cow* with the * being "any character(s) after this.
Dan Scott
58:03
?
Caity Kelly
58:04
Will Canvas mark the answer wrong if students write the correct word but they do not capitalize it as it is capitalized in the answer key?
Amanda Whitaker
58:29
Capitalization is not considered for fill-in-the-blank.
Caity Kelly
58:41
Thank you :)
Amanda Whitaker
58:47
I do not believe that wildcards are supported.
Dan Scott
58:57
OK, thanks.
Amanda Whitaker
59:04
I will ask Kip when he gets to an opportune place.
Dan Scott
01:04:01
OK thanks.
Madhurima Bhattacharya
01:09:44
analyzing and evaluating
AD Weber
01:10:02
Language course: low to middle order; Graduate course: HOTS
Caity Kelly
01:10:21
I don't have any objectives this semester but I have observed in previous courses I've taken that many of my instructors liked to start with LOTS and build up to HOTS as the semester went on
Amanda Whitaker
01:12:50
It sounds like there's been a nice mix of orders for you.
Irvin Butts (kip)
01:23:09
https://support.canvas.fsu.edu/kb/article/882-can-i-use-rubrics-in-canvas/
Tamara Fitzpatrick
01:39:53
How often do you review footage? How do you know when you need to review footage?
Mary Eichin
01:40:18
Honorlock will flag suspicious behavior.
Irvin Butts (kip)
01:40:23
The footage will display flags for review. It should be able to be reviewed shortly after the student(s) have finished their exam.
Mary Eichin
01:40:40
They use AI, though, so, as Amanda said, it isn't perfect.
Irvin Butts (kip)
01:40:55
Amanda will be going over reviewing footage shortly.
Tamara Fitzpatrick
01:41:03
Thank you
Mary Eichin
01:41:05
We suggest reviewing all of red flags, but spot checking yellow and green is also suggested.
Terri Bunch
01:43:18
my screen is not updating.
Irvin Butts (kip)
01:44:08
She is currently reading out Proctor Guidelines, I will ask her to refresh the screen-share.
Caity Kelly
01:45:32
I've taken at least one course in which the instructor was required by their department to use a few Pearson quizzes so I'd imagine Honorlock is helpful for that
Terri Bunch
01:45:41
no...
Terri Bunch
01:45:58
nothing!
Fang Liang
01:47:49
We are recording this session. We'll send you all the link to the location on our PIE website where we'll have posted the recording , and also an invitation to this development Canvas site later today or tomorrow.
Jorge Hernandez
01:49:10
wait, they show their face and their ID on the computer camera right?
Irvin Butts (kip)
01:49:29
Yes, they show their Face, then show their ID, both to the webcam.
Jorge Hernandez
01:49:40
coolio thanks!
Irvin Butts (kip)
01:49:46
Those are default options enabled within Honorlock.
Jorge Hernandez
01:51:13
and they would rotate their laptop (or desktop?) to survey the room?
Ann Clutter
01:51:38
What event is triggering the highest number of flags?
Mary Eichin
01:52:05
Great question.
Irvin Butts (kip)
01:52:13
If the webcam is part of a laptop, they would have to lift up the device to move it around.If it is a built-in camera, such as on All-in-One devices, the students would need to communicate with the instructor about not being able to physical move their computer.
Marissa Schrenk
01:52:19
The highest red flags are likely from students talking out loud
Marissa Schrenk
01:52:35
and "multiple people"
Ann Clutter
01:53:13
thank you
Jorge Hernandez
01:53:24
got it thanks!
Marissa Schrenk
01:53:49
"test window lost focus" and "face not clearly visible" would be the most common yellows
Irvin Butts (kip)
01:54:10
@Jorge, If there are exceptions that need to be made for students, the Proctor Guide and Information you set can also include a list of students with special needs or exceptions.
Paul Trombley
01:54:23
How many incidences of verified cheating have been detected?
Jorge Hernandez
01:55:02
great point, kip
Mary Eichin
01:55:03
I don't have that figure, but it is a low percentage.
Jessica Simon
01:55:18
What would you do if a student has an All-in-One device and could not do a room scan?
Jorge Hernandez
01:55:42
i figure that just the idea of being watched deters cheating
Dan Scott
01:55:47
Do students get any info that their honorlock vids have been flagged?
Mary Eichin
01:55:53
Yes - it does
Mary Eichin
01:55:59
No
Irvin Butts (kip)
01:56:07
@Jessica, You can add an exception in the Proctor Guide Instructions when setting up Honorlock. It is possible to list students who have special needs of exceptions.
Terri Bunch
01:56:19
can the settings be personalized for individual students?
Mary Eichin
01:56:28
Students can chat with Honorlock to indicate that they can't take a room scan.
Irvin Butts (kip)
01:56:56
@Terri, The settings are global. You can declare individual exceptions in the Proctor Guidelines for those who would review to see the notes.
Junko Brudenell
01:57:07
Do instructors use Honorlock along with proctoring on Zoom?
Jorge Hernandez
01:57:15
I wonder if this may somehow work for students who use their ten inch smartphones or an iPad Pro these days
Marissa Schrenk
01:57:26
If a student's face goes out of frame, Honorlock will pause their exam and tell them to come back in frame. If they try to copy/paste and that setting is enabled, they will get a message saying copy/paste is not allowed. They do not see the actual incident flags
Mary Eichin
01:57:27
You have to use a computer
Mary Eichin
01:57:40
With honorlock
Dan Scott
01:57:56
Given the socioeconomic disparities in/around Tally, does FSU have any data on what % of its students have home access to a full computer with webcam and required tech for this (and i.e. how many wouldn't, and therefore be unable to use Honorlock through no fault of their own)?
Jorge Hernandez
01:58:14
great point
Jorge Hernandez
01:58:24
Dan
Mary Eichin
01:59:02
Our research on Canvas usage indicates that most use a computer to access Canvas. We don't know for sure who don't, but there is a low usage of phones while working in Canvas at FSU.
Dan Scott
01:59:35
Is that data from a term during quarantine when students aren't in their usual student digs?
Debra Ann Fadool
01:59:36
My husband teaching last term said that 10% of his students had no technology access at home
Irvin Butts (kip)
01:59:43
@Junko, I have not experienced instances where instructors would use both Honorlock as well as Zoom. Some of the settings in HL would block Zoom features.
Lauren Willson
01:59:50
I have a question if we have time for a Q&A
Junko Brudenell
02:00:14
Thanks, Kip!
Ann Clutter
02:00:16
https://dsst.fsu.edu/ can help with laptops if needed.
Lisa Liseno
02:00:29
Please fill out this short follow-up workshop evaluation: https://bit.ly/Eval-PIE-Workshop-7-22-20 this link will also be emailed to you. We appreciate your feedback! Include any topics you’d like us to cover in future virtual workshops.
Jorge Hernandez
02:00:30
big number Dr. Fadool :/
Vivianne Asturizaga Hurtado de Mendoza
02:00:41
thanks for all the info!!
Jorge Hernandez
02:01:02
The resting center is definitively closed right?
Jorge Hernandez
02:01:06
testing
Jorge Hernandez
02:01:27
Fantastic workshop!
Irvin Butts (kip)
02:01:37
@Jorge, The Testing Center is currently closed. They have been working with some contracted courses for aiding in HL Proctoring.
Irvin Butts (kip)
02:02:00
@Jorge, There are plans on re-opening, but Mary would have better information on answer that.
Dongqi Li
02:02:10
Is the office hour Every Wednesday 11am-Noon with Fang Liang (Educational Psychology) is continuing next Wednesday?
Jorge Hernandez
02:02:19
Thanks kip
Fang Liang
02:02:43
Yes, the office hour Every Wednesday 11am-Noon with Fang Liang (Educational Psychology) is continuing next Wednesday, and through August.
Dongqi Li
02:03:00
Great! Thanks :)
Dan Scott
02:03:46
One last question: How does the HonorLock platform interface with students who have special dispensation with SDRC (e.g. need screen-reading for blind students, getting close to screen for difficult eyesight, etc.)?
Debra Ann Fadool
02:04:49
Thank you so much - wonderful workshop - will help my instruction immensely
Caity Kelly
02:05:45
Thanks so much for a fantastic workshop! :)
Dan Scott
02:05:51
I think that's good - just need to think about it a bit more. Thanks.
Jessica Simon
02:05:59
Thank you! I feel much more prepared!
AD Weber
02:06:34
Thank you so much. This workshop was tremendously helpful.
Ana Sanchez
02:06:38
Thank you, great information.
Lauren Willson
02:06:43
Thank you!!
Dan Scott
02:07:39
Thanks for the seminar - v useful.
Fang Liang
02:07:42
PIE Tip: Workshop recording can be found at the PIE website later today. https://pie.fsu.edu/coffee-hour-teaching-workshop-series/workshop-materials
Marissa Schrenk
02:07:53
: )
Marissa Schrenk
02:08:05
Hi Uju!!
Irvin Butts (kip)
02:08:14
Yes! Hello Uju.
Jorge Hernandez
02:09:15
Miss the coffee and pie!
Jorge Hernandez
02:09:19
:/
Alexandra Anyfanti
02:09:26
Thank you!!!
Junko Brudenell
02:09:33
Thank you!
Hye Ryung Won
02:09:40
Thank you!
Lauren Willson
02:09:44
Thank you all!!