���㽶��Ƶ

There are two equated forms available of the End of Curriculum™ exam. If a student fails on his or her first attempt and the PA program would like the student to retake the End of Curriculum exam, they may do so only once and no earlier than 60 days after their initial administration. This ensures that the student and program have adequate time to develop and implement an individualized remediation plan.

One limitation of transition from ExamDriver to the new Assessment Center is that we can’t tell the Assessment Center that the students have already taken their max allowed End of Curriculum attempts. Therefore, the Assessment Center thinks students who took End of Curriculum twice in ExamDriver can be scheduled for a third exams (second retake). While programs can technically schedule these students for a third End of Curriculum in the Assessment Center, it would be against ���㽶��Ƶ policy, and we ask that you please refrain from doing so.

Students can take all available forms (three Family Medicine forms, two for all others) for the first time in accordance with program policy. The first form is randomly assigned to all students, and when taking it a second or third time they are assigned a form they have not seen before.

After all forms have been given once, programs must wait 21 days after the last administration to allow for remediation before the student will be eligible for additional resits. During this 21 day period the student will not be available for selection when scheduling that type of exam. The student will become available to schedule for the exam once again when selecting a date 21 days after the last administration.

• PACKRAT – three 75-question sections, two 10-minute breaks
  • Standard Time: 75 minutes per section
  • Time and a Half: 113 minutes per section
  • Double Time: 150 minutes per section
• End of Rotation – two 60-question sections, one 10-minute break
  • Standard Time: 60 minutes per section
  • Time and a Half: 90 minutes per section
  • Double Time: 120 minutes per section
• End of Curriculum
  • Standard Time: five 60-question sections, 60 minutes per section, four 10-minute breaks
  • Time and a Half: Two days, five 30-question sections each day, 45 minutes per section, four 10-minute breaks each day
  • Double Time: Two days, five 30-question sections each day, 60 minutes per section, four 10-minute breaks each day

The Program Director or ���㽶��Ƶ account manager is responsible for granting Assessment Center permissions, and not everyone will have the same access. If you are missing access to complete a task, please check with your PD or account manager.

Below are the available roles, and one or multiple may be assigned:

• Ordering Agent: Users with this role have permission to use the ���㽶��Ƶ Assessment Shop to order exams.
• Assessment Hub User: Users with this role have permission to manage the program’s student roster, schedule exams, and view score reports in the ���㽶��Ƶ Assessment Hub.
• Exam Proctor User: Users with this role have permission to proctor exams within the Exam Delivery Platform. This role is not for remote proctoring services.

Ordering exams has never been easier! A great feature in the Assessment Center is the option to upload your purchase order (PO) online. Doing so removes the requirement to email ���㽶��Ƶ a copy of your purchase order, as was the normal procedure when ExamDriver was in use. The PO can be uploaded in one of three different areas while navigating through the Shop:

1. When entering your payment information, just before clicking the button to Place Order.
2. On the confirmation page, immediately after the exam order is placed.
3. When viewing previously submitted orders. From the Shop home page click View Previous Orders, then View Details for the relevant order.

• This option is great for programs whose policies require submitting the exam order first, then providing an invoice to their finance department to receive a purchase order and payment.

In each area the button will be labeled “Upload Files”. Once a PO is uploaded into the Shop with an exam order, ���㽶��Ƶ Finance receives an automated notification to review the information for accuracy and subsequently release the exams to your program. Keep in mind the Finance review process and releasing of exams may take two business days following the PO upload, and the PO only needs to be uploaded in one of the three places. Although emailing the PO is no longer required, you may still send a copy to exams@paeaonline.org for assistance if there is an issue uploading it online, or if the exams need to be urgently released.

For reference, uploading a PO is detailed starting on page 8 of the Assessment Center User Guide, which is available to download on the Assessment Center Resources page.�� We also have an instructional video available HERE outlining the complete ordering process from start to finish.

A quote can be generated in the Shop by program users with Ordering Agent assessment permissions.

1. Log into the ���㽶��Ƶ Member Community, select the Assessment Center tab, then clickAssessment Shop.
2. From the next page click Order Exams or scroll down further and click the button for the exam you need to order.
3. Adjust your quantity and click Add to Cart. Next, choose to Continue Shopping or View Cart if you have all the exams needed.
4. On the next page to the right, click Next under Request a Quote – Exams.
5. Review the order for accuracy, click Next again, and a .pdf file will be generated with your quote information.

Note: A quote is not an invoice and does not represent an order submission. After obtaining the quote, please return to your cart and finish submitting the order until a confirmation message is received.

Invoices are generated in the Assessment Shop after an exam order is submitted. There are several ways you can access an order invoice for completion of payment.

• You can download an invoice after your order is placed by clicking ‘View PDF’ on the confirmation page at the end of the process.
• You can also access this PDF by clicking the link in your order confirmation email.
• You can download an invoice at a later date by viewing your order history. Begin by logging into the Member Community. Click the Assessment Center in the navigation bar to enter the Assessment Shop. Near the lower half of the shop’s home page is the “View Previous Orders” button, which will take you to a list of your program’s orders. Locate the order you need and click ‘View Details’.�� On the next screen you can click ‘View PDF’ to generate the invoice.

As you’re uploading the students in your latest cohort, here are some recommendations for making it easy to get the responses you need to help students successfully activate the password-protected access they’ll need while in your program.

If possible, plan the time your students will be uploaded into the Hub by faculty or staff. Doing so at a time when most can easily access their email is ideal, since after being uploaded the students receive an automated email to set their password. If students are uploaded during a busy time when they don’t check email often (ex: during a clinical rotation, or at the end of the week), it’s likely they will miss the message and the password invitation link will expire – as it’s designed to do so if not clicked in 5 days.

Of course, we know planning around the schedule of many students can be difficult and that suggestion won’t work for everyone, so simply giving the students personal notice of when they’re going to be uploaded can also be helpful. With your prior notification they will know to expect the time-sensitive email from ���㽶��Ƶ. In addition, you should make it clear in your pre-exam communication to students that the Hub is not used for exam administration– it’s only used to view score reports. We have templates for communicating these and other topics with students available in the Assessment Center Resources, on the Student Communications Resources page.

In the event a student’s password creation link expires, Assessment Hub users can resend this welcome message. Go to the Manage Students page, select the student from the table and then click Resend Confirmation. If the student has already set their password but requires assistance resetting it, this button will say Send Password Reset.

1. Student Group Mismatch: The Student Group entered in column E of your CSV must match the student group name created in the Hub. This includes spacing, capitalization, and punctuation.
2. Blank Spaces: The program should ensure when copying and pasting information that the student’s email address does have an extra blank space at the end of the email address.
3. Sample Row: You MUST delete or overwrite the sample row (Row 2) in the CSV file before saving.

Information for previously uploaded students can be updated from the Manage Students page in the Hub. When on the Manage Students page, select a student to show their Student Details in the box next to the table. Click the Edit link in that box to open their details page for editing.

NOTES:

1. Student profiles cannot be deleted. If a student leaves the program, faculty or staff should update the student’s Graduation Date on the Manage Students page to make it at least 120 days prior. Updating their graduation date to 120 days in the past will archive the student’s account, making them ineligible for exam scheduling and unable to access their Assessment Hub account.
2. Graduation years will only show on the Manage Students page if a student has been uploaded to it with the CSV. If no students with that graduation year have been uploaded, the graduation year will not be available in the dropdown list.

The Schedule an Exam Event screen only displays the individual exam Credits available for each Exam Program. It’s important to note that this page will not display available Student Exam Box credits. Before scheduling, please use the Manage Student Exam Boxes page in the Student Roster tab to check available exam credits for applicable students. If credits for the particular Exam Program are available in a student’s assigned Student Exam Box, the Hub will automatically pull from the Student Exam Box when scheduling.

• In-Person exams are scheduled for a set time with a PIN, with in-person faculty or staff actively proctoring in the testing space. These exams may be scheduled until the time they are set to begin. SecureClient is optional to use for these exams, and programs will need to notify students of the preferred exam launch process before each exam.
• Unproctored exams are scheduled for a date range without a PIN, taken remotely without a live proctor present, and administered in SecureClient. These exams must be scheduled at least one day before they are set to begin.
• Remote Proctored exams are scheduled for a date range with a PIN, taken off campus with a third-party remote proctoring service, or proctored by faculty or staff using video conferencing to monitor exams (Zoom, Teams). These exams must be scheduled at least one day before they are set to begin.
  • R
  • Thi
  • equirements Using Third-Party Monitoring Service:rd-party monitoring service using their screen share and lockdown tools is most ideal
    • SecureClient is not required
  • Requirements Using Faculty or Staff to Remote Proctor:
    • For remote proctoring by faculty, programs can decide between two options for connecting with the student to monitor behavior:
      • Use their web camera and screen sharing — SecureClient cannot be used
      • Use a second device (phone or iPad) to the side of their work station to monitor their environment, including a view of their screen — SecureClient is recommended

In the Assessment Center, eligibility for time-based accommodations is established as part of the student roster. During the student upload process, students with time-based accommodations should be indicated in the CSV file using Yes or No in the relevant column. The specific duration they are granted (time and a half or double time) will be selected at the time of scheduling the exam.

Faculty will need to review their students with time-based accommodations in the Assessment Hub under “Manage Students” to make sure time-based accommodations is checked off in their profile.

In the Assessment Center you can schedule students’ exams to begin in their local time zones. This includes the ability to schedule in separate events if you have students taking remote exams in different time zones. You will select the time zone where the student will take the exam at time of scheduling, and the student’s confirmation email will state the time zone where the student will sit for the exam.

However, please be aware that all exam times will be converted to Eastern Time in the Exam Delivery Platform when Proctor users view the Monitor Exams tab. Also, exam availability will end at 11:59 p.m. Eastern Time on the last day. As long as a student begins their exam before that time, they will be able to complete it.

Assigning specific proctors to exams is not necessary. Anyone that has Exam Proctor user permissions in your program’s ���㽶��Ƶ Member Roster can proctor any exam. When proctoring an exam, the user will log into the Member Community and click Assessment Center > Exam Delivery Platform > Test Administration (at the top of the page next to the ���㽶��Ƶ icon) > Monitor Exam.

Proctors should not click the “Deliver Test” link at the bottom of the Exam Delivery Platform home page. Clicking this link will take you to the website to download SecureClient, which is not necessary for proctors.

While an In Person exam is scheduled with a specific start time, a student may still begin the exam until 11:59 PM Eastern Time if the event is delayed.

However, if the student is unable to take it on the scheduled calendar date (In-Person) or within the scheduled date range (Unproctored and Remote Proctored), it is important to cancel the exam event after being informed of the delay. This can be done by any faculty or staff with Assessment Hub User permissions by going to Assessment Center > Assessment Hub > Scheduling > Exam Schedule. Once filtered to the applicable Graduation Year and Exam, select Cancel from the corresponding row of the student’s exam you wish to cancel. When the exam is cancelled on this page, the exam credit is returned to the program’s available balance for future use.

Please note if an exam is not cancelled within the scheduled calendar day or date range, the system will automatically void the event and the credit does not return to the program’s balance. If your program is unable to cancel the exam event and the system automatically voids, please contact exams@paeaonline.org for additional assistance.

In some cases, a proctor can cancel an exam and reschedule it immediately to resolve technical issues with launching, or if the student was not assigned their allowed time-based accommodations.

• Note: Rescheduling for the same calendar day is only allowed for In Person delivery type.

When this is necessary, the program faculty or staff should go to Assessment Center > Assessment Hub > Scheduling > Exam Schedule. Once filtered to the applicable Graduation Year and Exam, select Cancel from the corresponding row of the student’s exam you wish to cancel. When the exam is cancelled from this page in the Hub, the exam credit is automatically returned to the program’s available balance to use again.

It’s very important that the proctor communicates to the student their exam is being cancelled and rescheduled. The student will need to immediately close the SecureClient app (or if needed shut down the computer) while the rescheduling takes place. After the proctor confirms the exam is rescheduled, the student can relaunch SecureClient and login with their newly generated keycode.

The Program Composite Reports tab is where programs release the student scores following an exam event.

1. Go to Program Composite Reports within the Score Reports tab, and use the dropdown menus to filter to the necessary exam.
2. Check the box next to the students whose scores you want to release and click Release Selected Scores.
3. If you are releasing the scores for all the students that took the exam, you can also click Release All Scores.
4. Students will receive an email that they have new score reports available in the Assessment Hub.

Note: If a student’s results for that exam have already been released, there will be a green check in the Released column, third from the left. If you click the Release All Scores, it will not notify students again if their scores have already been released.

In this article, “The End of Raw Scores, and the Benefits of Scale Scores,” we explain that upon launch of the Assessment Center in August 2023, ���㽶��Ƶ removed the scale score conversion calculator and replaced it with a raw score look up table. The ���㽶��Ƶ End of Rotation Exam conversion tables for Versions 2 through 8 are available in Assessment Hub under “Exam Driver Score Reports”.

Score reports for exams taken in ExamDriver are available in the Assessment Center for program faculty and staff long term. To access these reports, go to Assessment Center > Assessment Hub > Score Reports > ExamDriver Score Reports. If you do not find a particular ExamDriver report you would expect to have, please contact ���㽶��Ƶ exam support at exams@paeaonline.org.��

Please note students will not have access to ExamDriver score reports in their Assessment Center accounts. We kindly ask program faculty or staff to assist students with ExamDriver score report requests.��

The Exam State column denotes the current status of a student’s test. Many of these states will not apply to ���㽶��Ƶ exams. The below key can be found starting on page 31 of the Assessment Center User Guide.

To read more on the use of PINs in starting an exam, click here.

1. Go to the Test Administration page
2. Select the applicable students from the schedule table. Select only those students of the same exam type, delivery type, and start time in a single invigilation pack.
3. Click Print Invigilation Pack at the bottom of the screen
4. Choose the desired resources:

• • Attendance Register – This lists the details of selected exams and the keycode and PIN for each student with a column to mark them as present. This may be helpful for university proctors who may not have access to your program’s tools, such as in a testing center or library. It is also extremely useful as a backup tool if your program chooses to remove PINs to initiate exams.
  • Invigilation Report – This form allows the proctor to document any disturbances or anomalies that occurred in the course of the exam that may be helpful in the case of investigations of suspected inappropriate behavior.
  • Keycode Slips – These can be provided to the student if they forget their keycodes and include the student’s name, the exam they’re taking, and the keycode. They can be printed one or two per page.

5. Save or print the PDF document
6. To return to the schedule table, click Monitor Exam in the top navigation menu or click the Back button in your browser.

Exams are timed and have scheduled breaks, so they should not be paused unless there is an emergency or a student has an accommodation for frequent breaks. In-person proctors may pause and resume the exam on the Monitor Exam tab.

Third-party proctors do not have access to pause an exam in an emergency. In that case the student should disconnect from the exam by closing their browser. When they return, they will enter their Keycode again. Their progress and exam clock will resume where they left off.

1. Faculty and proctors do not need to download or open SecureClient. The lockdown browser is only used by students.
2. The MUST be used by students for unproctored exams. If a student tries to use the instead of the SecureClient browser for an unproctored exam, they will get an “Invalid Keycode” error.
3. Using SecureClient is now optional for In person exams, and programs have the flexibility to choose whether to require it for in-person testing based on their needs and technical environment. Programs should communicate general instructions to students in advance so they can make the necessary preparations, such as setting their Do Not Disturb focus or updating SecureClient.
4. To start a remote proctored exam with a third-party vendor, the student will sign on to the vendor’s website and when instructed, navigate to the They will NOT use the SecureClient browser. The vendor’s software will replace SecureClient.

������ Download Page –

*Students have access to the above link in their exam scheduling confirmation emails and their Hub accounts.��

������ System Requirements:

• Compatibility Check – The PC version of SecureClient has a system check option on the keycode screen. The Mac version has this, as well as a sample test. However, the sample test uses question types and formats not used on ���㽶��Ƶ exams. Students should proceed with caution, as we only use simple multiple-choice tests, sometimes with static images. ���㽶��Ƶ does not use sound or video on test items.

������ Troubleshooting for PCs –

Most common issues will be on the troubleshooting page. If you are experiencing an issue not mentioned on this page, please reach out to ���㽶��Ƶ Exam Support, and be prepared to provide a photo or screenshot of the error.

Currently, the primary tablet that can be used to take ���㽶��Ƶ exams is an iPad. The iPad Mini is not compatible due to screen resolution requirements, which . There are a few important differences in how the iPad app works:

• Using the iPad app may benefit students who require the use of zooming to increase the size of the test text and images by using pinch gestures. We urge students to exercise caution to ensure that pinching does not change their answer selections.
• The iPad version does not currently have the ability to highlight question text or strike out answer options like the computer apps.
• The digital notepad still only uses the keyboard. Students cannot draw with their finger or an Apple Pencil in the notepad, so it functions similarly to the computer version.

The app will ask users to enter lockdown mode before entering the test – clicking “no” will prevent students from entering the test, while clicking “yes” will disable buttons and gestures that allow test takers to access other apps.

Versions of the Microsoft Surface that require that apps be downloaded from the Microsoft Store are not compatible. If a student’s Surface runs the full version of Windows 10 or 11, not Windows 10 or 11 S, they will be able to download and install SecureClient. This primarly consists of the Microsoft Surface Pro devices.

PC users are required to temporarily disable text suggestion software in order to launch SecureClient. This includes the typing assist tools native to Windows, as well as tools like Grammarly. Users will not be able to launch��SecureClient��without first disabling these tools.

To do so, navigate to Settings > Time & language > Typing and ensure the toggles are set to Off before each exam. (See photo below)

1. After receiving an exam confirmation email, be sure to check the scheduled exam details for accuracy and save the email for future reference.
   1. Students who cannot locate their confirmation email should check the spam or junk folder. If the email is not there, follow up with your program for assistance. If the exam is properly scheduled, the program will also have the keycode in the Exam Schedule tab of the Assessment Hub, and in the Exam Delivery Platform one week before the exam.
   2. Note: students do not need to set their Assessment Hub password in order to take their exam, but they will need it to view their scores.
2. Only download the test in advance if instructed to do so by the program. Downloading the test in advance if not instructed to do so may cause exam launching issues.
3. Check for updates to the device’s operating system and SecureClient (if being used) the night before the exam.

1. If a student receives an invalid keycode error message when launching their exam, they should first make sure that it’s after the scheduled start time and that the keycode entered is accurate.
   1. If both are true, students should close SecureClient, check for updates, and relaunch.
   2. If that does not help, they should uninstall SecureClient and reinstall, ensuring that it’s from the website .
2. After entering their keycode, students should ensure that the information on the Student Details pop up screen is correct before proceeding. If the details are incorrect, the student may click to exit SecureClient and follow up with their proctor. Do not proceed into the exam if the information is not correct.
3. Students will need to acknowledge the Examinee Agreement before launching their exam. The check box is grayed out until the student scrolls through and reviews the whole agreement. After that task is complete, they can check the acknowledgement.
4. Next, In-Person and Remote Proctored exams will need a PIN, or will need the proctor to unlock the exam if the PIN has been removed. Unproctored exams will begin right away.
5. Before starting the exam, take a moment to check the exam clock and ensure the scheduled time is accurate.
   1. Note: the clock has 2 views – one for time remaining in a section and one for remaining time in the exam. To change the view, click on the clock.

Students testing a PC can use keyboard shortcuts (CTRL and + or -) to zoom within SecureClient, while those on an iPad have the ability to pinch to zoom. If a student has requested accommodation for enlarging or minimizing text, this can be met by simply testing on a PC or iPad and will not require special scheduling or evaluation by ���㽶��Ƶ. Zoom functionality is not yet available for SecureClient for Macs.

Other built-in exam features for students include:

• Color and contrast adjustment – The Settings gear in the bottom left corner of the exam screen will reveal a screen that allows you to change the colors to a combination that better suits your vision and environment.
• Text highlighting– Use your mouse to select the desired text and click the Highlight icon that appears. To un-highlight, hover over the highlighted text to reveal the button again.
• Striking answer options– Right click on the answer option you wish to strike.
• Item flagging – Click the flag button at the bottom of the screen next to the Back and Next buttons. A flag will appear in the item list on the left and in the grid available as a popout in the bottom left. Students will be alerted to flagged questions before finishing a section.
• Exam clock change – Click the exam clock to toggle between the time available in the section and the time available in the entire test.
• Digital note taking – Click the link to type notes for each question to help you organize your thoughts.
• Searchable lab values reference – Click the link to view a searchable PDF document that includes key adult lab value reference ranges.

Programs and students can test out these features by taking the ���㽶��Ƶ practice exam at the following link:

The features are also described with screenshots starting on page 45 of the Assessment Center User Guide, which is available to download on the Assessment Center Resources page.

A bit of patience is required in ending the exam. Because SecureClient downloads the test content and then uploads results, students need to be careful not to shut down their computers right after clicking the final “Exit Test” button. Wait for SecureClient to return to the Keycode screen or close down to ensure that their results have uploaded.

If the student closes out of an exam and the results upload properly, on the Monitor screen of the Exam Delivery Platform you will see a green “finished” check.

If a student closes the exam and their proctor does not see a green “finished” check, the student should open SecureClient again, wait about 5-10 minutes without entering anything, then reenter their Keycode after waiting. If the student receives a message stating “Invalid Keycode: This exam has been completed”, and/or if the State icon changes to a green check on the Monitor Exam tab, the exam has been successfully submitted and scores will be uploaded into the Hub shortly thereafter. If the State icon does not change for the proctor or, the student receives a different error message, please contact ���㽶��Ƶ Exam Support for further guidance.

The Mac version of SecureClient also has the following features to help with upload errors:

• SecureClient will retry the score upload every 30 seconds if a connection error prevents the initial upload. Students will still see the error message at the end of the test, but they will see the screen refresh after 30 seconds to indicate a retry. A Proctor user can check the Monitor Exam tab to verify that the score is uploaded, which is indicated by a green checkmark next to the student’s name.
• SecureClient will unlock the test immediately after the student confirms they have completed. The impact of this change is that the student can check the task bar at the top of their screen to see if they are connected to the internet and reconnect if needed. The student will not be able to go back into the test at this point to change their answers as they have indicated that they are finished. This will simply allow them to verify a strong Wi-Fi connection while the app attempts to upload their responses.

We recommend that students check their Wi-Fi connection and wait two or three retry cycles before escalating to other troubleshooting. If proctors are unable to verify upload of the test at this point, have the student exit the test and then reopen SecureClient to the keycode screen, letting it sit a couple minutes to attempt the upload again. The proctor can check for the green checkmark, or the student can enter their keycode to see if the exam is showing as completed. If that is not successful, please reach out to ���㽶��Ƶ Exam Support for further assistance.

1. Expired Link: When a student is receiving an error message to confirm their email address, that means the previous link sent to confirm their email address has expired. In the event this link expires, Assessment Hub users at the program can resend this welcome message. Program faculty and staff can refer to this article for directions to resend the welcome message:
2. Wrong Website: Students should ensure they are logging directly into the website and using the login boxes on that page, not the button above. If a student has accidentally navigated to the login page for program faculty or staff, their log in credentials will not work and cannot be recovered from that page.
3. Invalid or Blank Character: Program faculty and staff entering student information should ensure that student emails do not contain any special characters, except for a period (.) or an at symbol (@). They should also make sure when copying and pasting that the student’s email address does have an extra blank space at the end of the email address.