Synap Academy
Synap Home
  • ๐Ÿ‘‹Hello there
  • ๐Ÿ†•What's new
    • Big features
      • โณLimit membership duration for user groups
      • โ“Question based marking
      • ๐Ÿ‘ฝCloze questions & new editor
      • ๐Ÿฆ„Customise questions in exams
      • ๐Ÿคธโ€โ™‚๏ธFlexi retakes
      • ๐Ÿ’ฟRecords of learning
      • ๐Ÿ‡Override attempt scores, comments & history
      • ๐ŸงชLab values / Additional exam resources
      • ๐Ÿ”–Bookmarking
      • โœ๏ธSingle Sign On (SSO)
      • ๐ŸŽSub portals
      • ๐Ÿ›‚Multi-factor Authentication (MFA)
      • ๐Ÿ—’๏ธNotepad on attempts
      • ๐Ÿ‘๏ธโ€๐Ÿ—จ๏ธSynoptic
      • ๐ŸŽ–Override Grades
      • ๐Ÿ“ธGet webcam shots for identity verification
      • ๐Ÿ”Exam security: Lock exam attempts
      • โ›“๏ธShare links
      • ๐Ÿ›ฉ๏ธThe attempts table
      • ๐Ÿ“‹Anti cheat: disable copy & paste
      • ๐ŸฆšStudents Insights page
      • ๐Ÿงžโ€โ™‚๏ธGenerating quizzes
      • ๐Ÿฅ‡Exam certificates & resits
      • ๐Ÿ” Mark schemes/rubric marking
      • โœ…Marking & definition of completed attempts events -
      • ๐Ÿ‘ฏโ€โ™€๏ธCloning
  • ๐ŸŽฎInteractive demos
  • ๐Ÿƒโ€โ™‚๏ธGetting started
    • Overview
    • Content management
      • Notes
        • Dynamic notes
      • Surveys
      • Uploading content
        • Embed presentations
    • Billing & usage
  • โ“Quizzes
    • Creating a Quiz
      • Question types
        • Cloze question types
        • Audio recording questions
        • Audio/Video Stems and configurations
      • EMQs
      • Quiz Experience
      • Instructions & sections
      • Scoring on Synap (Points vs Credits)
        • Negative Scoring
        • Score by choice
    • Importing & Exporting Questions
      • Importing
        • Word Doc to CSV Format
        • Questions
        • EMQs
        • Sections
      • HTML formatting
  • ๐Ÿ‘จโ€๐Ÿ‘ฉโ€๐Ÿ‘ฆโ€๐Ÿ‘ฆUsers & Groups
    • User types
    • Creating groups
      • Adding & inviting users by email
      • Generating user accounts
      • Importing new and existing users via csv
      • Customising messages to users
      • Sharing user group links
      • Advanced group settings
    • Manage groups
    • User information
    • Permissions
      • Global permissions
      • Specific permissions
      • Educator permissions
      • Markers permissions
  • ๐Ÿ‘จโ€๐Ÿ’ปExams
    • Understanding Exams on Synap
    • Create and Manage Exams
      • ๐Ÿ—๏ธ1. Setup: Exam
        • Dynamic exams
        • Customisation
      • ๐Ÿ”จ2. Build: Exam
        • Sections
        • Grades
      • โš™๏ธ3. Configure
        • Experience
        • Instructions
        • Results
        • Resits
        • Certificates
      • ๐Ÿš€4. Advanced
      • ๐Ÿ–‹๏ธMarking - Double & Blind
        • Adding custom marks & a mark scheme
      • ๐Ÿ“จ5. Share
        • Schedule
        • Publishing
        • Versioning
      • ๐Ÿ‘€6. Manage
    • Mark/Score attempts
    • Anti-Cheat features
      • Disabling Spellcheck for Exams
    • Proctoring
      • Proctoring with Rosalyn
        • Rosalyn Lock-down exam
        • Rosalyn Live Proctoring exam
        • Sitting a Rosalyn Proctored exam
      • Proctoring with Synoptic
        • Create a Synoptic exam
        • Reviewing Synoptic Sessions
        • Sitting a Synoptic Proctored Exam
        • Synoptic Best Practices & Trouble Shooting
      • Proctor Pricing
  • ๐Ÿ„Collections
    • Creating collections
      • Configure collections
    • Manage user group visibility
    • Collection mocks
    • Collections and the Study
    • Collection use cases
  • ๐ŸŽ๏ธCourses
    • Assignments
    • Course builder
    • Assigning a course
      • Viewing assignments & publishing new versions
    • Courses and assignment use cases
  • โš™๏ธPortals
    • Trouble shooting for your students
    • Portal Settings
      • General and branding
      • Registration settings
      • Email settings
      • Locale / Language settings
      • SSO Authentication
        • Auth0
        • JSON Web Tokens (JWT)
        • SAML with Okta (EU)
        • SAML with Okta (US)
      • Study and Self Practice settings
    • User Access
    • Data Management
      • Tag manager
      • Attributes
      • Records of learning
    • Sub portals
      • Creating sub portals
      • Branding sub portals
  • ๐Ÿ“ŠAnalytics
    • Fractal
    • Tags & facets
      • Facet best practice
    • Student Insights
    • Question statistics
  • โฌ…๏ธExports & Reporting
    • Attempts table & exports
    • Reporting platform (Depreciated)
    • Flag exports
  • ๐Ÿ”ŒIntegrations
    • ๐ŸชWebhooks
      • User Updated Webhook
      • Attempt Completed Webhook
      • Attempt override created
      • User Registered Webhook
      • Exam Completed Webhook
      • Attempt Submitted Webhook
      • Exam Submitted Webhook
      • Attempt Certificate Generated
      • Store Purchase Webhook (Legacy)
      • Completed Assignment Webhook
      • Flag Planted Webhook
      • User Added to User Group Webhook
      • User Registered for Exam Webhook
      • Learning Record Webhooks
      • Invite sent
    • Integrations & APIs
    • Single Sign On
    • โšกZapier
      • ๐ŸŸขGet started
      • ๐Ÿ”ซTriggers
      • ๐ŸŽฌActions
      • ๐Ÿ—๏ธExample Workflows
    • Segment
      • Test & Question Analytics
    • Google Analytics
    • Custom Domain (CNAME)
    • Synap Mobile apps
  • ๐Ÿš€Using Synap
    • Admin Account
    • Synap Students
Powered by GitBook
On this page
  • โœ๏ธ Marking roles
  • ๐Ÿค” Marking considerations
  • ๐Ÿ“ Configure marker type lists
  • ๐Ÿ“ฅMarkers inbox
  • ๐Ÿคนโ€โ™€๏ธ Manage and assign markers
  • ๐Ÿ‘€ Viewing marks

Was this helpful?

  1. Exams
  2. Create and Manage Exams

Marking - Double & Blind

Detailed instructions on setting up and managing the double and blind marking process for exams on Synap

Previous4. AdvancedNextAdding custom marks & a mark scheme

Last updated 5 months ago

Was this helpful?

Requires Pro or higher

With Synap's Double and Blind Marking features you can deliver exams that adhere to required marking processes, and streamline marking to one place. This feature is available on Pro or higher plans, allows exam creators to establish detailed marking rules and processes at the exam level, fully supporting both double and configurable double-blind marking approaches. When double marking is enabled, each attempt must be evaluated by provisional markers at least the minimum number of times specified. This ensures that multiple perspectives are considered before final marks are assigned.

To enable go to any exam and find the marking page.

  • ๐Ÿ‘ฏโ€โ™€๏ธ Double marking = refers to the process where an exam attempt is evaluated multiple times by different markers before finalisation. This process ensures that multiple perspectives are considered, enhancing the accuracy and fairness of the assessment. On Synap enabling double marking introduces the role of the provisional marker to an exam

  • ๐Ÿ•ถ Blind marking = is designed to preserve the anonymity and integrity of the marking process, ensuring unbiased evaluations. On Synap there are two configurable options for blind marking:

    • ๐Ÿฅท Candidate Concealment: This feature hides the identity of the candidate from the marker. It can be enabled for both provisional and moderating markers, ensuring that marks are assigned based purely on the content of the responses, without any influence from the candidateโ€™s identity.

    • ๐Ÿงโ€โ™‚๏ธMarker Isolation: This feature prevents provisional markers from seeing each otherโ€™s marks and comments. This ensures that each provisional markerโ€™s assessment is independent, which is crucial for maintaining objectivity in the double marking process. Marker isolation cannot be enabled for moderating markers as they need to review all provisional marks to finalize the attempt.

โœ๏ธ Marking roles

On exams with double marking enabled, marking is split into 3 distinct roles, generally these roles will be performed by different users however depending on your process you may have the same person taking on multiple roles (eg an admin or manager could be a provisional or a moderating marker).

Term
Description

Provisional marker

Provisional markers are assigned to an attempt when double marking is enabled. They input their own set of marks, feedback, and comments on responses. Importantly, the marks and comments from each provisional marker are not visible to other provisional markers to maintain independent assessments. An attempt can have one or more provisional markers, and their contributions are reviewed by the moderating marker.

Moderating marker

This individual oversees the entire marking process, reviews the inputs from provisional markers, and has the authority to override and finalise the marks for each question. The moderating marker ensures the consistency and accuracy of the final marks. Regardless of the number of provisional markers, each attempt will have only one moderating marker.

Finalising marker

The finalising marker is responsible for finalising the marks on an attempt, making it ready for release. This role can be assigned to an admin, educator, or manager and is configurable via global or specific permissions for an exam. The finalising marker ensures that all marks are thoroughly reviewed and validated before release.

๐Ÿค” Marking considerations

Before you configure marking on an exam it's important to think about the marking process and features you need

  • Should attempts be marked more than once? - if yes then enable double marking to allow provisional markers to play a role in marking attempts before they get to a moderating marker, and set the minimum markers per attempt accordingly. If no then all markers assigned to the attempt will act as a moderating marker.

  • Should provisional markers see the inputs of other markers? - if no then enable marker isolation to ensure the provisional markers are marking blind. Moderating markers will always be able to see the inputs of provisional markers who marked before them.

  • Should markers know who's attempt they are marking? - if no then make sure candidate concealment is enabled for both provisional and moderating markers, else they'll be able to see candidate information about who's attempt they are marking

  • How should markers be assigned attempts to mark? - if you want to control exactly who is assigned which attempts you'll want to use manual assignment to allocate attempts, else if you're happy for this to be done at semi random by the system to allocate based on capacity then allow round robin to be used. Once attempts are assigned markers you can modify the assignment from the exam users table.

  • How should people be marking attempts? - if you have markers who only have the role of marker on platform then they'll only be able to access attempts via the markers inbox. However if you have educators, admins or managers marking attempts then you may need to configure the markers inbox page to show for them.

Candidate concealment configurations may not always work for admins, educators or managers who can access attempts outside of the markers inbox

๐Ÿ“ Configure marker type lists

Create lists of each marking role for your exam, add users in one by one or entire user groups. Users can assume two roles if they are in both lists. Marker lists stay editable even after an exam is scheduled so if one of your markers is away or you need to remove them from the exam, then just remove them from the list and save.

๐Ÿ“ฅMarkers inbox

The markers inbox page is where provisional or moderating markers will go to mark attempts assigned to them. The inbox is easy to use and navigate, there is a tab for all the open attempts and a tab for all the completed attempts. Markers can search for attempts by id or exam name, and by default the inbox is ordered by attempt submission, showing the longest waiting first.

Once on the marking inbox page, markers can mark attempts via the pencil icon to open the marking page

From the marking page, all responses that require marking will show as blue with an unmarked status which will update to marking once inputs have been started then marked once completed. Once all of the blue status's are gone all the required questions for marking are completed.

To help with marking on exams with auto marked and manual marking questions, markers can use the quick navigation bar to go straight to unmarked responses.

Provisional and moderating markers can save throughout their marking process and exit the marking page at any time to return to later. Once they've finished marking they then need to submit their marks using the button at the top of the page. After submission they will not be able to go back and change any of their inputs. The attempt will then progress onto the next step which may be for more provisional marking, the moderating markers or the finalising marker.

๐Ÿ“Markers who are only of the user type Marker will only have the markers inbox page enabled. No other pages are available to add for users of this type.

If you have educators or other user types who will also be markers then you should enable the markers inbox page from pages from user access settings.

For more details about marking attempts, feedback and internal comments see our docs on how to mark an attempt below.

๐Ÿคนโ€โ™€๏ธ Manage and assign markers

When double marking is enabled, the marker assignment method can be selected.

  • Round Robin: Implement round robin assignment to distribute attempts randomly and evenly among markers, ensuring balanced workloads. Marker assignment can be overridden by an admin, manager or educator (with the right permissions).

    • Provisional markers: are assigned when an attempt has been submitted

    • Moderating markers: are assigned when all provisional marking has been completed

  • Manual Assignment: Use manual assignment for greater control, allowing exam creators or managers to handpick markers for specific attempts. When enabled no markers will be assigned to attempts automatically.

To assign or reassign markers to an attempt go to the exam users table, select one or more attempt, and use the assign marker button to select and assign specific markers for an attempt.

From the assign marker modal, select the provisional or moderating markers required for the attempt/s, you can also remove already assigned markers.

From the assign markers modal, you'll have the option to self assign attempts to yourself if you're an admin. When self assigning an attempt you'll be given the roll of moderating marker, if provisional marking is required this will still need to be completed before you are able to mark.

All attempts must now be assigned before they can be marked. Previously on the system if you were an admin, manager or educator (with the correct permissions) then you could mark any attempt, however now you will need to self assign them individually or in bulk in order to mark.

๐Ÿ‘€ Viewing marks

Once an attempt has had it's marking completed, finalised or released, all markers who were assigned the attempt, or admins/managers/educators who can view the attempt will be able to view the marking page.

From the exam users table select the attempt to view and use the view marks button

From the view only marking page, inputs from all markers can be viewed. Provisional marker comments and marks will show in a response history, and moderating marker final marks are shown as the final inputs.

When viewing attempts, inputs can no longer be changed or updated by any users. If you need to update marks or grades at this point this is done from the results override options, more below

๐Ÿ‘จโ€๐Ÿ’ป
๐Ÿ–‹๏ธ
Mark/Score attempts
๐Ÿ‡Override attempt scores, comments & history
Marking video guide
Viewing inputs of provisional markers and the overall marks left by a moderating marker on a question
Configuring double and blind marking
Creating provisional and moderating marker lists for an exam
Navigating the markers inbox
The marking page
Marking status
navigating marking
Marking page buttons
enabling the markers inbox page
Marker assignment configuration
Assigning a marker
Assigning markers manually
Self assign attempts
View marks button
Viewing marking