| 摘要 |
A computer network implemented system for enabling intelligent crowd sourced examination marking is provided. The system includes a marker community manager that enables authorized users of the system to access one or more features or functions for building and managing a crowd of markers (“crowd markers”) associated with the system, and optionally dedicated to one or more authorized users, wherein the marker community manager includes or is linked to a profile manager for creating and updating a profile for each crowd marker (“crowd marker profile”), and storing the crowd marker profiles to the database. An examination content distributor is also provided for making accessible examination content to crowd markers using one or more network-connected devices. A marking manager enables authorized users to (i) create one or more active crowd sourced marking projects, and (ii) to automate the management of one or more workflows related to the completion of one or more aspects of active crowd source marking projects. The system enables authorized users to generate one or more marking parameters associated with marking projects or associated marking activities, where the marking parameters may relate to marking quality criteria, and the marking parameters are stored to the database as a marking profile. A matching component for matching marking projects or marking activities to crowd markers suggests suitable crowd markers for the marking project, and optionally suggests allocation of particular marking activities to selected crowd markers, or groups of crowd markers. The system delivers applicable examination content for marking (including scoring and/or providing feedback on examination content) by selected crowd markers, or groups of crowd markers through an adaptive marking tool. Related computer implemented methods are also provided. |
| 主权项 |
1. A computer network implemented system for enabling intelligent crowd sourced examination marking comprising:
(a) one or more server computers linked to the Internet and to a database, and enabling one or more computer implemented utilities providing:
(i) a marker community manager that enables authorized users of the system to access one or more features or functions for building and managing a crowd of markers (“crowd markers”) associated with the system, and optionally dedicated to one or more authorized users, wherein the marker community manager includes or is linked to a profile manager for creating and updating a profile for each crowd marker (“crowd marker profile”), and storing the crowd marker profiles to the database;(ii) an examination content distributor for making accessible examination content to crowd markers using one or more network-connected devices, the content distributor optionally enabling the import of scanned versions of paper based examination papers into the database such that they are associated with the examination writer; and(iii) a marking manager that is configured to enable authorized users to (i) create one or more active crowd sourced marking projects, and (ii) to automate the management of one or more workflows related to the completion of one or more aspects of active crowd source marking projects; wherein the marker community manager, the marking manager, and the examination content distributor interoperate so as to enable, or initiate: authorized users to generate one or more marking parameters associated with marking projects or associated marking activities, where the marking parameters may relate to marking quality criteria, and the marking parameters are stored to the database as a marking profile; a matching component for matching marking projects or marking activities to crowd markers, optionally using the applicable crowd marking profiles, so as to (i) suggest suitable crowd markers for the marking project, and (ii) optionally suggesting allocation of particular marking activities to selected crowd markers, or groups of crowd markers; and deliver applicable examination content for marking (including scoring and/or providing feedback on examination content) by selected crowd markers, or groups of crowd markers. |
