A platform for automated and distributed marking of programming assessments, completed as an undergraduate project.
PALS is an open source assessment system for programming assignments, which uses dynamic and static analysis techniques for automated marking. Its architecture allows for multiple nodes to process work simultaneously, with dynamic analysis executing student code within a sandboxed environment. Plugins can also be hotswapped and automatically reloaded across all nodes, allowing for extended functionality to be added and changed without restarting the system.
For a more detailed technial explanation of the system, refer to the project report section.
- Multiple question types:
- Java code - allows editing, compilation and automated testing of code written in Java. Submission can be through an editor or by uploading a zip file.
- Written responses - for essays/text answers, can be manually and automatically marked.
- Multiple choice and response - randomly ordered options, persisted for an instance of an assignment.
- Multiple criterias combined to form the overall mark for a question, which can be given different weightings.
- Multiple criteria types for marking questions:
- Regex matching.
- Code metrics - lines of code, blank lines, comment lines, average identifier length (classes, methods or fields).
- Testing inputs - execute code with a specified or random set of inputs. This is executed against both student and correct code, with the outputs compared to determine correctness.
- Standard input/output testing.
- Existence of classes, methods, fields or enums (including values).
- Java inheritance and interfaces.
- Custom code capable of providing a mark between 0 to 100 for a criteria. Custom feedback can be also provided to the student.
- XSS (cross-site scripting) and CSRF (cross-site request forgery) protection.
- Custom session management using SHA-256 hashes for session identifiers, using guidelines from OWASP.
- Captcha protection to prevent automated brute-forcing.
- Passwords hashed with SHA-512 with unique salts for each password.
- Secure inter-node communication using RMI with SSL.
- Aggregation of exceptions, warnings and issues found with code. Useful for addressing common mistakes by students.
- Hotswappable plugins architecture, allowing for a plugin to be added/changed from a central file share and (re)loaded in every node.
- Mass enrollment.
Releases can be found at:
Click [here](/assets/projects/pals/report.pdf) to download the final project report.
- The results from dynamic assessment of student code and correct code.
- Dynamic testing of standard input/output.
- Feedback providing the student with a hint of the issue wrong.
- Stats for common issues.
- Graph of time to mark assessments with 1 to 5 nodes simultaneously.
- ERD for PALS.
- The home page.
- Administration page for nodes.
- Administration page for plugins.
- Mass enrollment page.