LMS Requirements for Enhanced Functionality
LMS Requirements for Enhanced Functionality
Category: Functionality
2. The system shall send manual electronic messages via email or SMS to users, including but not limited to Communications Required
participants, developers, instructors, administrators, with training communications.
3. The system shall have a white board feature for participants and instructors to interact with each other Communications Required
via diagrams, equations, and written notes.
4. The system shall save the current version of the whiteboard in long term storage. Communications Required
5. The system shall save the history of the whiteboard in long term storage Communications Desired
6. The system shall have a discussion forum for participants to interact with instructors and each other. Communications Required
7. The system shall have a mechanism for posting questions. Communications Required
8. The system shall have a mechanism for posting responses to questions. Communications Required
9. The system shall provide a live chat feature to allow participants to communicate with each other Communications Required
10. The system shall provide a live chat feature to allow the instructor to communicate with the participants Communications Required
11. The system shall provide for simultaneous translation Communications Required
12. The system will create event work spaces where users can collaborate on specific events or to develop Performance/Capabilities Required
training materials.
13. The system shall support content development and storage for online and classroom training Performance/Capabilities Required
14. The system will include collaboration tools that allow content developers to work together to develop or Performance/Capabilities Desired
adapt training materials
9
Requirement Requirement Type Importance
15. The system shall provide training materials development tools such as text editors, graphics production, Performance/Capabilities Desired
video editing, etc.
16. The system shall provide templates that can be used by course developers Performance/Capabilities Desired
17. The shall allow content developers or instructors to sequence modules Performance/Capabilities Desired
18. The system shall have a calendar feature for scheduling online and classroom-based courses Performance/Capabilities Required
19. The system shall have a calendar feature for tracking online and classroom-based courses Performance/Capabilities Desired
20. The system shall have a calendar feature for scheduling instructor availability Performance/Capabilities Desired
21. The system shall have a calendar feature for tracking instructor availability Performance/Capabilities Desired
22. The system shall provide for real time video streaming using built-in tools Performance/Capabilities Optional
23. They system shall have a recording feature that will allow participants to playback content at a later Performance/Capabilities Required
time.
24. They system shall have a recording feature that will allow content developers to playback content at a Performance/Capabilities Required
later time.
25. The system shall allow the participant to pause the training and continue from where they left off at a Performance/Capabilities Required
later time.
26. The system shall provide for participants and instructors to maintain an online journal during training Performance/Capabilities Desired
27. The system provides a point of contact for any training course questions Performance/Capabilities Required
28. The system shall have "knowledge check" features and/or support external tools for knowledge check Performance/Capabilities Required
(e.g. Menti)
29. The system shall have the capability of customizing the LMS user interface to accommodate different User interface Desired
languages
30. The system shall allow for creation of customized dashboards for different types of users (e.g. content User interface Required
developers, instructors, project leads, trainees)
31. The system shall allow a participant to review the completion status of any content being worked on for User interface Required
any module or course
32. The system shall support programmatic branding options for all types of training User interface Required
10
Category: Data Management
2. The LMS shall maintain a training profile for each participant. Data records Desired
3. The system shall provide version control media used by content developers Data records Required
4. The system shall tag content development according to INSEP-specified parameters (e.g. draft, Master, Data records Required
cleared for release, etc.)
5. The system shall maintain a list of email addresses for a participant to contact an instructor, or content Data records Required
developer, or course administrator
6. The system shall save, store and allow for query of evaluation data from online and classroom trainings Data records Required
7. The system shall save and store chats, discussion boards, and Q&A information for each training course Data records Required
8. Databases can be maintained on cloud-based servers maintained by Amazon or Microsoft (among Data storage Desired
others), the vendor, or an NNSA or national laboratory server contingent of meeting security
requirements.
13. The system shall allow authorized users to create data tables Database structure Required
14. The system shall allow authorized users to create data fields Database structure Required
15. The system shall allow authorized users to customize data tables Database structure Required
16. The system shall allow authorized users to customize data fields Database structure Required
11
Category: Records and Reports
12. The LMS shall be compatible with the following operating systems: Windows, OSX, LINUX, Android, and Software Required
iOS.
12
13. System software updates shall be made only on the server, or shall be pushed to users when they log in to Software Desired
the LMS
23. The LMS shall work with the existing INSEP databases System Required
integration/interface
25. The system shall be compatible with Sharable Content Object Reference Model System Required
integration/interface
26. The system shall be compatible with Learning Tools Interoperability System Required
integration/interface
28. The system shall have a tutorial for system familiarization training Training Desired
13
Appendix 15: Attribute to Requirements Map
The research team, working with prominent vendors defined a set of attributes that the team
could use to describe and discriminate among various products. Using these attributes as a
starting point, the team then defined a set of user requirements that were related to each class
of attribute. This mapping is provided below.
Attribute Derived Requirements for INSEP
16) Communication Tools
a) White Board
i) Distribution
• The system shall allow for individuals and
(1) 1 whiteboard for all
groups to create whiteboards for sharing
students
ideas in real-time.
(2) Multiple whiteboards for
• The system shall allow users to save,
subsets of students
recall, and edit individual whiteboards.
(3) Each student has his/her
• The system shall NOT save the history of
own
each whiteboard.
ii) Ability to save
• The system shall allow users to resume
(1) None
work on a previously saved whiteboard.
(2) Current Version
(3) History
44
Attribute Derived Requirements for INSEP
b) Stream Video • The system shall support the streaming
i) Live/synchronous of live videos.
• The system shall support multiple
resolutions to accommodate various
bandwidth limitations.
• The system shall have the ability to
encode video files in various formats
• The system shall maintain adequate non-
volatile storage for recorded videos
• The system shall allow the user to move
back in the video timeline when
streaming a stored video.
• The system shall allow the user to move
forward in the video timeline when
streaming a stored video.
• The system shall prevent the user from
ii) Recorded
moving past an unviewed portion of the
timeline when streaming a stored video.
• The system shall allow the user to pause
playback when streaming a stored video.
• The system shall prevent the user from
pausing playback when streaming a live
video.
• The system shall prevent the user from
moving back in the timeline of a live
video.
• The system shall support the streaming
of recorded videos stored in the
following formats
o TBD
45
Attribute Derived Requirements for INSEP
c) Discussion Forums • The system shall allow instructor and
i) Organized Structure administrators to create discussion
ii) Flexible discussion options; boards.
discussions do not need to be • The system shall allow discussion boards
tied to a course or activity to have an internal structure (i.e., sub-
(course vs community-based boards).
for example) • The system shall allow discussion boards
iii) Ability to Search for Topics to be linked to instructional
iv) Ability to respond to prompt courses/activities.
v) Ability to respond to other • The system shall allow
user’s comments instructors/administrators to post
prompts.
• The system shall allow students to
respond to posted prompts.
• The system shall allow students to
respond to other students.
• The system shall provide an optional
moderator function.
• The system shall allow moderators to
hide posts.
• The system shall allow moderators to
prevent specific users from creating
posts.
• The system shall allow moderators to
vi) Presence of Moderator review posts before they appear to all
function users.
• The system shall notify students when
instructors have posted prompts.
• The system shall notify users when other
users have responded to them.
• The system shall notify users when other
users have mentioned them by name.
• The system shall allow for keyword
searches of prompts and responses and
discussion board titles.
• The system shall implement automated
ways/measures to prevent cross site
scripting and cross site request forgery in
discussion board posts (cybersecurity)
46
Attribute Derived Requirements for INSEP
d) Social / Experiential Learning - • The system shall provide community
Communities spaces within which students can
i) Closed Communities based on collaborate on “group projects.”
role, geography, or discipline • The system shall allow students to
(1) Ability for end users to upload the following types of content to
contribute assets such as the group space.
videos, commentary o TBD
recorded in the platform, • The system shall provide for an optional
documents, links to outside moderator function for approving
resources or webpages uploads.
(2) Ability for a moderator to • The system shall provide an interface for
approve or reject content viewing every type of upload it allows.
based on community • The system will provide access to the
standards group space based on the following
ii) Content is accessible anywhere student profile attributes.
(1) Available through the o User name
browser interface as well as o Course enrollment
on a mobile device o Country of origin
(2) Content should live and be o Region of origin
viewable within the • The system shall warn students if clicking
platform, not take the on a link will take them to an external
learner to a new page site.
outside the platform • The system shall allow for an
administrator to limit the size of a
community uploaded asset.
• The system shall provide data analytics
and reporting:
(3) Data, Reporting & Analytics o User name
o Content list of assets uploaded
o Platform (mobile/computer/tablet)
used to access community.
o Time spent in community space.
47
Attribute Derived Requirements for INSEP
e) File Exchange • The system shall support file exchange
i) Ability to control scope of among users.
share • The system shall provide a secure
ii) Ability to add security to exchange location/drop box.
exchange locations (e.g., a • The system shall allow the user to limit
secure drop box) the scope of access based on the
iii) Ability to proctor/moderate file following user attributes.
exchange o User name
iv) Integration with Google Docs o Course enrollment
or other file sharing tools o Country of origin
v) Allow for drag & drop o Region of origin
functionality • The system shall provide for an optional
vi) Allow for multiple moderator function for approving file
upload/download exchange.
vii) Variety of File types • The system shall support “drag and
(1) JPEG drop” upload and download from/to a
(2) PNG user’s local system.
(3) GIF • The system shall allow a user to
(4) MP4 upload/download multiple files within a
(5) SVG single operation.
(6) PDF • The system shall support
(7) DOC upload/download of any approved file
(8) XLS type.
(9) RTF • The system shall indicate file
(10) TXT upload/download progress.
• The system shall warn user if attempting
to upload a non-supported file type.
• The system shall automatically
virus/malware scan uploaded
files(cybersecurity)
• On Mobile platforms, the system shall
launch native file sharing apps when
(11) PPT users select links for those services.
• The system shall allow an interrupted file
upload to be resumed.
• The system shall allow file shares to have
an expiration date.
• The system shall enforce a configurable
storage capacity per user.
48
Attribute Derived Requirements for INSEP
f) Communication Support
i) Email • The system shall allow
(1) By individual instructors/administrator to send custom
(2) By group email messages to each of the following
(3) By course groups.
(4) All users o Individual users
ii) Automatic email generation o All individuals enrolled in a course.
based on a number of trigger o All members of a specific learning
conditions. For example: community.
(1) Inactivity (no log ins) • The system shall provide the ability to
(2) Missing assignments generate automatic emails to users
(3) Performance levels under the following conditions.
o The user has been enrolled in a
course.
o The user has been removed from a
course.
o The user has completed a course.
o The user has not accessed course
(4) Completion material by a specified date.
o The user has an assignment that is
past due.
• The system shall allow for
instructors/administrator to save email
templates.
49
Attribute Derived Requirements for INSEP
iii) Live Chat • The system shall support user-to-user
(1) Instant messaging text chat.
• The system shall support group text chat.
• The system shall allow users to define
text chat groups.
• The system shall include an optional
moderator function for the chat system.
• The system shall allow moderators to
prevent specific users from posting to
specific chat groups.
• The system shall allow moderators to
prevent specific users from posting to all
chat groups.
• The system shall allow moderators to
close down specific chat groups.
• The system shall support user to user
video chat.
• The system shall support single user
video stream to many users text chat.
• The system shall prevent users from
moving the timeline during video chat.
• The system shall prevent users from
(2) Video chat
pausing playback during video chat.
• The system shall allow users to set an
available-for-chat status visible to other
users.
• The system shall allow users to set an
unavailable-for-chat status visible to
other users.
• The system shall allow users to hide their
online status from all other users.
• The system shall allow users to block
specific other users from seeing their
online status.
• The system shall allow users to block
specific other users from communicating
with them via chat.
• The system shall allow for video chat
functionality.
• The system shall accommodate for low
bandwidth connections when using chat
features
50
Attribute Derived Requirements for INSEP
iv) Online Journal • The system shall allow students to
(1) Ability to secure journal maintain journals.
(2) Ability to share the journal • The system shall allow instructors to
with an instructor (e.g., for review and comment on student
assessment) journals.
(3) Ability to share the journal • The system shall include keyword
with other users searching within journals.
• The system shall allow journals to be
shared with other users.
• The system shall allow students to
revoke access to their journals from
(4) Ability to search journal
other students
entries
• The system shall allow users to archive
journal entries after a specified time
period, preventing all users including
instructors from accessing them
51
Attribute Derived Requirements for INSEP
17) Administration Tools
a) Authentication
i) Two-factor Authentication
ii) No Authentication
iii) Single Sign On
iv) Location of Credential • The system shall require each user to
Database maintain a unique identity.
(1) External database • The system shall associate a role with
(2) Specified Server each identity.
(a) IMAP Server • The system shall allow for two-factor
(b) LDAP Server authentication to enable access.
(c) NNTP Server • The system shall allow users to reset
(d) POP3 Server forgotten passwords by sending an
(e) RADIUS Server automated secured link to the user’s
(f) Shibboleth Server email address on record.
v) Ability to reset credentials • The system shall require confirmation of
vi) Allow signups through social a user’s email address at registration by
media sending an automated secured link to
vii) Allow administrator accounts the address.
to log on remotely (i.e., • The system shall prompt the user to re-
restricted to console access confirm their email address periodically.
only)? • The system shall disable accounts that
viii) Remove all disabled accounts have been inactive for a specified period.
within a specified timeframe? • The system shallow allows for
ix) Allow for central management administrator remote access.
of authentication to the
firewalls, IPS sensors, routers
and switches for individually
identifiable accounts?
b) Course Authorization • The system shall allow administrators to
i) Single enrollment add individual users.
ii) Batch enrollment • The system shall allow administrators to
iii) Self-enrollment add a group of users. using an Excel file
c) Registration Integration or another similar delimited source.
i) Support self-registration • The system shall allow administrators to
ii) Support manual registration enroll individual users in a course.
iii) Support match registration • The system shall allow administrators to
(1) from Excel enroll a group of users to a course using
an Excel file or another similar delimited
(2) from Database
source.
52
Attribute Derived Requirements for INSEP
d) Student Profiles • The system shall maintain a user profile
i) Extensibility (i.e., the ability to for each user.
add custom fields to the • The system shall enable administrators
student profile) to add fields to the standard user profile.
e) Report Generation • The system shall include a collection of
i) Pre-built and custom reporting standard reports pertaining to the
ii) Ability to export reports in following data types.
csv/excel • TBD
• The system shall allow administrators to
define custom reports summarizing
stored data.
• The system shall export report data to
Microsoft Excel.
iii) Ability to schedule reports
• The system shall export report data to
comma-separated text files.
• The system shall allow administrators to
set schedule for automatic report
generation and distribution.
18) Curriculum Design
• The system shall provide one or more
course templates to provide common
structures among similar courses.
• The system shall allow for course
a) Course Templates templates to be customized.
• The system shallow for new course
templates to be created.
• The system shall allow for keyword tags
to be embedded within a template.
b) Course categories and
subcategories (ability to categorize N/A
courses based on their content)
c) Ability to allow students to pick
N/A
courses from a course catalog
53
Attribute Derived Requirements for INSEP
• The system shall support the
development of course-rating surveys
(i.e., Kirkpatrick Level 1 surveys).
• The system shall support discrete and
d) Ability to allow students to rate short answer questions within course-
courses (stars) rating surveys.
• The system shall generate/export
reports-based course rating data.
• The system shall allow students to
modify and delete survey responses.
e) Curriculum Management • The system shall allow curriculum
i) LMS has ability to create developers to decompose a course into
modules or units constituent modules/units.
• The system shall allow curriculum
developers to establish the sequence in
ii) LMS provides the ability to which students should access/complete
sequence students through modules/units.
content • The system shall allow curriculum
managers to define prerequisites for a
given module/unit.
f) Customization of Look-and-Feel • The system shall allow the administrator
i) Allows for Customization and to set the color scheme to be used within
Personalization the system.
ii) Allows for Branding • The system shall allow the administrator
to define screen layout for learning
activities within the system.
• The system shall allow an organizational
iii) Use a template to lock specific
logo to be displayed in the interface.
settings or content items
• The system shallow allows for default
color scheme to be overridden by user to
support 508 compliance.
g) Instructional Design/Content
Development Tools
i) Support for Synchronous
instructor led training via Addressed elsewhere
streaming video
ii) Support for streaming recorded
Addressed elsewhere
video
54
Attribute Derived Requirements for INSEP
• The system shall support the authoring
of asynchronous self-paced interactive
multimedia instruction.
• The system shall support the delivery of
asynchronous self-paced interactive
multimedia instruction.
• The system shall allow content
developers to include the following
content presentation media:
o Text
o Still Graphics (TBD – Add file types)
iii) Support for interactive o Animated Graphics (TBD – Add File
multimedia instruction Types)
o Video (TBD – Add File Types)
• The system shall allow content
developers to include the following
question types for learning checks:
o Two-state
o Multiple Choice
o Hot Spot
o Matching
• The system shall provide IMI templates
to promote commonality among similar
IMI units.
iv) Support for blended instruction TBD
v) Support for gamification TBD
vi) Support for virtual classrooms TBD
• The system shall allow students to access
content via iOS devices.
• The system shall be compatible with at
least the two most recent major version
releases of iOS.
vii) Support for mobile learning
• The system shall allow students to access
content via Android devices.
• The system shall be compatible with at
least the two most recent major releases
of Android.
h) Automated Testing and Scoring Addressed elsewhere
i) Simple assessment tool to add
Addressed elsewhere
different types of questions
(1) Multiple choice Addressed elsewhere
(2) Short answer N/A
55
Attribute Derived Requirements for INSEP
(3) Essay questions N/A
(4) Equation N/A
(5) Word cloud N/A
(6) Matching Addressed elsewhere
ii) Provides tools for creating
assessments with
N/A
(1) Multimedia
(2) Learning games
(3) Interactive tools (e.g., polls and
surveys)
• During synchronous activities, the system
shall allow instructors to pose poll
questions to attendees.
• During synchronous activities the system
shall give students the ability to respond
to poll questions.
• During synchronous instruction, the
system shall provide the instructor with a
iii) Provides tools to share the control for displaying the results of the
results of polls and surveys poll.
with the class • Within discussion boards, the system
shall allow instructors to pose poll
questions.
• Within discussion boards, the system
shall give students the ability to respond
to poll questions.
• Within discussion boards, the system
shall provide the instructor with a control
for displaying the results of the poll.
iv) Adaptive testing (e.g.,
Multipart questions and N/A
branching)
• The system shall allow an option for
immediate remediation.
v) Tests can provide immediate • The system shall allow tests to be
feedback with tips for configured with automatic correct
remediation and/or incorrect remediation to be
displayed when a user enters an answer
for test questions.
vi) Calculation capabilities beyond
+-*/ (e.g., engineering N/A
equations)
56
Attribute Derived Requirements for INSEP
vii) Robust rubric integration N/A
viii) Ease of use and user
friendliness of the system to • The system shall provide instructors with
provide contextual comments the ability to annotate students’ written
on written papers (e.g., pdf input.
annotator)
• The system shall provide students with
i) Support for peer-to-peer feedback the ability to annotate other students’
projects.
j) Support for self-assessment N/A
k) Content Sharing and Reuse • The system shall provide a content
i) LMS provides a repository for repository for content developers.
content and basic tools for • Content developers shall be allowed to
content organization create organizational structures (e.g.,
ii) Supports Multi-file folders) within the content repository.
upload/download • The system shall limit access to the
iii) Supports drag & drop content repository to individual with
upload/download appropriate role designations.
• The system shall support “drag and
drop” upload and download from/to a
user’s local system.
• The system shall allow a user to
iv) LMS capable of using content upload/download multiple files within a
from public, private and shared single operation.
workspaces including • The system shall support
subscription-based content upload/download of any supported file
(e.g., podcasts and feeds) to type.
archival content • The system shall provide version history
of file uploads for content developers.
• The system shall allow import of content
published through xml feed
specifications such as rss.
19) Course Delivery Tools
a) Course Management
• The system shall alert the relevant
i) Communication capabilities
instructor when a student has completed
when assignments are posted
an assignment.
and when discussion questions
• The system shall alert the relevant
responses have been
instructor when a student has completed
completed
assigned discussion questions.
57
Attribute Derived Requirements for INSEP
• The system shall provide a dashboard
that will allow instructors to monitor
each student’s level of participation.
• The system shall monitor and display a
ii) Tracking tools available for all
record of the time that a student has
user activity, including
accessed a course.
instructional users (audit log,
• The system shall provide and display a
student participation log, time
record of the time that a student has
on task etc.)
been active within a course.
• The system shall provide and display the
status of each course assignment for
each student.
iii) Hierarchical and flexible system
for anonymous evaluations at
course, department and
Addressed under course rating
institutional level for either
summative or formative
purposes
• The system shall allow the instructor to
program the automated release of
content, assessment activities, and
assignments.
• The system shall allow the instructor to
iv) Ability to release content as a
base release triggers on date/time
function of a variety of trigger
information, content completion status,
conditions including dates,
assignment completion status, and
specific content consumption,
performance levels.
grades received/assignment
• The system shall provide a manual
completion
control for an instructor to release
content to everyone in a course.
• The system shall provide a manual
control for an instructor to release
content to specific students.
b) Instructor Support
58
Attribute Derived Requirements for INSEP
• The system shall provide a staffed Help
Desk for instructor and administrator
support.
• The system’s Help Desk shall be available
on a 24/7/365 basis.
i) Helpdesk
• The system shall provide a knowledge
database of frequently asked helpdesk
questions.
• The system’s Help Desk shall notify users
when updates are available to issues.
• The system shall provide printer-friendly
User Guides that provide detailed step-
ii) Printed Materials
by-step directions for completing
common functions.
• The system shall provide structured
iii) Webinars, online and training activities to instruct instructors
classroom training sessions and administrators on the optimal use of
the system.
c) Online Grading Tools
• The system shall include an electronic
gradebook that allows each instructor to
record/monitor the standing of each
student in each course he/she
supervises.
• The system shall ensure that an
instructor will only be able to access
grade records for courses to which
he/she is assigned.
i) Grade book
• The system shall allow for an
administrator or supervisor to access all
electronic gradebooks.
• The system should allow for
administrator to change instructors for
re-assigned classes.
• The system shall provide alerts to the
instructor for students whose grades fall
below a certain threshold.
• The system shall be able to export
ii) Grades can be exported to a
gradebook records to Microsoft Excel.
spreadsheet or student
• The system shall be able to export
information system
gradebook records to a delimited file.
59
Attribute Derived Requirements for INSEP
iii) LMS provides a record of
learning that could be used
N/A
across multiple
disciplines/functions
• The system shall allow students who
have worked together on a group
assignment to provide feedback to their
teammates.
iv) Support for peer and 360
• The system shall allow students to
evaluation
provide feedback on courses they have
enrolled in and completed.
• The system shall make student feedback
anonymous.
d) Student Tracking
• The system shall allow the instructor to
program the automated messages to
i) Students are automatically students.
emailed when their • The system shall allow the instructor to
participation is substandard (or base triggers on date/time information,
other triggers met) content completion status, assignment
completion status, performance levels,
or access records.
e) Archives
i) Provide instructor access to • The system shall allow instructor to
completed and archived review previously delivered synchronous
courses training sessions.
• The system shall maintain a complete
record of a student’s learning
ii) Allows retrieval of student experience.
learning history • The system shall maintain those records
after a student’s account has been
removed.
• The system shall allow students to
iii) Ability of students to re-take
reselect and complete instructional units
completed units
that that have previously completed.
20) Student Involvement
a) Group Work
• The system shall allow instructors to
i) The definition of groups
define groups of students.
60
Attribute Derived Requirements for INSEP
• The system shall allow instructors to
define collaboration areas to support
ii) The definition of collaboration group work.
areas • The system shall allow instructors to
assign groups and/or individual users to
defined collaboration areas.
b) Student Community Building N/A
c) Self-assessment N/A
d) Student Portfolios
i) Tools to allow students and • The system shall allow all user types to
instructors to create ad-hoc develop presentations.
presentations • The system shall allow users to select
ii) Tools to allow students and predefined presentation templates.
instructors to create structured • The system shall enforce template
presentations constraints.
• The system shall allow all users to deliver
synchronous presentations to an
assembled group of users.
• The system shall prevent users from
pausing playback of live synchronous
presentations.
• The system shall prevent users from
moving backwards in the timeline of live
synchronous presentations.
• The system shall allow all users to record
iii) Tools to allow students and synchronous presentations for later
instructors to gather and asynchronous playback.
present student work products • The system shall allow users move back
in the timeline of recorded
presentations.
• The system all allow users to pause the
playback of recorded presentations.
• The system shall allow users to move
forward in the timeline of recorded
presentation.
• The system shall prevent users from
moving past unviewed portions of
recorded presentations.
e) Ability to share ePortfolio outside
N/A
of the LMS
21) Productivity Tools
61
Attribute Derived Requirements for INSEP
• The system shall allow students to set
bookmarks.
• The system shall allow students to
navigate to bookmarks.
a) Bookmarks
• The system shall automatically bookmark
the student’s last location.
• The system shall provide students with
an option to jump to their last location.
• The system shall allow users to search for
free text terms within a given
instructional unit.
b) Searching Within a Course • The system shall allow users to search for
free text terms across instructional units.
• The system shall employ Boolean
operators within its search functions.
• The system will provide the user with a
calendar of important events.
• The system shall tailor the calendar
events to user types.
• The system calendar for students shall
c) Calendar/Progress Review include assignment due dates.
• The system calendar for instructors shall
include assignment due dates, course
convenings, and synchronous lectures.
• The system calendar for administrators
shall include report due dates.
d) Ability to Work Offline and then
N/A
Synchronize
e) Orientation/Help
i) Online user manual Addressed elsewhere
• The system shall provide online context-
ii) Context Sensitive help
sensitive help for system functions.
• The system shall provide pop-up tool tips
iii) Pop-up and rollovers for just-
to guide user interaction with interface
in-time prompts
elements.
iv) 24/7 Helpdesk Addressed elsewhere
22) Pricing/Licensing
TBD – Does INSEP require a specific license
a) License Structure
structure?
i) Open Source
(1) Significant Usage
requirements
62
Attribute Derived Requirements for INSEP
(2) Significant modification
restrictions
ii) Proprietary
(1) One-time Charge
(2) Yearly Flat Fee
(3) Active users per month Fee
(4) Registered users per month
(5) Free
(6) Free + Premium Upgrades
b) Payment Methods
i) Credit card
ii) Wire transfer • The vendor can accept payment using
iii) Check U.S. Government processes.
iv) PayPal
c) Free Trial Available
TBD – Does INSEP desire a specific hosting
23) System
structure?
a) Hosting Location
i) Locally Hosted
ii) Software As a Service
iii) Hybrid (e.g., locally hosting via
AWS)
b) Server OS
i) Windows
ii) Linux
iii) Other
c) Client Hosting
i) Instructor
(1) Client Desktop Software
• Instructors shall be able to access the
system via desktop/laptop systems using
operating systems based on Windows,
macOS, or Linux.
(a) Windows • The system should be accessible with
baseline operating systems:
o Windows 8.X and later
o MacOS (TBD)
o Linux (TBD)
(b) macOS
(c) Linux
(2) Browser-based
63
Attribute Derived Requirements for INSEP
• Instructors shall be able to access the
(a) Edge system using Microsoft Edge, Google
Chrome, Mozilla Firefox, or Apple Safari.
(b) Internet Explorer
(c) Chrome
(d) Firefox
(e) Safari
(3) Mobile Application N/A
(a) Android
(b) iOS
(c) Other
(4) Mobile Form Factor N/A
(a) Phone
(b) Tablet
ii) Students
• Students shall be able to access the
system via desktop/laptop systems using
operating systems based on Windows,
macOS, or Linux.
(1) Client Desktop Software • The system should be accessible with
baseline operating systems:
o Windows 8.X and later
o MacOS (TBD)
o Linux (TBD)
(a) Windows
(b) macOS
(c) Linux
• Instructors shall be able to access the
(2) Browser-based system using Microsoft Edge, Google
Chrome, Mozilla Firefox, or Apple Safari.
(a) Edge
(b) Internet Explorer
(c) Chrome
(d) Firefox
(e) Safari
• Students shall be able to access
instructional content on mobile devices
(3) Mobile Application
running either the iOS or Android
operating system.
(a) Android
(b) iOS
(c) Other
64
Attribute Derived Requirements for INSEP
• Students shall be able to access
(4) Mobile Form Factor instructional content on both
smartphones and tablet mobile devices.
(a) Phone
(b) Tablet
iii) Administrators
(1) Client Desktop Software
• Administrators shall be able to access the
system via desktop/laptop systems using
(a) Windows
operating systems based on Windows,
macOS, or Linux.
(b) macOS
(c) Linux
(2) Browser-based
• Administrators shall be able to access the
(a) Edge system using Microsoft Edge, Google
Chrome, Mozilla Firefox, or Apple Safari.
(b) Internet Explorer
(c) Chrome
(d) Firefox
(e) Safari
(3) Mobile Application N/A
(a) Android
(b) iOS
(c) Other
(4) Mobile Form Factor N/A
(a) Phone
(b) Tablet
d) Software Support
i) Type of Support Provided
(1) Manual Addressed Elsewhere
(2) 24/7 Help Desk Addressed Elsewhere
• The customer service support staff shall
(3) Remote Support/Remote be able to use remote desktop
Desktop Functionality functionality to assist users with
troubleshooting activities.
(4) Dedicated Customer
N/A
Success Manager
(5) Onboarding Training Addressed Elsewhere
65
Attribute Derived Requirements for INSEP
• The customer service support staff shall
(6) Support for Multiple be able to support users speaking the
Languages following languages:
o TBD
• The customer service support staff shall
(7) Chat Support be able to support users via phone,
email, or real-time text chat.
ii) Cost of Support TBD – Does INSEP have a requirement?
(1) Free/Included in
Subscription
(2) Additional Fee
iii) Updates TBD – Does INSEP have a requirement?
(1) How often is the Software
Updated?
(2) Is there a fee for updates?
iv) Uptime Guarantee
e) Can localize interface to multiple
languages
i) Arabic
ii) Spanish (Latin America and
Castilian)
iii) Brazilian Portuguese
iv) French (Canada and France)
v) Japanese
vi) Korean
vii) Swedish • It shall be possible to localize the system
viii) German interface to use control/display labels
ix) Danish that employ the following languages:
x) Dutch o TBD
xi) Turkish
xii) Chinese (Simplified and
Traditional)
xiii) Welsh
xiv) English (US, UK and Canada)
xv) Ability to customize for a
particular language
24) Integration
a) Content Standards
i) Interoperability Standards
66
Attribute Derived Requirements for INSEP
• The system shall be compatible with
SCORM 2004 and TinCan/xAPI.
• The system shall provide a Learning
(1) AICC
Record Store (LRS) for TinCan/xAPI data.
• The system shall make its LRS available
to external applications.
(2) Sharable Content Object
Reference Model (SCORM)
(3) PENS
(4) Learning Tools
Interoperability (LTI)
(5) IMS Common Cartridge
(6) CMI5
(7) LETSI RTWS
(8) TinCan / xAPI
ii) Accessibility
• The system shall adhere to “Section 508”
accessibility standards.
• The system shall allow instructors and
content developers to add alternate text
to media content.
• The system shall alert instructors and
content developers to media content
that doesn’t have associated alternate
text.
• The system shall allow multiple language
versions of alternate text.
• The system shall allow users to add
(1) Section 508
subtitles to recorded video and audio
content created by that user.
• The system shall allow video and audio
subtitles to be entered in multiple
languages.
• The system shall highlight recorded
audio and video content that doesn’t
contain subtitles.
• The system shall provide a 508-
compatibility dashboard to
administrators and content developers
to allow 508 compliance to be audited.
67
Attribute Derived Requirements for INSEP
TBD – Which, if any, of these tools are
important to Insep
DropBox?
b) Embedded Support for Third Party
G Suite?
Tools
Google Calendar?
Zoom?
i) Adobe Connect
ii) ADP
iii) API
iv) BambooHR
v) BigBlueButton
vi) Dropbox
vii) Drupal
viii) G Suite
ix) Google Calendar
x) GoToMeeting
xi) GoToTraining
xii) GoToWebinar
xiii) HubSpot
xiv) Joomla
xv) Magneto
xvi) Mailchimp
xvii) Microsoft Dynamics CRM
xviii) Namely
xix) Office 365
xx) Okta
xxi) OneDrive
xxii) OneLogin
xxiii) Oracle Sales Cloud CRM
xxiv) Outlook Calendar
xxv) PayPal
xxvi) Salesforce CRM
xxvii) SAP CRM
xxviii) Service Now
xxix) SharePoint
xxx) Shopify
xxxi) Slack
xxxii) Stripe
xxxiii) Sugar CRM
xxxiv) WebEx
68
Attribute Derived Requirements for INSEP
xxxv) WooCommerce
xxxvi) WordPress
xxxvii) Zapier
xxxviii) Zendesk
xxxix) Zoom
25) Portal Organization and
TBD
customization
a) Ability to create independent sub-
portals (branches)
b) Ability to create groups of
students, in order to assign N/A
common courses (groups)
• The system shall allow INSEP to modify
c) Ability to customize and brand
fonts, colors, and badging to provide a
your portal and sub-portal(s)
consistent “brand image.”
d) Ability to add your own login
N/A
domain
e) Ability to create automated events
based on triggers (e.g., course
Addressed Elsewhere
assignments, user deactivation,
point assignment, etc.)
f) Ability to customize automated
notifications based on triggers
(e.g., on course assignment, on Addressed Elsewhere
user signup, X hours before
expiration)
g) Ability to configure user
permissions
• The system shall align with OWASP and
26) Security the Center for Internet Security (CIS)
best practices and guidelines
a) Allow IP control and filtering?
b) Support double username access
lockability?
c) Support secure password
management?
• The system shall employ data in
d) Support encryption and user
transit encryption and data at rest
password per authentication?
encryption
e) Encrypt data during transmission?
69
Attribute Derived Requirements for INSEP
• The system shall scan all file uploads for
viruses.
• The system shall prevent the upload of
files which are detected to contain
viruses.
f) Include an advanced antivirus • The system shall automatically update
check on all uploaded content? virus definitions at a regular interval.
• The system shall provide administrators
with the virus definition update status.
• The system shall log all detected virus
activity for auditing.
70
Attribute Derived Requirements for INSEP
i) Perform an automated correlation
of security logs between the
various device types (system,
network, firewall, and/or IPS)?
j) Enable the identification of internal
personnel (specific user) in the
event of an internal attack?
• The system shall implement CIS
28) Network/Service Architecture benchmarks for locking down networks
and services
a) Deploy firewalls?
b) Deploy network Intrusion
Prevention System (IPS) sensors? If
yes, are all IPS sensors updated
within 24 hours of new signatures
released?
c) Support the firewalls, IPS sensors,
routers and switches on software
and hardware levels?
d) Patch all critical security issues on
firewalls, IPS sensors, routers and
switches within 1 month of
release?
e) Encrypt data in transit on public or
shared networks?
• The system shall implement CIS
29) Secure Server
benchmarks for locking down Servers
a) Have antivirus software installed
and running optimally in the
server?
b) Have measures in place to protect
data from exposure when the
service is executed on shared
servers?
c) Have measures in place to protect
from performance degradation
when the service is executed on
shared servers?
d) Have policies in place to ensure the
integrity of any software prior to
installation?
71
Attribute Derived Requirements for INSEP
e) Have its servers built off a general
network or on an isolated
network?
f) Have security patches installed
prior to the server being put onto
the general network?
30) Backups
• The system shall backup all data (course
and student records) to external media
on a daily basis or replicate the data at a
secondary site in near real-time.
• If backup (vs. replication) is performed,
the backup process shall be tested on a
monthly basis.
a) Are the servers backed up to
• If backup (vs. replication) is performed, a
external media (e.g. tape) on a
full backup shall be performed on a
daily basis or all data replicated in
weekly basis.
near real-time to a secondary site?
• If backup (vs. replication) is performed,
backup media shall be stored at an
offsite location.
• The system shall have disaster recovery
plan in place.
• The system shall be accessible within 72
hours of a catastrophic failure.
b) Are backups tested regularly? If
yes, please specify the frequency.
c) If data is backed up to external
media, how often are full backups
performed?
d) If data is backed up to external
media, are the backups encrypted?
e) If data is backed up to external
media, are the backups stored
offsite?
72
Appendix 17: Glossary
74
Term Definition Remarks
opportunities for interaction online with
traditional place-based classroom methods. It
requires the physical presence of both teacher
and student, with some elements of student
control over time, place, path, or pace.
Blended Learning Training approach that combines remote and Synonymous with
in-person learning hybrid learning
75
Term Definition Remarks
DAM: Digital Asset Software which organizes media such as
Management images, videos, and documents.
System
The Discussion Board tool in the LMS allows
online communication with other members of a
subject or community. Groups within a subject
or community can also have their own private
discussion board. The Discussion Board is an
asynchronous communication tool, allowing
messages to be posted and read at any time.
76
Term Definition Remarks
engage people, motivate action, promote
learning and solve problems
Interactive multimedia instruction is a term
Interactive
applied to a group of predominantly interactive,
multimedia
electronically-delivered training and training
instruction
support products.
IP filtering is a mechanism that decides which
types of network messages will be processed
IP control and normally and which will be discarded. For
filtering example, you may want to discard message
coming from or going to certain internet
addresses.
Just-in-time Training that occurs as needed without a
learning planned schedule or agenda. Typically
associated with self-directed learning like
asynchronous web-based training or localized
on-the-job training or coaching.
mLearning Electronic learning that has been formatted for Mobile Learning is a
quick and easy consumption on mobile hand- subset of e-
held devices such as cell phones and tablets. Learning, not a
77
Term Definition Remarks
synonym for e-
Learning.
A mobile application is a unit of software
Mobile Application designed to run on a mobile device like a
smartphone or tablet computer.
The form factor of a mobile device refers to its
size, shape, and style, as well as the layout and
position of its major components. Most
Mobile Form Factor
significantly, the mobile form factor is often
used to identify whether a specific application is
optimized for use on tablets or smartphones.
Mobile learning is learning activities that
employ personal electronic devices, such as
smartphones and tablets. A form of distance
Mobile learning
education, m-learners use mobile device
educational technology at times that are
convenient for them.
In a discussion forum, you can assign a user the
role of moderator. A moderator reviews posts
before they appear in the discussion.
78
Term Definition Remarks
access points and configuring firewalls to
prevent future attacks. IPS solutions can also be
used to identify issues with security policies,
deterring users from violating the rules these
policies contain.
Journals are personal spaces for students to
communicate privately with an instructor.
Students can also use journals as a self-
reflective tool. They can post their opinions,
ideas, and concerns about the course, or
discuss and analyze course-related materials.
79
Term Definition Remarks
Raw requirement An environment or requirement that has not
been analyzed and formulated as a well-formed
requirement
Remote Learning Training that occurs online when instructor and Synonymous with
participant are geographically separated and online training,
cannot meet in a traditional classroom setting. distance learning,
Can occur synchronously or asynchronously virtual learning and
virtual training
Remote Remote support software is the technology that
Support/Remote gives IT technicians the ability to access their
Desktop clients’ devices remotely to provide
Functionality maintenance and support.
Requirement A condition or capability needed by a user to
solve a problem, or achieve an objective. OR A
condition or capability that must be met or
possessed by a system or system component to
satisfy a contract, standard, specification or
other formally imposed document
A rubric is a scoring guide used to evaluate the
Rubric quality of students' responses. Put simply, it is a
set of criteria for grading assignments.
SCORM (Sharable A collection of standards and specifications for
Content Object web-based electronic educational
Reference Model) technology (also called e-learning). It defines
communications between client side content
and a host system (called "the run-time
environment"), which is commonly supported
by a learning management system.
80
Term Definition Remarks
academic achievement; (2) determining
whether students have met learning standards
or other academic requirements for courses,
grade-level promotion, and graduation; (3)
helping students reflect on their academic goals
and progress as learners; and (4) creating a
lasting archive of academic work products,
accomplishments, and other documentation
Synchronous Real time learning that is facilitated live over a
meeting platform (such as MS Teams)
System An interdependent group of people, objects,
and procedures constituted to achieve defined
objectives or some operational roles by
performing specified functions.
Two-factor Authentication is an extra layer of
security used to make sure that people trying to
gain access to an online account are who they
say they are. First, a user will enter their
username and a password. Then, instead of
immediately gaining access, they will be
required to provide another piece of
information. This second factor could come
from one of the following categories:
Two-factor
• Something you have: Typically, a user
Authentication
would have something in their
possession, like a credit card, a
smartphone, or a small hardware token
• Something you know: This could be a
personal identification number (PIN), a
password, answers to “secret questions”
or a specific keystroke pattern
Something you are: This category is a little more
advanced, and might include biometric pattern
of a fingerprint, an iris scan, or a voice print
Uptime is a measure of system reliability,
expressed as the percentage of time a machine,
Uptime Guarantee
typically a computer, has been working and
available. Uptime is the opposite of downtime.
A virtual classroom is a learning environment in
Virtual classrooms which students engage with the lesson material
online. Virtual classrooms allow for live
81
Term Definition Remarks
interaction between the instructor and one or
more learners as they are participating in
learning activities. In other words, the virtual
classroom is a shared online space in which the
learners and the tutor work together
simultaneously. Usually, these interactions take
place through videoconferencing.
Web-Based Training Online learning variant of instructor-led courses
delivered via the web. Can be delivered as
synchronous (instructor led) training or in
asynchronous (self-paced) learning format.
82