As of August 1st, 2008, the Edutech web site will no longer be updated. Edutech was funded by the Swiss Virtual Campus programme, which ended on July 31st, 2008. Some activities will be taken over by the e-Learning Services group at the SWITCH foundation.

LMS Evaluation Report

hide details | show criteria descriptions

Products

Blackboard ML

Blackboard Inc.: http://www.blackboard.com/

Last major evaluation update: Jan '03

strong points

  • Clean, easy-to-use interface
  • Powerful "virtual classroom" tool
  • Good possibilities for interoperating with other systems (e.g. students and administrative information systems)
  • Building blocks programme for extending the system
  • Good documentation

weaknesses

  • Limited customizability of look and feel
  • No internal resource or file manager
  • Frame based display: no bookmarking of individual course pages.

Student's Environment

Student's Environment

Ease of Use

Blackboard's usability is good, with a clean and simple interface:

  • all functions are grouped under various sections that have the same names in all courses, e.g. "Course documents", "Communication", "Tools".
  • font scaling works well (except with older versions of Netscape)
  • course menu is always visible; course map can be displayed in a separate popup window, to provide quick access to all course components.
  • "Back" button does work.

However, there are some limitations (partly due to the frame-based display): individual pages in a course cannot be bookmarked, and correct printing depends on the browser's handling of frames.

browser bookmarks
not supported: page location is always the course homepage
URL access possible
not supported: page location is always the course homepage
in-system bookmarks
no
print current page
typical frame problem: student needs to know how to print a specific frame
save page on local disk
same frame problem as for printing
find word in current page
yes (only works in IE and Netscape 4 if the right frame has the focus)
no frames
no: pages consist of several frames
font scalable
yes (with IE 5, Mozilla 1.1 on Windows; also works with Netscape 4.7 if focus is on content frame), image-based toolbar is not scaled).
Compliant with common web technology
Good compliance
Mozilla 1.7
-
Netscape 6 ok
yes
IE 6 ok
yes
other browsers ok
Netscape 4.7
web-tablets, set top boxes ok
-
Functional environment
Standard range of functionalities, with some nice additions: thesaurus/dictionary, calendar, personal address book, tasks, personal file storage and exchange, course map in separate window.

Some limitations:

  • The student can only create one note for a whole course. The note cannot be saved (must use copy-paste).
  • Separate functions must be used to search content and forums. Other course components (e.g. assignments) cannot be searched.
  • No context-sensitive help.
keyword search
powerful search tool for course content (search in title/body, use regular expressions); discussion boards can be also searched, but with a separate function, and only one forum at a time
configurable environment
-
effective navigation aids
course map can be displayed in popup window
context sensitive help
no (student manual is available within a course, but only in pdf format)
Collection of Tools
personal address book, tasks, thesaurus/dictionary, digital drop box (personal file storage and exchange)

Tutoring and Didactics

Ease of use
Usability for tutors is good, all tutoring functions can be accessed from the "Control panel".
Communication
Blackboard offers a good range of communication tools including searchable forums (forums can be defined for workgroups), and a powerful virtual classroom tool (no audio-video, but includes whiteboard, group browsing, questions, breakout rooms, chat, recording/archives and course map). The virtual classroom is a Java based applet, which requires no installation on client machine (tested in IE and Netscape).

Blackboard provides no internal email inside courses, but at the portal/community level, it can be interfaced to an institution's email system.

forum threaded
yes
forum searchable
yes
private workgroup forums
yes
internal mailing system
no (regular emails can be sent from within Blackboard to other registered users).
mailing system interoperable with emails
at portal (not course) level
chat
yes
whiteboard with integr. chat
yes
Instant Messaging
-
Students management
Various possibilities are offered for course enrollment: self-registration by students, upload of lists by tutor, and integration with various directories (via snapshots or using an event-driven model).
class enrollment by tutor
yes
class enrollment by student
yes (can be enabled/disabled by instructor)
tutors can build groups
yes
students can build groups
no
Activity tracking
Tracking facilities are available, but not everything can be tracked, and sometimes without much detail (e.g. only entry page of content in a zip archive).

Also, tracking statistics for individual content elements are not available from the main statistics page. Instructor has to go to the content pages to view them.

individual page/tool access
yes
class page/tool access
yes
individual activity in forum
no
class activity in forum
globally: number of times each message has been read
individual performance in tests
yes
class performance in tests
yes
class assignment performance
-

Course Developement

Ease of Use

Blackboard provides a web interface for organizing the course structure, and uploading content. Various possibilities are provided for adding course material:

  1. Single documents can be added to the course structure, and displayed either inline within a page or as a link. Folders can also be created and may contain other elements (incl. folders). This allows for hierarchical structuring of content.
  2. Zip archives containing different files can be uploaded and uncompressed. Directory structure is maintained, and relative links within documents in the archive work. Actually, if a course document needs to use external files (such as a style sheet or a data file in a Flash animation), zip archives are the only solution.
  3. "Learning units" can also be created, to enforce sequential viewing of content.
  4. SCORM packages can be imported. Results from the package can be stored in the gradebook (SCORM packages are handled with a Building block called the "SCORM Viewer").
  5. Other types of contents may be added, depending on the installed building blocks.

All course elements can have additional text that will appear before the element in the course structure.

Various metadata (ownership, resource format, copyright information, etc.) can be added to course elements.

Downsides of content creation in Blackboard:

  • Creating even a moderately complex hiearchical structure with option 1 above is a tedious task, and authors will probably resort to option 2, i.e. use a zip archive. However, this solution requires that authors provide their own navigation within documents.
  • Blackboard provides no concept of a "file manager": once uploaded, documents cannot be accessed directly, or reused in another place in the course. And changing a document requires re-uploading it. Thus, updating individual files uploaded with options 1 or 2 is cumbersome: e.g. if a single file in a zip archive has to be updated, the whole archive must be uploaded again.
  • Finally, there is no integrated text editor or web-based form that could be used to make small changes to HTML documents.

No html editor as such available?

Upload

online editor for course organization
yes
online editor for content structure
yes
Web interface to up/download resources
yes
up/download of resource packages
yes
Drag & Drop loading
-
offline editor for course structure
no
offline editor for content structure
no
Linking
only within documents in the same uploaded zip archive
Flexible Development Framework
Blackboard Building Blocks is a very interesting program that permits developers to extend the features and functionalities of the platform. It consists primarily of a set of Java APIs that can be used to access various components of the platform, such as the gradebook, course data, etc. Examples of extensions would be a bridge to an external system, a new content type, and journal and FAQ tools.

Once an extension has been developed, it can be redistributed (freely or commercially) via the online Blackboard Building Blocks catalog. Some of the extensions available in the catalog include a SCORM player, a "who's online" module, and bridges to quiz systems from Respondus and Perception.

Building Blocks are very powerful, but require a good deal of very technical programming. Thus, a skilled programmer is needed, and there is some overhead, even to create a simple extension.

extensible architecture
yes (with building blocks)
support for client side scripting
yes
SCORM Runtime API
no (but results from SCORM content can be stored in the gradebook)
support for server side scripting
no
server side scripting API
yes (building blocks)
custom navigation scheme
no
Developers support

There is a "Behind Blackboard" web site at Blackboard, which provides free access to various kinds of materials: documentation, knowledge base, forums, etc.

The Blackboard Developers Network provides developers of Blackboard extensions with a selection of information and services (subscription of 1200$ per year required). Blackboard also recommends that developer licenses be purchased to develop and test Building blocks applications on a "non-production" Blackboard server ($2500 per year).

basic manual/tutorial for authors
yes
advanced manual for programmers
yes
complete documentation of APIs
yes
responsive support
yes
online user forums
yes (not managed by Blackboard)
Compatibility with common web authoring tools

Content must be uploaded as a zip archive if it consists of html pages with images, Flash animations, external style sheets, etc.

The upcoming release 6 of Blackboard will support WebDAV.

compatible with standard web content
yes
up/download via ftp
no
up/download via WebDAV
no (should be available in release 6)
Assessment
Blackboard provides the two standard types of assessments: quizzes/exams (graded) and surveys (anonymous, not graded). The available question types are also fairly standard: multiple choice/multiple answer, true/false, fill in the blank, matching, ordering and short answer essay. Images and files can be attached to questions.

Questions can be stored in "pools", which are course specific, but pools can be exported as a file and imported within another course.

An extension allowing integration with the professional quiz system QuestionMark from Perception can be bought, as well a one from Respondus for offline editing of quizzes.

Assessments can also placed at any location within the course content, which is a nice feature. But the process to accomplish this is a bit cumbersome: it isn't done with the course structure editor, as one would expect it. Instead, it must be done when setting the quiz availability in the assessment manager.

Online Quizz Editor
yes
Offline Quizz Editor
no (but commercial third-party tool from Respondus can be used for this)
Broad Range of Quizz Types
yes
Quizz Engine Extensible
yes (using building blocks)
Quizz Validity Feedback
-
Support for e-learning standards
Blackboard closely watches the evolution of the e-learning specifications. A free SCORM compliant player is available as a Building Block.

With regard to IMS standards, Blackboard is compliant in the following :

  • Content Packaging 1.12
  • Enterprise 1.01
  • QTI 1.2 (release 6, import and export functionality is not exposed)
  • Metadata 1.2.1 (release 6)
SCORM package import
yes
IMS/SCORM-CP
yes (1.12)
SCORM-API
-
LOM Metadata
IMS metadata 1.2.1 compliant (release 6)
IMS-QTI
yes (with release 6)
Adaptable look-and-feel

Virtual installations allow several institutions to share a single Blackboard server, creating several distinct and customizable Blackboard environments (this feature is currently only available in Blackboard 6, and is simulated in Blackboard ML via the separate language library profiles).

At the course level, only the button shape and colors and a banner for the home page can be changed.

Style sheets can be used in content files uploaded as a zip archive.

course level look-and-feel
no
multiple corporate identities
virtual installations (available in v6.0, simulated in ML via separate language library profiles)
Multilinguality
Blackboard ML ("ML" is for Multi-lingual) provides an interface in several languages, including French, German, Italian and English.
french environment
yes
german environment
yes
italian environment
yes
XML support
-
support for XHTML content
-
includes XSLT engine
no
includes XSL-FO engine
no
Migration of current WebCT courses
Blackboard provides a migration path for WebCT courses.

System & Administration

System management
-
Performance
-
Availability
-
Maintenance
-
Security
-
Administration
Several authentication schemes are supported out-of-the box, APIs can be used to implement others. Integration of user, course and enrollment information can be done via snapshots or using an event-driven model.
One server - multiple institutions
yes (virtual installations)
Flexible Authentication Scheme
yes (pre-configured Building Blocks extensions are provided for LDAP, Microsoft Passport and Active Directory, and Kerberos; others can be implented through the APIs).
Documentation
yes
Flexible Licensing Model
Various licensing models are possible.
Technical Architecture
  • Three tier architecture: database, web server + Blackboard application
  • Application consists of Perl scrips and Java servlets
  • Load balancing is supported