As of August 1st, 2008, the Edutech web site will no longer be updated. Edutech was funded by the Swiss Virtual Campus programme, which ended on July 31st, 2008. Some activities will be taken over by the e-Learning Services group at the SWITCH foundation.
LMS Evaluation Report
hide details | show criteria descriptions
| Products | Blackboard MLBlackboard Inc.: http://www.blackboard.com/Last major evaluation update: Jan '03 strong points
weaknesses
| |
Student's Environment | ||
Student's Environment | ||
Ease of Use | Blackboard's usability is good, with a clean and simple interface:
However, there are some limitations (partly due to the frame-based display): individual pages in a course cannot be bookmarked, and correct printing depends on the browser's handling of frames. | |
browser bookmarks | not supported: page location is always the course homepage | |
URL access possible | not supported: page location is always the course homepage | |
in-system bookmarks | no | |
print current page | typical frame problem: student needs to know how to print a specific frame | |
save page on local disk | same frame problem as for printing | |
find word in current page | yes (only works in IE and Netscape 4 if the right frame has the focus) | |
no frames | no: pages consist of several frames | |
font scalable | yes (with IE 5, Mozilla 1.1 on Windows; also works with Netscape 4.7 if focus is on content frame), image-based toolbar is not scaled). | |
Compliant with common web technology | Good compliance | |
Mozilla 1.7 | - | |
Netscape 6 ok | yes | |
IE 6 ok | yes | |
other browsers ok | Netscape 4.7 | |
web-tablets, set top boxes ok | - | |
Functional environment | Standard range of functionalities, with some nice additions: thesaurus/dictionary, calendar, personal address book, tasks, personal file storage and exchange, course map in separate window.
Some limitations:
| |
keyword search | powerful search tool for course content (search in title/body, use regular expressions); discussion boards can be also searched, but with a separate function, and only one forum at a time | |
configurable environment | - | |
effective navigation aids | course map can be displayed in popup window | |
context sensitive help | no (student manual is available within a course, but only in pdf format) | |
Collection of Tools | personal address book, tasks, thesaurus/dictionary, digital drop box (personal file storage and exchange) | |
Tutoring and Didactics | ||
Ease of use | Usability for tutors is good, all tutoring functions can be accessed from the "Control panel". | |
Communication | Blackboard offers a good range of communication tools including searchable forums (forums can be defined for workgroups), and a powerful virtual classroom tool (no audio-video, but includes whiteboard, group browsing, questions, breakout rooms, chat, recording/archives and course map). The virtual classroom is a Java based applet, which requires no installation on client machine (tested in IE and Netscape).
Blackboard provides no internal email inside courses, but at the portal/community level, it can be interfaced to an institution's email system. | |
forum threaded | yes | |
forum searchable | yes | |
private workgroup forums | yes | |
internal mailing system | no (regular emails can be sent from within Blackboard to other registered users). | |
mailing system interoperable with emails | at portal (not course) level | |
chat | yes | |
whiteboard with integr. chat | yes | |
Instant Messaging | - | |
Students management | Various possibilities are offered for course enrollment: self-registration by students, upload of lists by tutor, and integration with various directories (via snapshots or using an event-driven model). | |
class enrollment by tutor | yes | |
class enrollment by student | yes (can be enabled/disabled by instructor) | |
tutors can build groups | yes | |
students can build groups | no | |
Activity tracking | Tracking facilities are available, but not everything can be tracked, and sometimes without much detail (e.g. only entry page of content in a zip archive). Also, tracking statistics for individual content elements are not available from the main statistics page. Instructor has to go to the content pages to view them. | |
individual page/tool access | yes | |
class page/tool access | yes | |
individual activity in forum | no | |
class activity in forum | globally: number of times each message has been read | |
individual performance in tests | yes | |
class performance in tests | yes | |
class assignment performance | - | |
Course Developement | ||
Ease of Use | Blackboard provides a web interface for organizing the course structure, and uploading content. Various possibilities are provided for adding course material:
All course elements can have additional text that will appear before the element in the course structure. Various metadata (ownership, resource format, copyright information, etc.) can be added to course elements. Downsides of content creation in Blackboard:
No html editor as such available? Upload | |
online editor for course organization | yes | |
online editor for content structure | yes | |
Web interface to up/download resources | yes | |
up/download of resource packages | yes | |
Drag & Drop loading | - | |
offline editor for course structure | no | |
offline editor for content structure | no | |
Linking | only within documents in the same uploaded zip archive | |
Flexible Development Framework | Blackboard Building Blocks is a very interesting program that permits developers to extend the features and functionalities of the platform. It consists primarily of a set of Java APIs that can be used to access various components of the platform, such as the gradebook, course data, etc. Examples of extensions would be a bridge to an external system, a new content type, and journal and FAQ tools.
Once an extension has been developed, it can be redistributed (freely or commercially) via the online Blackboard Building Blocks catalog. Some of the extensions available in the catalog include a SCORM player, a "who's online" module, and bridges to quiz systems from Respondus and Perception. Building Blocks are very powerful, but require a good deal of very technical programming. Thus, a skilled programmer is needed, and there is some overhead, even to create a simple extension. | |
extensible architecture | yes (with building blocks) | |
support for client side scripting | yes | |
SCORM Runtime API | no (but results from SCORM content can be stored in the gradebook) | |
support for server side scripting | no | |
server side scripting API | yes (building blocks) | |
custom navigation scheme | no | |
Developers support | There is a "Behind Blackboard" web site at Blackboard, which provides free access to various kinds of materials: documentation, knowledge base, forums, etc. The Blackboard Developers Network provides developers of Blackboard extensions with a selection of information and services (subscription of 1200$ per year required). Blackboard also recommends that developer licenses be purchased to develop and test Building blocks applications on a "non-production" Blackboard server ($2500 per year). | |
basic manual/tutorial for authors | yes | |
advanced manual for programmers | yes | |
complete documentation of APIs | yes | |
responsive support | yes | |
online user forums | yes (not managed by Blackboard) | |
Compatibility with common web authoring tools | Content must be uploaded as a zip archive if it consists of html pages with images, Flash animations, external style sheets, etc. The upcoming release 6 of Blackboard will support WebDAV. | |
compatible with standard web content | yes | |
up/download via ftp | no | |
up/download via WebDAV | no (should be available in release 6) | |
Assessment | Blackboard provides the two standard types of assessments: quizzes/exams (graded) and surveys (anonymous, not graded). The available question types are also fairly standard: multiple choice/multiple answer, true/false, fill in the blank, matching, ordering and short answer essay. Images and files can be attached to questions.
Questions can be stored in "pools", which are course specific, but pools can be exported as a file and imported within another course. An extension allowing integration with the professional quiz system QuestionMark from Perception can be bought, as well a one from Respondus for offline editing of quizzes. Assessments can also placed at any location within the course content, which is a nice feature. But the process to accomplish this is a bit cumbersome: it isn't done with the course structure editor, as one would expect it. Instead, it must be done when setting the quiz availability in the assessment manager. | |
Online Quizz Editor | yes | |
Offline Quizz Editor | no (but commercial third-party tool from Respondus can be used for this) | |
Broad Range of Quizz Types | yes | |
Quizz Engine Extensible | yes (using building blocks) | |
Quizz Validity Feedback | - | |
Support for e-learning standards | Blackboard closely watches the evolution of the e-learning specifications. A free SCORM compliant player is available as a Building Block.
With regard to IMS standards, Blackboard is compliant in the following :
| |
SCORM package import | yes | |
IMS/SCORM-CP | yes (1.12) | |
SCORM-API | - | |
LOM Metadata | IMS metadata 1.2.1 compliant (release 6) | |
IMS-QTI | yes (with release 6) | |
Adaptable look-and-feel | Virtual installations allow several institutions to share a single Blackboard server, creating several distinct and customizable Blackboard environments (this feature is currently only available in Blackboard 6, and is simulated in Blackboard ML via the separate language library profiles). At the course level, only the button shape and colors and a banner for the home page can be changed. Style sheets can be used in content files uploaded as a zip archive. | |
course level look-and-feel | no | |
multiple corporate identities | virtual installations (available in v6.0, simulated in ML via separate language library profiles) | |
Multilinguality | Blackboard ML ("ML" is for Multi-lingual) provides an interface in several languages, including French, German, Italian and English. | |
french environment | yes | |
german environment | yes | |
italian environment | yes | |
XML support | - | |
support for XHTML content | - | |
includes XSLT engine | no | |
includes XSL-FO engine | no | |
Migration of current WebCT courses | Blackboard provides a migration path for WebCT courses. | |
System & Administration | ||
System management | - | |
Performance | - | |
Availability | - | |
Maintenance | - | |
Security | - | |
Administration | Several authentication schemes are supported out-of-the box, APIs can be used to implement others. Integration of user, course and enrollment information can be done via snapshots or using an event-driven model. | |
One server - multiple institutions | yes (virtual installations) | |
Flexible Authentication Scheme | yes (pre-configured Building Blocks extensions are provided for LDAP, Microsoft Passport and Active Directory, and Kerberos; others can be implented through the APIs). | |
Documentation | yes | |
Flexible Licensing Model | Various licensing models are possible. | |
Technical Architecture |
| |
