As of August 1st, 2008, the Edutech web site will no longer be updated. Edutech was funded by the Swiss Virtual Campus programme, which ended on July 31st, 2008. Some activities will be taken over by the e-Learning Services group at the SWITCH foundation.

LMS Evaluation Report

hide details | show criteria descriptions

Products

WebCT Vista 1.2

WebCT Inc.: http://www.webct.com/

Last major evaluation update: Dec '02

strong points

  • appealing look-and-feel
  • easy to use for admins, designers, tutors and students
  • powerful communication tools
  • numerous powerful student tools: i.e. search tool, context sensitive help
  • efficient file handling due to integrated file manager with WebDAV support
  • numerous flexible authentication models supported
  • large institutions and consortia can hierachically organize groups, courses, sections etc.
  • good documentation

weaknesses

  • severe usability issues: can't copy-paste URLs, no browser bookmarks, browser's 'back' and 'reload' button don't work
  • less severe usability issues: incomplete font scaling, difficult printing
  • limited SDK - limited extensibility. End users can't program custom 'components' or custom quizz types.
  • limited layout control
  • incomplete or missing support for IMS-QTI, IMS-CP and SCORM
  • not backwards compatible with WebCT 3.x (missing tools: no compile, no student presentations, english interface language only)

Student's Environment

Student's Environment

Ease of Use
The environment has an appealing look-and-feel. The navigation is intuitive, except for the issues mentionned below.

Many functions, that browsers offer for common web pages don't work

  • no browser bookmarks
  • can't refer to content pages with URL (i.e. can't copy/paste and send an URL by email)
  • good font scaling capabilities with Mozilla but limited with IE
  • back button often doesn't work as expected
  • reloading the current page takes the browser to the course homepage
browser bookmarks
not supported - bookmark always leads to course homepage
URL access possible
not supported - url always leads to course homepage
in-system bookmarks
limited in-system bookmarks. Can only link to components within a learning module. Bookmark tool not available outside a learning module
print current page
typical frame problems. Students need to know how to select a frame and set the appropriate printing option in the browser. Math formulas are not printed.
save page on local disk
yes - with IE6
find word in current page
yes
no frames
no! 7 frames are displayed to show a content page
font scalable
Yes, with Mozilla 1.1, No with IE6 (only scales content pages, but not environment)
Compliant with common web technology
Mozilla 1.7
-
Netscape 6 ok
-
IE 6 ok
mostly ok
other browsers ok
student view ok with Mozilla 1.1
web-tablets, set top boxes ok
-
Functional environment
Many useful and easy to use student tools are available: excellent search engine, online help system, page annotations (also printable), to-do list. A powerful calendar tools allows to make private and shared public entries, and entries can be compiled and printed.

Another useful tool is the private file manager, that allows to store arbitrary files and organize them in folders.

The system navigation aids are intuitive to use. However, the browser's navigation function often don't work (bookmarks, back button, copy-paste URL)

In the discussions forums and emails the students can also use a HTML and a math formula editor (math formulas can't be printed however).

in content pages kann man die grösse des linken frames zwar anpassen, aber es springt bei einem seitenwechsel wieder auf die urprüngliche grösse zurück.

keyword search
very powerful search engine. Search can be refined, and targeted to areas (title, fulltext, ...) and components (assessment, content, forum, ...)
configurable environment
Hide/reveal navigation frame bar, choose date formats in calendar, background colors, layout of the entry page,
effective navigation aids
yes: intuitive navigation tools available
context sensitive help
excellent context sensitive help at any location within the environment. additionally allows to browse and search for help items.
Collection of Tools
private file manager, fomula editor, html editor

Tutoring and Didactics

Ease of use
As other parts of the WebCT system, the tutoring tools are fairly easy to use.

Estimated introductory training required for a typical tutor to be able to use the basic tutoring tools: 2 hours

The tracking and reporting functions are not implemented in version 1.2

Communication
The communication tools are a strong point of Vista. They are easy to use and offer all the necessary functions.

Asynchronous communication tools are: discussion forums, local mails that optionally can be forwarded to common mail address, announcments at group/institution/course/section levels. Any user can use a web based html editor and a formula editor (both applets) in the discussions and emails.

Synchronous tools are: 'who's online' tool, Chatroom and shared whiteboard, all implemented as a Java applets.

forum threaded
yes
forum searchable
yes, search can be restricted to subject, body and date
private workgroup forums
yes
internal mailing system
powerful local messaging system
mailing system interoperable with emails
yes, mail can optionally be forwarded to personal email address
chat
powerful combined chat and whiteboard (java applet)
whiteboard with integr. chat
powerful combined chat and whiteboard (java applet)
Instant Messaging
-
Students management
Various different enrollment models are available.
class enrollment by tutor
yes
class enrollment by student
yes
tutors can build groups
yes
students can build groups
no
Activity tracking
The activity tracking covers: the tools that were used, summary of student activity, course components used, top entry and exit pages or tools, most viewed content pages and student tracking.
individual page/tool access
yes
class page/tool access
individual activity in forum
yes
class activity in forum
individual performance in tests
class performance in tests
class assignment performance
-

Course Developement

Ease of Use
A course structure is entirely built using the web-based structure editor. It is easy and intuitive to use. The basic course structure and navigation concept can't be changed. The advantage of this is, that new courses with consistent navigation can be quickly conceived even by beginners, and that students always have the same familiar environment. The disadvantage is that experienced web designer can't set up a custom navigation and layout scheme.

The content can be edited in the web-based system using a built-in graphical HTML editor (Java-applet). This is useful for small corrections. However, voluminous content should be edited using an offline editor on the local computer, and uploaded as zip-archive or by WebDAV.

Estimated introductory training for a typical web designer to be able to use the basic editing features: 4 hours

Uploaded HTML pages are identified by their html title tag instead of by filename - author is required to rename pages either in WebCT or in html.

Crashed once, got error messages - not stable yet? Not yet possible to access text or xml files from Flash movies. -PMc

online editor for course organization
yes - powerful web-based editor
online editor for content structure
yes - powerful web-based editor (Java applet )
Web interface to up/download resources
yes - powerful file manager
up/download of resource packages
yes - zip archives can be uploaded/extracted and created/downloaded
Drag & Drop loading
-
offline editor for course structure
no
offline editor for content structure
no support for IMS-CP or similar data formats
Linking
deep linking is not possible. cross course linking is not possible?
Flexible Development Framework
This is a weak point of Vista. There are just a few ways to extend the functions or to make it interoperable with 3rd party infrastructure:
  • user account data can be accessed over a command line interface or a web-based interface
  • any external html page can be integrated into a learning module of a course, that will be showed in a frame. A student still has the impression of beeing in a WebCT course, because all common navigations aids are available in the same browser window. However, the external resource has no possibility to access to data of the WebCT server.
extensible architecture
no - limited SDK for user management/authentication
support for client side scripting
JavaScript can be used but there's no API that allows to access to data on the server (i.e. scores, student data, ...)
SCORM Runtime API
not available in version 1.1
support for server side scripting
no
server side scripting API
no
custom navigation scheme
The course structure can't be changed. The only location, where designers can optionally define their own navigation concept is within a learning module
Developers support
WebCT offer very complete manuals for administrators, designers, and tutors.

The online help is context sensitive, informative, searchable, hyper-linked and easy to navigate.

WebCT has set up a question and answer service (discussion forums) for administrators, designers and tutors. These forums are a useful source of informations.

basic manual/tutorial for authors
PDF manual (~500 pages) and online help
advanced manual for programmers
SDK reference (~100 pages)
complete documentation of APIs
SDK reference (~100 pages)
responsive support
during our evaluation - yes
online user forums
very active online discussion forum
Compatibility with common web authoring tools
Excellent WebDAV support! Sites can be defined, fully transparent file upload, download, synchronization, and file locking between multiple authors (tested with Dreamweaver).

A considerable drawback is that flash movies cannot read parameters from XML or text files in the same directory.

HTML files are parsed and modified, before they are delivered. All relative links to other pages, to images or to objects are prefixed by the server with an absoulute URL path. This might cause problems, if relative links are coded in JavaScript, Flash etc.

eine hochgeladene Seite wird irgendwann geparst und verändert. Z.b ein tag wird so verändert original:

geparst:

ein link: original: geparst:
compatible with standard web content
any common web content can be used. Restrictions: 1) Flash movies that read parameters from XML fiels in the same directory, 2) script generated urls?
up/download via ftp
no - use WebDAV
up/download via WebDAV
yes - fully supported and easy to use
Assessment
WebCT offers a powerful and easy to use quizz enviroment, for the most important question types.

The quizz engine can't be customized or extended.

Online Quizz Editor
yes, easy to use web interface.
Offline Quizz Editor
Respondus (third party product) - not available yet vor Vista
Broad Range of Quizz Types
yes
Quizz Engine Extensible
no
Quizz Validity Feedback
-
Support for e-learning standards
The current version of Vista has an incomplete support for upcoming standards and data formats.

Two import formats are currently available: IMS-CP (with numerous proprietary extensions) to import entire courses, and a subset of IMS-Enterprise to import user/student data.

SCORM package import
not available in version 1.2
IMS/SCORM-CP
IMS-CP import of entire courses, that were exported by WebCT 3.x (not tested)
SCORM-API
not available in version 1.2
LOM Metadata
not available in version 1.2
IMS-QTI
not available in version 1.2
Adaptable look-and-feel
Possibility to design and optionally lock down appearance for subordinate groups/courses in an institution.

The best way to define and adapt the look-and-feel of content pages is by using CSS. Relative CSS references are supported.

Basic possibilities to change the type and appearance of the environment. Colors and icons can be adapted, and (navigation)tool can be hidden and revealed. A custom institution logo can be displayed in the top left corner.

course level look-and-feel
partly adaptable. Adaptable: tool positions, tool icons, tool visibility, color scheme, myWebCT 'window' positions. Not adaptable: fonts, toolbars, frames, overall appearance. good CSS support
multiple corporate identities
multiple institutions can have their own branding. 'branding' means change logo and background colors
Multilinguality
in version 1.1, only english is supported as interface language (french and german language packs are promised to be available soon)
french environment
not in version 1.1
german environment
not in version 1.1
italian environment
not in version 1.1
XML support
Native XML support for course contents is not available.
support for XHTML content
no
includes XSLT engine
no
includes XSL-FO engine
no
Migration of current WebCT courses
(not tested)

System & Administration

System management
[to be determined]
Performance
-
Availability
-
Maintenance
-
Security
-
Administration
The authentication scheme is flexible enough, to integrate the user database in existing infrastructure. Five different authentication models are available. [SWITCH checks for compatibility with national AAI infrastructure]

The complete administration documentation is electronically available as PDF documents.

One server - multiple institutions
yes
Flexible Authentication Scheme
5 different authentication schemes available out-of-the-box: WebCT internal db, LDAP, Win domain controller, cutom authentication.
Documentation
PDF documentation available (~250 pages)
Flexible Licensing Model
yes
Technical Architecture
-