You are on page 1of 89

CIS NG 1.

1 User Guide

WSI_UG01_CIS

WorldSkills International Secretariat


Keizersgracht 62-64, 1015 CS Amsterdam, The Netherlands
www.worldskills.org, Tel: +31 23 5311071, Fax: +31 23 5310816

1 of 89

Table of Contents
1

Introduction ................................................................................................................................................. 6

Installation .................................................................................................................................................. 7
2.1
Windows Installation .......................................................................................................................... 7
2.1.1 Database........................................................................................................................................ 7
2.1.2

Download Installer Package .......................................................................................................... 7

2.1.3

Start the Installer ............................................................................................................................ 7

2.1.4

Install JDK (bundled downloads only) ........................................................................................... 8

2.1.5

CIS NG Installation Welcome Screen............................................................................................ 8

2.1.6

Choose Installation Path ................................................................................................................ 9

2.1.7

Installation Packs ........................................................................................................................... 9

2.1.8

New CIS NG Instance.................................................................................................................. 10

2.1.9

Server Settings ............................................................................................................................ 11

2.1.10

Instance Settings ..................................................................................................................... 12

2.1.11

Admin User .............................................................................................................................. 13

2.1.12

Installation of Files ................................................................................................................... 13

2.1.13

Processing ............................................................................................................................... 14

2.1.14

Shortcuts .................................................................................................................................. 14

2.1.15

New Instance URL ................................................................................................................... 15

2.1.16

Installation Complete ............................................................................................................... 16

2.2
Linux Installation .............................................................................................................................. 17
2.2.1 GUI Installation ............................................................................................................................ 17
2.2.2

Console installation...................................................................................................................... 18

2.2.3

Installation Path ........................................................................................................................... 18

2.2.4

Ports on Linux .............................................................................................................................. 18

2.3
Upgrading an existing installation .................................................................................................... 19
2.3.1 New Permissions ......................................................................................................................... 19
2.4
Adding Another CIS NG Instance .................................................................................................... 19
2.4.1 New Database or Existing Database ........................................................................................... 19
2.4.2

Configuration Details ................................................................................................................... 20

2.5
Configuration File ............................................................................................................................. 21
2.5.1 Port .............................................................................................................................................. 22

2.5.2

Version ......................................................................................................................................... 22

2.5.3

Build Number ............................................................................................................................... 22

2.5.4

Shutdown Configuration .............................................................................................................. 22

2.5.5

Instance Configuration ................................................................................................................. 22

Starting/Stopping CIS NG ........................................................................................................................ 23


3.1
3.2
3.3
3.4
3.5

Windows Startup .............................................................................................................................. 23


Linux Startup .................................................................................................................................... 23
Shutting down CIS NG..................................................................................................................... 23
Log Files .......................................................................................................................................... 24
Troubleshooting ............................................................................................................................... 24

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

2 of 89

3.5.1
4

Server wont start ......................................................................................................................... 24

Setting Up The Competition ..................................................................................................................... 25


4.1
Logging in ........................................................................................................................................ 25
4.2
CIS NG Homepage .......................................................................................................................... 26
4.3
Changing Password......................................................................................................................... 27
4.4
Config Screen .................................................................................................................................. 27
4.4.1 Competition Name ....................................................................................................................... 27
4.4.2

File System Path for Images........................................................................................................ 27

4.4.3

URL of Help System .................................................................................................................... 28

4.4.4

Secondary Logo........................................................................................................................... 28

4.4.5

Sort Competitors by ..................................................................................................................... 28

4.4.6

Unicode Font List ......................................................................................................................... 28

4.4.7

Allow Multi-Skill Competition........................................................................................................ 28

4.4.8

Include Multi-Skill Marks in Member Comparison Reports.......................................................... 28

4.4.9

Include Multi-Skill Medals in Member Comparison Reports ........................................................ 28

4.4.10

Gold Medal Points ................................................................................................................... 29

4.4.11

Silver Medal Points .................................................................................................................. 29

4.4.12

Bronze Medal Points ................................................................................................................ 29

4.4.13

Medallion for Excellence Medal Points .................................................................................... 29

4.5
Setting Competition Dates ............................................................................................................... 29
4.6
User Groups and permissions ......................................................................................................... 30
4.7
Positions .......................................................................................................................................... 31
4.8
Members .......................................................................................................................................... 32
4.9
Subjective Judging Rules ................................................................................................................ 33
5 Adding Skill Information ............................................................................................................................ 34
5.1
Skills & Skill Rules ........................................................................................................................... 34
5.1.1 Skill Number ................................................................................................................................ 34
5.1.2

Name ........................................................................................................................................... 34

5.1.3

Subjective Marking Rule Group ................................................................................................... 35

5.1.4

Identify The Judge When Entering A Score ................................................................................ 35

5.1.5

Competitors Are Organised In Groups ........................................................................................ 35

5.1.6

Allow Compatriot Marking ............................................................................................................ 35

5.1.7

Allow to generate a landscape marking form .............................................................................. 35

5.1.8

Generate 500 Scale Marks And Medals ...................................................................................... 35

5.1.9

Exclude From Member Results Comparison ............................................................................... 35

5.1.10

Prevent Further Editing Of Marking Scheme ........................................................................... 35

5.2
Adding People To CIS NG ............................................................................................................... 36
5.2.1 Picture .......................................................................................................................................... 36
5.2.2

Positions ...................................................................................................................................... 36

5.2.3

Exclude From Final Results ......................................................................................................... 36

5.2.4

Username and Password ............................................................................................................ 37

5.2.5

User Group .................................................................................................................................. 37

5.2.6

Language ..................................................................................................................................... 37

5.2.7

Importing From a File................................................................................................................... 37

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

3 of 89

5.3
Searching For People ...................................................................................................................... 38
5.4
Creating Teams ............................................................................................................................... 39
5.5
Deleting people ................................................................................................................................ 40
6 Entering The Marking Scheme ................................................................................................................. 41
6.1
Entering Criteria ............................................................................................................................... 41
6.2
Adding a Sub Criterion..................................................................................................................... 42
6.3
Adding Subjective Aspects .............................................................................................................. 44
6.4
Adding Objective Aspects ................................................................................................................ 45
6.5
Moving Aspects ............................................................................................................................... 46
6.6
Objective Marking Types ................................................................................................................. 47
6.6.1 Direct Mark Entry ......................................................................................................................... 47
6.6.2

Ranged Score .............................................................................................................................. 47

6.6.3

Percent Score Comparison.......................................................................................................... 48

6.6.4

Stepped Score Comparison......................................................................................................... 48

6.7
Importing Data ................................................................................................................................. 51
6.7.1 Importing a Marking Scheme ....................................................................................................... 51
6.7.2

Importing People .......................................................................................................................... 52

6.7.3

Importing Members ...................................................................................................................... 53

6.8
Setting Marking Days....................................................................................................................... 55
6.8.1 Specific Day ................................................................................................................................. 55
6.8.2

Any Day ....................................................................................................................................... 55

6.8.3

Per Competitor ............................................................................................................................. 55

6.9
Locking a Marking Scheme ............................................................................................................. 56
6.10
Checking That Skills Are Ready For Mark Entry ............................................................................. 57
6.11
Marking Forms ................................................................................................................................. 58
6.11.1
Blank Forms ............................................................................................................................. 58

6.11.2

Marking Forms With Aspects ................................................................................................... 60

6.11.3

Marking Forms for Hand-Written Marks .................................................................................. 62

6.11.4

Landscape Forms for Hand-Written Marks.............................................................................. 63

6.11.5

Marking Forms With Aspects And Marks ................................................................................ 64

6.11.6

Signoff Form for Marking Scheme ........................................................................................... 66

6.11.7

Signoff Form for Mark Entry..................................................................................................... 67

Multi-Skills ................................................................................................................................................ 68
7.1
Activating Multi-Skill functionality ..................................................................................................... 68
7.2
Creating a Multi-Skill ........................................................................................................................ 69
7.3
Multi-Skill Teams ............................................................................................................................. 70
7.4
Multi-Skill Results ............................................................................................................................ 71
7.4.1 100 Scale Marks .......................................................................................................................... 71
7.4.2

500 Scale Marks .......................................................................................................................... 71

During the Competition ............................................................................................................................. 72


8.1
Manage Application ......................................................................................................................... 72
8.2
Entering Marks ................................................................................................................................. 73
8.2.1 Competitor Information ................................................................................................................ 73
8.2.2

Sub Criterion Selection ................................................................................................................ 74

8.2.3

Objective Mark Entry ................................................................................................................... 74

8.2.4

Subjective Mark Entry .................................................................................................................. 76

8.3

Marking Progress and Missing Marks ............................................................................................. 77

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

4 of 89

8.3.1

Marked Aspects Report ............................................................................................................... 77

8.3.2

Missing Marks Report .................................................................................................................. 78

8.4
Locking Marks .................................................................................................................................. 79
After Mark Entry........................................................................................................................................ 80
9.1
Viewing Marks ................................................................................................................................. 80
9.2
500 Scale Marks & Medals .............................................................................................................. 81
9.3
Competitor Certificates .................................................................................................................... 82
9.4
Exporting Data ................................................................................................................................. 83
9.4.1 Exporting a Marking Scheme....................................................................................................... 83

10

9.4.2

Exporting People ......................................................................................................................... 83

9.4.3

Exporting Members...................................................................................................................... 83

9.4.4

Exporting Results ......................................................................................................................... 83

Reports ................................................................................................................................................ 84

10.1
10.2
10.3
10.4
10.5
10.6
10.7
10.8
10.9
10.10
10.11

Experts Head to Head ..................................................................................................................... 84


Marks by Single Expert .................................................................................................................... 85
Analysis of Experts .......................................................................................................................... 85
Skills Comparison ............................................................................................................................ 86
Proportion of Objective to Subjective .............................................................................................. 86
Range of Marks ............................................................................................................................... 87
Albert Vidal Award ........................................................................................................................... 88
Member Comparison ....................................................................................................................... 88
Member Medal Totals ...................................................................................................................... 88
Official Results ............................................................................................................................. 89
Mark Entry Times ......................................................................................................................... 89

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

5 of 89

INTRODUCTION
CIS NG is the Next Generation of the Competition Information System (CIS) software. It has been rewritten from the ground up to provide a better user experience, as well as better performance and
stability. The software handles many of the tasks involved in running a WorldSkills Competition,
including creating marking schemes, holding Competitor information, storing Competitors marks,
producing medal results and many other activities.
This document will guide you through the installation and use of CIS NG. It details functions of the
software in chronological order of when they would most likely be used, not necessarily in the order
they appear in the menu.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

6 of 89

INSTALLATION

2.1 Windows Installation


2.1.1

Database
CIS NG gives you the choice of two different databases that can be used MySQL or H2.
The MySQL database has the advantage of being a well-known and well-supported database
with many third party tools available for doing backups and other maintenance. If you wish to
use MySQL with CIS NG you must install it separately prior to installing CIS NG.
The H2 database requires no installation procedure for use with CIS NG. If you wish to use
this database CIS NG will create the necessary files in the databases folder of your
installation directory.

2.1.2

Download Installer Package


The CIS NG installer for Windows comes in three different packages. You should select the
one appropriate for your system.
The first package assumes that you have a Java 6 JDK (not JRE) already installed on your
system. If you dont have the JDK installed (or you dont know if you do), choose one of the
other two packages. The other two packages come bundled with a JDK which will install during
the CIS NG installation process. One of the packages contains the JDK for 32-bit systems, the
other for 64-bit systems.
Download the package you require from http://cis.worldskills.com and save it to your hard
drive.

2.1.3

Start the Installer


Simply double click the downloaded file to start the installation process.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

7 of 89

2.1.4

Install JDK (bundled downloads only)


If you downloaded one of the installation packages that is bundled with a JDK, you will see a
screen similar to the following. Proceed through the JDK installation steps.

2.1.5

CIS NG Installation Welcome Screen

Proceed through the installation steps as follows.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

8 of 89

2.1.6

Choose Installation Path

2.1.7

Installation Packs
At this stage there is only the CIS NG installation pack.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

9 of 89

2.1.8

New CIS NG Instance


At this step you are selecting whether to create a new instance of CIS NG or simply upgrade
an existing installation. You can have multiple CIS NG instances within the one installation.
Each instance has its own URL.
On this screen if you wish to upgrade an existing installation without adding any new CIS NG
instances, simply uncheck the checkbox and press the Next button. You will skip to step
2.1.12.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

10 of 89

2.1.9

Server Settings
Here you need to select what port the CIS NG server will listen on for incoming requests. The
default is port 80, which is the standard HTTP port used for serving web pages. You may find
that other software installed on your machine such as Apache, IIS or even Skype will attempt
to use port 80 and cause problems for CIS NG when it starts up. If this is the case, you can
either simply not run the other software, re-configure it to use a different port, or configure CIS
NG to use a different port.
On this screen you also need to select what type of database you want to use for the new
instance of CIS NG. You can choose to create a new database in an existing MySQL
installation, or choose the H2 database which will create a file in the databases folder of your
installation directory.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

11 of 89

2.1.10

Instance Settings
On this screen you enter the configuration details for the new CIS NG instance.

Competition Name This name appears on the top of every page, the login screen and at the
top of every PDF generated by CIS NG.
URL Path Each CIS NG instance is accessed at a different URL by a web browser. The part
entered here comes after the machine name/address. For example, if the CIS NG screenshot
above were being installed on the WorldSkills International server it would be accessed at
http://www.worldskills.org/antarctica
Host Name (MySQL only) This is the host name of the computer where MySQL is installed.
If it is installed on the same machine as the one CIS NG is being installed on, then it can be
left at the default name of localhost. If MySQL is on a different machine, enter the host
name or IP address of that machine. If the H2 database were selected in the previous step this
field will not appear.
Port Number (MySQL only) This is the port number that the MySQL database is listening
on. In most cases this will be the standard MySQL port 3306.
Database Name This is the name of the database that the new CIS NG instance will use. If
the database doesnt exist then it will be created. If it does exist then it must be empty.
Username & Password fields This is where you enter the username and password of the
database user that will access the CIS NG database. For MySQL installations the user must
already exist and have full permission to create and edit the database. For H2 installations
these details will be used to create a new user to access the new database that will be
created.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

12 of 89

2.1.11

Admin User
This screen is where you give the username and password of the admin user that will be
created for CIS NG. This will be the only user that exists once the installation is complete. The
admin user will have full control over the CIS NG instance. It is recommended that you write
down the username and password and keep it in a secure location.

2.1.12

Installation of Files
The files are transferred to the installation path

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

13 of 89

2.1.13

Processing
During this step the configuration file is created and the new database created.

2.1.14

Shortcuts
For setting up shortcuts on your machine

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

14 of 89

2.1.15

New Instance URL


This screen gives you a URL from which you can access the new CIS NG instance once it has
been started. You will note that it is your machine name with the URL Path that you supplied in
step 2.1.10 appended. After you start the CIS NG server you can type this in to your web
browser and you will see the CIS NG login screen.
You can also access the CIS NG instance using the IP address of your machine, for example
http://192.168.0.1/antarctica. Depending on your network configuration you may also have
other names mapped to your machine. For example, you may have domain name configured
to point to your machine, so http://www.yourdomain.com/antarctica could also point to CIS NG

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

15 of 89

2.1.16

Installation Complete
This is the final screen of the installation. Note occasionally this screen is missing the green
tick and message. This is a bug in the installation software rather than CIS NG itself and does
not present a problem. The installation has still been completed successfully.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

16 of 89

2.2 Linux Installation


The Linux installer is an executable jar file. This requires that you already have a Java 6 JDK (not JRE)
installed on the system. You have two options for running the Linux installer.
2.2.1

GUI Installation
If you are using a desktop environment like GNOME or KDE you can use a GUI installer that is
very similar to the Windows one. Simply open a terminal window, change to the directory
containing the installation jar file, and type:
java jar cis_installer.jar

See the Windows installation documentation above for the data required at each step. The
Linux installer differs in that it does not show the Processing screen at 2.1.13 because it does
the processing in the background. It also skips the shortcut screen at 2.1.14 because the
automatic creation of shortcuts is unavailable for the Linux installation.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

17 of 89

2.2.2

Console installation
If you only have shell access to the machine, you can run the installation in console mode.
SSH on to the machine, change to the directory containing the jar file and type:
java -jar cis_installer.jar console

The installer will ask for the same information as the Windows installer, so the above
documentation can be used as a guide.
2.2.3

Installation Path
The installation path on Linux cannot have any spaces in it. If any of the folder names in the
path have a space in it the installation will fail.

2.2.4

Ports on Linux
On Linux systems TCP ports with numbers less than 1024 are reserved and can only be
opened by the root user. This will cause problems trying to run CIS NG on the default HTTP
port 80. The CIS NG installer suggests that you pick the port 8080, but any port above 1024
will be fine as long as it doesnt conflict with another application. Because a port other than
port 80 will be used it will mean that the port number will need to be put in the URL when
accessing CIS NG, for example http://localhost:8080/antarctica
You can, however, still have URLs without the port number in them by redirecting traffic from
port 80 to the port that CIS NG is listening on. Here are a couple of ways you can do it:
1. Use iptables to port forward port 80 to desired port.
Below is an example iptables rule to do that. Depending on the configuration of your
machine you might need to tweak this to get it to work:
iptables -A PREROUTING -t nat -i eth0 -p tcp --dport 80 -j
REDIRECT --to-port 8080

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

18 of 89

2. Install Apache with the mod_proxy module and use reverse proxies.
You will need to enter a rule in to the Apache config file for each instance of CIS NG.
Read the documentation for mod_proxy for detail on how to do this. Here is an
example:
ProxyPass /antarctica http://localhost:8080/antarctica
ProxyPassReverse /antarctica http://localhost:8080/antarctica
2.3 Upgrading an existing installation
To upgrade an existing installation run the installer for the latest version of CIS NG. Select the path of
the existing installation as the installation path in the new installer. The installer will detect that the path
contains an existing installation of CIS NG and upgrade the installation. Also remember to uncheck the
Create new instance checkbox in step 2.1.8 above so that it doesnt add another database to your
installation.
2.3.1

New Permissions
Some upgrades may introduce new permissions to CIS NG or modify existing ones. If there is
a feature missing from CIS NG that you were expecting, first check the permissions to make
sure you have access to the new feature.

2.4 Adding Another CIS NG Instance


CIS NG can run multiple instances (or competitions) from the one installation. To add a new instance to
your installation you need to run the configUpdater utility. It is located in the installation directory and is
named configUpdater.exe on Windows and configUpdater.sh on Linux.
2.4.1

New Database or Existing Database


You can choose to create a whole new database or connect to a database that already exists.
If choosing to connect to an existing database the CIS NG configuration file is updated but no
operations are performed on the database itself.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

19 of 89

2.4.2

Configuration Details
Fill in the rest of the configuration details for the new CIS NG instance. You will be asked for
information similar to that requested during installation. Refer to the Windows installation
procedure for further details on a specific item.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

20 of 89

2.5 Configuration File


CIS NG has a configuration file cisconfig.xml that it reads every time it is started. You shouldnt
normally need to touch this file, but there are a few things that should be covered just in case you do.
Here is the file that has been created so far during installation and after adding an extra CIS NG
instance.
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<CISConfig>
<Server>
<Port>80</Port>
<Version>1.1</Version>
<Build>361</Build>
<Shutdown>
<Port>8005</Port>
<Message>shutdownCISNG</Message>
</Shutdown>
</Server>
<Instance>
<Name>Antarctica Competition</Name>
<ContextPath>/antarctica</ContextPath>
<Database>
<Type>MySQL</Type>
<Host>localhost</Host>
<Port>3306</Port>
<DatabaseName>cis_ng</DatabaseName>
<Username>cis</Username>
<Password>password</Password>
</Database>
</Instance>
<Instance>
<Name>North Pole</Name>
<ContextPath>/north_pole</ContextPath>
<Database>
<Type>H2</Type>
<DatabaseName>cis_ng_north_pole</DatabaseName>
<Username>cis</Username>
<Password>123456</Password>
</Database>
</Instance>
</CISConfig>
Lets take a look at a couple of parts of the file.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

21 of 89

2.5.1

Port
Within the <Server> XML tag you can see a <Port> tag. This is the port that CIS NG listens
on for incoming requests from web browsers. Port 80 is the standard HTTP port. If you need to
change this simply put the new port number in here and CIS NG will attempt to bind to that
port when it starts up.

2.5.2

Version
This tag contains the version number of the CIS NG software.

2.5.3

Build Number
The <Build> tag contains the build number that is used by the CIS NG installer when
performing upgrades to existing installations. It should never be altered manually.

2.5.4

Shutdown Configuration
CIS NG should always be shut down using the shutdown script rather than just killing the
running CIS NG process. This allows CIS NG to gracefully stop all the user sessions in each
instance and clean up any locks held by the users.
The shutdown script works by connecting to a special port that CIS NG is listening on and
sending it a shutdown message. CIS NG will only accept connections on that port that
originate from the same machine. Any attempt to connect to it from another machine will be
rejected.
This section of the configuration file allows you change the default shutdown port and the
message that is shutdown message sent to CIS NG.

2.5.5

Instance Configuration
Each of the competitions in the CIS NG installation is represented by an <Instance> tag.
Here you can tweak a few of the settings if necessary. For example is the database password
is changed you can update it here in the configuration file to reflect the new password. If the
database is moved to a different server you can enter the details of the new server here so
CIS NG will know where to find it. You can also change the URL path for the instance by
changing the contents of the <ContextPath> tag.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

22 of 89

STARTING/STOPPING CIS NG
Now that CIS NG has been installed and configured, you can start up the CIS NG server. The CIS NG
server must be started before any users can login to the system.

3.1 Windows Startup


If you chose to create shortcuts during installation you can start the CIS NG server by double clicking
on the desktop icon or clicking on the CIS NG application in your Start menu. Alternatively you can
double click on the cisng.exe file in the installation directory.
Starting the CIS NG server will create a minimised window that sits in the system tray and has the CIS
NG icon. The server is now running, and after a few seconds will be ready to accept requests from a
web browser. If the icon in the system tray is clicked it will maximise a window that looks similar to the
screenshot below:

This message shows that the configuration file has been read and all CIS NG instances have been set
up and are ready to accept connections from web browsers. It gives the URL for each instance that is
running in this installation. IThe screenshot above shows that there are two competitions running in this
CIS NG installation.
3.2 Linux Startup
Installations on Linux should be started using the startup.sh script found in the installation directory.
The same output as shown in the screenshot of the Windows startup above can be found in the
nohup.out file.
3.3 Shutting down CIS NG
The CIS NG server should always be shut down using the shutdown script. On Windows this is the
shutdown.exe file in the installation directory. There is also a shortcut to this file from the Windows
Start menu. On Linux the shutdown.sh script found in the installation directory should be used.
Shutting down the server in this way allows CIS NG to gracefully invalidate the users sessions and
clean up any locks or other resources they may be holding. Just closing the CIS NG window or killing
the process risks leaving mark entry screen for a particular Competitor locked until the user who was
entering the marks logs back in and goes the mark entry screen to reclaim the lock.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

23 of 89

3.4 Log Files


The log files for CIS NG can be found in the logs folder within the installation directory. Each instance
will have its own log file where any errors or warnings are logged. There is also a log file for the server
itself called server.rlog.
3.5 Troubleshooting
3.5.1

Server wont start


On Windows if the server wont start youll see the CIS NG icon briefly appear in the Windows
task bar then disappear a few seconds later. On other operating systems you will see that
there is no process running.
To find out what may be causing the problem, open up the server.rlog file located in the
logs folder of the installation directory. Most commonly you will be presented with a message
such as the following:
2010-09-10 11:45:17.889::WARN: failed SocketConnector@0.0.0.0:80
java.net.BindException: Address already in use: JVM_Bind
This indicates that some other software installed on your machine is currently using the port
that CIS NG has been configured to use, so CIS NG is unable to start. Webserver software
such as Apache, IIS or Tomcat can often cause this conflict. To resolve the conflict you can
either change the port that CIS NG uses (see section 2.5.1) or re-configure the other software
that is using the port.
Another piece of software that causes problems in this regard is Skype. It uses port 80 by
default. To turn this off, do the following:
1. Select Tools->Options from the menu.
2. Click on "Advanced" then "Connection".
3. Uncheck the box "Use port 80 and 443 as alternatives for incoming connections".
4. Click Save.
5. Restart Skype.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

24 of 89

SETTING UP THE COMPETITION

4.1 Logging in
Once the CIS NG server has been started a user can go to the login screen with their web browser. The
user interface has been designed to work with Firefox and this is the recommended web browser,
although other browsers should work as well.
In our case well go to the login URL for our competition http://localhost/antarctica

You can see that the competition has the name that was supplied during installation. Enter the admin
username and password that you provided during installation and press enter or the login button to
login to CIS NG.
Each user of CIS NG can only have one active session at a time. If you attempt to login with a user that
has a currently active session, the active session is destroyed and the new session becomes the active
one.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

25 of 89

4.2 CIS NG Homepage


Upon successfully logging in, the user is presented with the CIS NG homepage.

At the top is the header with the competition name and the WorldSkills International logo. On the left is
the menu that appears on every page of CIS NG. At the bottom of the menu are a few interesting
things.

Here you can see the language select box. The default language is English. Changing the language
results in the text of the user interface changing to the selected language.
Also shown here is the user that youre currently logged in as, as well as a Change Password and
Logout button.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

26 of 89

4.3 Changing Password


The Change Password screen is reached by clicking the Change Password button at the bottom of
the menu.

Once a new password has been saved it can be used the next time you log in.
4.4 Config Screen
The first item in the menu is Config. Various settings for the competition can be set on the Config
screen.

4.4.1

Competition Name
The name of the competition can be changed here. The change will be reflected in the
generated PDFs, the header of the CIS NG user interface and the login page. You will see the
updated name when you next move to a new screen,

4.4.2

File System Path for Images


This is the path where all uploaded images will be stored. Images can be uploaded for
secondary logos, Competitor photos, etc. By default the image path is set to a folder in your
installation directory images/<competition name>. In this case the folder is
C:/Program Files/CIS NG/images/Antarctica_Competition/

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

27 of 89

4.4.3

URL of Help System


If you wish to make a help website available to your users you can enter the URL here. Once
set all new CIS NG sessions will receive a HELP link in their menu above the System
section of the menu. WorldSkills International has a help site located at
http://cis.worldskills.org/help/ that can be used if desired. For our example competition the
WorldSkills International help site will be used.

4.4.4

Secondary Logo
You may want to add some branding for your competition to CIS NG. Here you can upload
another logo that will be displayed in the generated PDF files, the header of the CIS NG user
interface and the CIS NG login page.
You need only upload one image here. CIS NG will use the uploaded version in the PDF files
and create resized versions to fit the user interface. It is recommended that an image in PNG
format be used. The file size should be kept to a minimum to avoid the size of the generated
PDF documents getting overly inflated. About 20K seems to give a good balance between
image quality and file size.
For our example competition a WorldSkills Antarctica logo will be uploaded.

4.4.5

Sort Competitors by
Here you can set how Competitors are sorted when they appear in lists in CIS NG. The default
is to sort them alphabetically by last name. Alternatively they can be sorted alphabetically by
member code.

4.4.6

Unicode Font List


CIS NG accepts text entered in many different languages and generally does a good job of
rendering the characters in the user interface. It is slightly more difficult to render these
characters in the PDF documents. The default font used in the PDFs is Helvetica, but
Helvetica cannot render all Unicode characters. If a character is encountered that cant be
handled with Helvetica, CIS NG looks through a list of other fonts until it encounters one that it
knows will handle it.
On Windows Vista and Windows 7 installations the default behaviour will likely be sufficient
because there are many Unicode fonts installed by default with these versions of Windows.
Other operating systems may need to have a font installed that will handle the characters. You
can let CIS NG know about these fonts by putting the names of the fonts in a commaseparated list in this field, for example MS Song, Baekmuk Batang, Kochi Mincho.

4.4.7

Allow Multi-Skill Competition


Switch on or off the ability to create Multi-Skills that collect the results of several skills
together, such as those used in EuroSkills competitions. See section XXX for futher details.

4.4.8

Include Multi-Skill Marks in Member Comparison Reports


Add the marks for Multi-Skills to the total number of marks in the Member comparison reports.

4.4.9

Include Multi-Skill Medals in Member Comparison Reports


Add the medals for Multi-Skills to the tallies in the Member comparison reports.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

28 of 89

4.4.10

Gold Medal Points


The number of points that a Gold medal is worth in the Member comparison reports. The
default value is 4.

4.4.11

Silver Medal Points


The number of points that a Silver medal is worth in the Member comparison reports. The
default value is 3

4.4.12

Bronze Medal Points


The number of points that a Bronze medal is worth in the Member comparison reports. The
default value is 2

4.4.13

Medallion for Excellence Medal Points


The number of points that a Medallion for Excellence medal is worth in the Member
comparison reports. The default value is 1

4.5 Setting Competition Dates


The Competition Dates link in the menu will take you to the screen for setting the dates for each day of
competition.

Click the Add button to add a new day. The date can be changed by typing it in the text field or clicking
the calendar icon and selecting a date from the calendar. When youve finished adding dates hit the
Save button. Dates can be removed by clicking the red minus icon on the left.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

29 of 89

4.6 User Groups and permissions


The User Groups menu item provides a screen for managing user groups and what they have
permission to do within CIS NG. By default there is only the Admin user group that has permission to
every part of CIS NG. This is the user group that the admin user belongs to. If youre planning on
allowing other people to log in to CIS NG, you will need to create some new user groups and set what
parts of the software they are allowed to use. To delete an existing user group, select it from the drop
down box and click the Delete User Group button with the red minus sign.
For our example competition well click the New button and create a new group called Experts. They
will be allowed to edit their own skills information, edit their own skills marking scheme, view the PDF
marking forms for their own skill, enter marks for their own skill and view total marks for their own skill.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

30 of 89

4.7 Positions
This screen is for defining the different relationships that people in CIS NG have to a skill.

Each position has a name and a position type. The position type is a category for the position. The
screenshot above shows the positions that are created automatically during installation. You can see
that there is an Expert position and a Chief Expert position. Both have the position type of Expert.
This will allow CIS NG to be able to retrieve a list of all Experts for a skill by retrieving all people with a
position type of Expert for that skill. There are three possible position types for a position Competitor,
Expert and Non Participant.
Lets say that each skill has an assistant that assists with mark entry. They will need to have a login to
CIS NG and have access to just the skill they have been assigned to. Obviously they shouldnt have a
Competitor position or else they will appear on the marking forms and CIS NG will expect them to
receive marks. They shouldnt be an Expert or Chief Expert because then they will appear in places like
the subjective mark entry forms as a judge for subjective marking. A new position called Assistant
should be created, with a position type of Non Participant. When a user login for each assistant is
created, they should be assigned to their skill with the Assistant position.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

31 of 89

4.8 Members
The Edit Members screen allows you to add, edit and delete members from the system. A newly
created competition has all the WorldSkills International members loaded by default. Individual
members can be removed by clicking the red minus icon next to the member. All members can be
removed at once by clicking the Delete All button at the bottom of the page. New members can be
added one at a time using the form or imported from an Excel or CSV file on the Import Data page
(see section 6.7). Once a Member has been added, their abbreviation code cannot be changed.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

32 of 89

4.9 Subjective Judging Rules


This screen is where the set of rules for subjective marking are configured.

Each rule group is required to have a name. You also need to set the minimum score and the maximum
score. These are usually 1 and 10 respectively.
You also need to define at least one (and usually only one) rule. In the screenshot above the rule is for
five judges. The maximum allowed difference between the judges scores is set to 4. It has also been
configured to ignore the highest score and the lowest score. So any skills that have the above
subjective judging rules applied to them need to have five judges assessing the subjective aspects of
Competitors work.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

33 of 89

ADDING SKILL INFORMATION

5.1 Skills & Skill Rules


This screen allows you to create and delete skills from the system. You can also set various high level
details about a skill.

For our example competition two skills will be created: Snowman Building and Ice Sculpting. The Ice
Sculpting skill will be a team skill.

5.1.1

Skill Number
This is a unique identifier for the skill that has a maximum length of four characters. Despite its
name, it can also contain letters. This field is mandatory.

5.1.2

Name
This is the name of the skill. You can add a different piece of text for the name for each of the
different languages. It is mandatory to enter a name for at least one language.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

34 of 89

5.1.3

Subjective Marking Rule Group


This is a list of the rules that were set up in the Subjective Judging Rules screen (see4.9). It
is mandatory to select one of these rules, even if your skill wont have subjective aspects.

5.1.4

Identify The Judge When Entering A Score


This checkbox sets whether the identity of the judge needs to be known for each score during
subjective marking. If this is checked it allows CIS NG to produce an analysis of the marking
patterns of each judge. See section10.

5.1.5

Competitors Are Organised In Groups


This is used to indicate whether Competitors are grouped in to teams of two or more people for
this skill.

5.1.6

Allow Compatriot Marking


This checkbox indicates whether an Expert is permitted to assess the work of a Competitor
from the same Member organisation. This applies only to subjective marking.

5.1.7

Allow to generate a landscape marking form


Some skills may require a marking form that allows them to mark multiple competitors for the
same aspect at the same time. This form lists the aspects down the left of the page and space
for multiple competitors across the page and is in landscape format (as opposed to portrait).
See section 6.11.4 for more detail.

5.1.8

Generate 500 Scale Marks And Medals


This indicates whether a skill should have its marks converted from the 0 - 100 scale to the
500 scale and have medals assigned once marking is completed. Some skills such as
Presentation Skills may not have 500 scale marks generated.

5.1.9

Exclude From Member Results Comparison


If this checkbox is checked the skills 500 scale marks and medals will not count toward the
Member tallies generated by reports at the end of the competition (see section 10.8). Host
Member Skills fall in this category of skill.

5.1.10

Prevent Further Editing Of Marking Scheme


When the marking scheme for a skill has been finalised, this checkbox should be checked. CIS
NG will check that the marks add up to 100 and that there are no other anomalies.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

35 of 89

5.2 Adding People To CIS NG


The Add Person link under the Personnel section of the menu takes you to a screen where you can
add the details for a person to CIS NG. Only the First Name and Last Name fields are mandatory.

5.2.1

Picture
A picture of the Competitor can be uploaded that will appear on the mark entry screen when
marks are being entered for that Competitor.

5.2.2

Positions
This is used to map the person to a skill. The list of positions are the same that appear on the
Positions screen (see section 4.7). The list of skills are those created on the Skills & Skill
Rules screen. To create the link between the person and the skill, click the Add button. To
remove a link to a skill, click the red minus icon next to the skill name.
In the example screenshot above Expert One has been added as an Expert in the Snowman
Building skill.

5.2.3

Exclude From Final Results


If this is checked the Competitor will still receive a mark out of 100 but their mark will not be
used in the calculation of the 500 scale marks. This can be used in cases where a Competitor

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

36 of 89

has not completed the competition or is ineligible to receive a result for some other reason.
This field only appears if the person is linked to a skill as a Competitor.
5.2.4

Username and Password


If a username and password are provided it allows the person to log in to CIS NG. The user
can change their password once they are logged in via the Change Password button at the
bottom of the menu (see section 4.3).

5.2.5

User Group
If a username and password are entered, a user group must also be selected so that CIS NG
knows what the user has permission to do when they log in. The user groups are managed on
the User Groups screen (see section 4.6).

5.2.6

Language
This is the language of the CIS NG user interface for this user. In the example screenshot
above, Expert One will see the user interface in German by default when she logs in.

5.2.7

Importing From a File


All the required people can be entered into the system using this screen, but for anything other
than a small number of people it will probably be more convenient to import them from a
spreadsheet (see section 6.7).

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

37 of 89

5.3 Searching For People


The Person Search screen allows you to find people already entered in to CIS NG.

Clicking the Find button without filling in any part of the form will return all users in the system. Any
information entered in the form is used to narrow the results. In the screenshot above there has been a
search for all Competitors in the Snowman Building skill.
The First Name and Last Name fields will match names that start with the supplied text and are case
insensitive. For example, if t were added to the Last Name field it would return Competitor Two and
Competitor Three in the search results.
People can also be deleted from CIS NG on the search results page. The people are selected and
ticked in the checkbox. Clicking the Delete Selected button will delete all the currently selected people.
Clicking on any of the text in the search results will take you to Edit Person page. The Edit Person page
is very similar to the Add Person and contains the same fields as well as a Delete button.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

38 of 89

5.4 Creating Teams


The Manage Teams screen is for grouping individual Competitors into teams.

To group Competitors in to a team, click on the Competitors in the left column. The selected
Competitors will have green ticks next to their name. Click the Group button in the middle. The new
team will appear in the right column and the Competitors will disappear from the left column.
To remove a team, click on the team in the right column. The selected team will have a red tick on the
left. Click the Ungroup button. The team will be removed from the right column and all the Competitors
from the team will appear back in the left column.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

39 of 89

5.5 Deleting people


People can be deleted individually from the Edit Person page by clicking the Delete button. Multiple
people can be deleted from CIS NG at the same time on the Person Search page. Simply search for the
people to be deleted, tick the checkbox for each person then click the Delete Selected button.

People can only be deleted from CIS NG if:


- No marks have been entered for the person
- The person is not part of a team (if they are in a team the team must be ungrouped first see
section 5.4)
- The person is not part of a Multi-Skill team;

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

40 of 89

ENTERING THE MARKING SCHEME

6.1 Entering Criteria

The Assessment Criteria link in the Competition section of the menu leads to a screen where you
can enter each criterion of the skill. As the mark for each criterion is entered it is added to the total at
the bottom of the screen.
The Marks Defined column contains the total of the aspect marks within that criterion. When creating a
new criterion as in the screenshot above, this value will obviously be zero. Once your marking scheme
is complete, the number of Marks Defined should match the Max Mark for the criterion. If it doesnt
its a good indication that there aspects missing from the criterion.
When the Save button is pressed or the enter key is pressed the data is saved. Once a new criterion
is saved the delete and edit icons for the criterion will appear on the right. Clicking the edit icon will take
you to a new screen that allows you to enter sub criteria and aspects.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

41 of 89

6.2 Adding a Sub Criterion


At the top right of the screen there are two boxes. The Total Sub Criterion marks box is the total
number of marks assigned to Sub Criteria in this Criterion. The Total cumulative marks box is the total
number of marks assigned to Aspects across all Sub Criteria on this screen.

Click the Add Sub Criterion button with the green plus sign to add a new sub criterion with the next
available ID. In the screenshot above sub criterion A1 has been created. There are a number of fields
for a sub criterion.
Marking Day This can be entered on this screen or on the separate Marking Days screen. See
section 6.8 for further details.
Sub Criterion Description A text description for the sub criterion
Max Mark The maximum possible mark for this sub criterion.
Marks Defined This is the total of all aspects defined for this sub criterion and should never be more
than the Max Mark field. As aspects are added to the sub criterion, this field is updated.
Remove Button The red minus icon removes the sub criterion from the criterion.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

42 of 89

The marking scheme for this criterion can be saved at any time on this screen by pressing the save
button at the bottom of the screen. To save the criterion and go back to the screen with the list of
criteria, click the save icon at the top right of the screen in the grey criterion bar (see screenshot below).

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

43 of 89

6.3 Adding Subjective Aspects

Click the Add Subjective Aspect button with the green plus sign to add a new subjective aspect. In the
screenshot above aspect A1.S1 has been created. There are a number of fields for a subjective aspect.
Aspect Description A text description for the aspect.
Max Mark The maximum possible mark for the aspect
Add Row This button adds an extra line of text to the aspect description. You can have as many of
these as you like.
Add Page Break The first icon under the Actions heading will add a page break after the aspect
description in the generated marking form PDF documents.
Remove Button The red minus icon removes the aspect from the sub criterion.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

44 of 89

6.4 Adding Objective Aspects

Click the Add Objective Aspect button with the green plus sign to add a new objective aspect. In the
screenshot above aspect A1.O1 has been created. There are a number of fields for an objective aspect.
Aspect Description A text description for the aspect.
Max Mark The maximum possible mark for the aspect
Requirements or Nominal Size Information about the required measurements
Marking Type For configuring mark calculations for the aspect. The default marking type is Direct
Mark Entry, which means that there are no calculations performed for this aspect. See section 6.5 for
further information on the different marking types.
Add Row This button adds an extra line of text to the aspect description. You can have as many of
these as you like.
Add Page Break The first icon under the Actions heading will add a page break after the aspect
description in the generated marking form PDF documents.
Remove Button The red minus icon removes the aspect from the sub criterion.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

45 of 89

6.5 Moving Aspects


Aspects can be re-ordered within a Sub Criterion or be moved from one Sub Criterion to another by
dragging the aspect to its new location. To drag an aspect, click near the symbol shown in the
screenshot below.

While still holding down the mouse button, you can drag the aspect to its new location within the Sub
Criterion. In the screenshot below, aspect A1O2 is being moved to the location after A1O5. Once the
mouse button is released the aspects will be re-ordered as well as being re-numbered to reflect the new
order.

In the same way, aspects can be moved from one Sub Criterion to another. Drag the aspect to
anywhere on the target Sub Criterion while holding down the mouse button. When the button is
released the aspect will be added as the last aspect in the Sub Criterion and re-numbered
appropriately. In the screenshot below aspect A1O5 is being dragged to Sub Criterion A2, where it will
become aspect A2O4.

Remember when moving aspects between Sub Criteria that the total marks for each Sub Criterion may
need to be adjusted.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

46 of 89

6.6 Objective Marking Types


CIS NG has the ability to perform various calculations on the values entered for an aspect to produce a
mark. For example, an aspect may measure the time taken to complete a task and award different
marks based on that time. At the point of entering data for each Competitor for this aspect, only the
value for the time taken would be entered and CIS NG would calculate the correct mark for the
Competitor.
Currently there are four different marking types.
6.6.1

Direct Mark Entry


This is the default marking type. No calculations are performed and marks are entered directly
in to CIS NG.

6.6.2

Ranged Score
This marking type calculates the Competitors mark based on how close a value is to a target
value. It provides the capability to define up to ten ranges of values and the amount of marks
to be deducted in each value range. If the Competitors value does not fall within any range
they awarded a mark of zero. There are several parameters for the marking type:
Target Value The ideal value the Competitor should achieve
Mark Deduction Type In each value range, whether to deduct a number of marks or a
percentage of marks
Range 1 .. 10 A number of ranges that define how many marks (or what percentage of
marks) are deducted for values that fall within the range

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

47 of 89

In the example screenshot above the height of a wall built by a Competitor is being measured.
The target height is 1200mm. The Competitors are allowed to be within +- 5mm, so the first
range deducts zero marks. The second range is for walls that have a height that is between +5mm and +-10mm and deducts 0.5 marks for the Competitor. The third range is for +-10mm to
+-20mm and deducts 2 marks. The fourth range is for +-20mm to +-30mm and deducts 5
marks. Any walls that have heights outside 1200mm +- 30mm will receive zero marks.
It is also worth noting that if a range defines a mark deduction that is greater than the
maximum mark for the aspect, a mark of zero will be awarded. It will not award negative
marks.
6.6.3

Percent Score Comparison


This marking type compares the results of all Competitors for this aspect and awards the
maximum mark to the Competitor with the best value and zero marks to the Competitor with
the worst value. All other Competitors receive a percentage of the maximum mark depending
on how close they are to the best value.

Selecting Percent Score Comparison from the marking type select box pops up the window
shown in the screenshot above. This allows you to determine whether the best value is the
highest value (for example furthest distance travelled) or the lowest value (for example the
fastest time).
Lets demonstrate this with an example. An aspect has been defined where the maximum
mark (5 marks) is awarded to the Competitor with the fastest time and zero marks are awarded
to the Competitor with the slowest time. To set up the calculation, the Percent Score
Comparison option is selected from the marking type drop down. In the parameters window
that then pops up, the option for Highest Mark to should be set to Lowest Value.
During the competition the fastest Competitor takes 10 seconds to complete the task, and the
slowest Competitor takes 26 seconds, giving us a time difference of 16 seconds. After the
times for all Competitors have been entered in to CIS NG the marks will be calculated as
follows.

6.6.4

Competitor

Time

Difference to
Slowest Time

Calculation

Mark

10

16

16 / 16 x 5 =

12

14

14 / 16 x 5 =

4.38

15

11

11 / 16 x 5 =

3.44

21

5 / 16 x 5 =

1.56

26

0 / 16 x 5 =

Stepped Score Comparison


This marking type compares the results of all Competitors for this aspect and awards the
maximum mark to the Competitor with the best value. Marks for other Competitors are then

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

48 of 89

deducted at a specified rate. If the number of marks to deduct works out to be more than the
maximum marks for the aspect the Competitor is simply awarded zero marks. The marks can
be deducted at stepped intervals or a proportional rate. There are several parameters for the
marking type:
Highest Mark to whether the maximum mark for the aspect goes to the highest value or the
lowest
Results Based On whether each step is measured as a numerical value or a percentage
Value or Percentage Interval the size of the step
Marks Deducted per Difference how many marks are deducted per step
Deductions are Proportional whether the evaluation is stepped or a steady rate
Lets look at a couple of examples.

In the screenshot above maximum marks are awarded to the fastest time, so the highest mark
is awarded to the lowest value. From the next three parameters it is determined that for every
5 seconds slower than the fastest time, the Competitor will lose one mark. Since the
deductions have not been marked as proportional, the marks are calculated in a stepped
fashion. So times 0 4 seconds slower than the fastest lose no marks, 5 9 seconds lose one
mark, and so on. If the maximum mark for the aspect is 4 there might be marks such as:
Competitor

Time

Num of 5 sec
steps from fastest

Calculation

Mark

10

4 (0 x 1) = 4

12

4 (0 x 1) = 4

15

4 (1 x 1) = 3

17

4 (1 x 1) = 3

23

4 (3 x 1) = 1

30

4 (4 x 1) = 0

41

4 (7 x 1) = -3

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

49 of 89

In the next example shown in the above screenshot maximum marks are awarded to the
highest number of watts of power output. The next three parameters show us that for every 5%
less than the highest power output, one mark is deducted. Since the deductions have been
marked as proportional, marks are reduced at a steady rate rather than stepped. If the
maximum mark for the aspect is 4 there may be marks like the following:
Competitor

Watts

% less than highest

Calculation

Mark

800

4 (0 x 1 / 5) = 4

783

2.125

4 (2.125 x 1 / 5) = 3.575

3.58

730

8.75

4 (8.75 x 1 / 5) = 2.25

2.25

699

12.625

4 (12.625 x 1 / 5) = 1.475

1.48

680

15

4 (15 x 1 / 5) = 1

620

22.5

4 (22.5 x 1 / 5) = -0.5

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

50 of 89

6.7 Importing Data


To import data from a file, click the Import Data menu item in the System section. There are a
number of types of data that can be imported.
6.7.1

Importing a Marking Scheme


The template for the marking scheme import file can be found on the CIS NG page of the
WorldSkills website. Alternatively you could export a skills marking scheme (see section 9.4.1)
and modify the resulting file (CIS NG exports marking schemes in the standard template). For
the Snowman Building skill the spreadsheet looks as follows:

CIS NG will import .csv, .xls and .xlsx files containing the marking scheme defined using the
Excel template.

Select Marking Scheme from the select box on the Import Data screen to produce the form
shown in the above screenshot.
Select Skill The skill to import the marking scheme to. If the current login only has access to
one skill, the drop down box will be replaced with the name of the skill.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

51 of 89

CSV Separator If importing a CSV file, enter the field separator character.
Excel or CSV file Select the file to import
Click the Import button to import the file. Any existing marking scheme for the skill will be
erased during import and replaced with the marking scheme in the file.
Please note that some users have encountered an error when importing a spreadsheet that is
currently open in Excel, so it is recommended that you close the spreadsheet in Excel before
importing the marking scheme.

6.7.2

Importing People
CIS NG will import .csv, .xls and .xlsx files containing the list of people.

Select People from the select box on the Import Data screen to produce the form shown in
the above screenshot.
CSV Separator If importing a CSV file, enter the field separator character.
Excel or CSV file Select the file to import
CIS NG will import files in the format used by the old CIS 2.x software or the new format. The
first row of a file in the new format is a row of headers that indicate to CIS NG what the content
of the column is. All headers are optional unless otherwise stated. The headers are:
wiw id WSI internal use only.
title The title of the person, for example Mr, Ms, Dr, etc
first name The first name of the person. This is mandatory.
last name The last name of the person. This is mandatory.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

52 of 89

initials The persons initials.


gender The values can be F or M.
dob The persons date of birth.
email The persons contact email address.
phone The persons contact phone number.
member The abbreviation of the member that the person belongs to, for example AE
position This is the name of a position defined on the Position screen (see section 4.7).
skill number The skill number of the skill that the person holds the position in.
username If the user is to have a login you can supply their username.
password If the user is to have a login you can supply their password.
usergroup If the user is to have a login you can supply the name of the usergroup to which
they will belong.

6.7.3

Importing Members
CIS NG will import .csv, .xls and .xlsx files containing the list of members.

Select Members from the select box on the Import Data screen to produce the form shown
in the above screenshot.
CSV Separator If importing a CSV file, enter the field separator character.
Excel or CSV file Select the file to import

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

53 of 89

The first row of a member import file is a row of headers that indicate to CIS NG what the
content of the column is. The headers are:
abbreviation The abbreviation of the member, for example their two digit ISO code.
name The name of the member.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

54 of 89

6.8 Setting Marking Days


Each Sub Criterion needs to provide information about which day it should have marking completed.
This can be done in the Assessment Criteria part of CIS NG (as shown in section 6.2) or it can be
done on the Marking Days screen as shown below.

There are three different types of Marking Days:


6.8.1

Specific Day
This is a specific day of the competition where all Competitors for the skill complete the sub
criterion. This is represented in the select box by entries such as Day 1, Day 2, etc.

6.8.2

Any Day
This means that the sub criterion can be marked on any day of the competition. In any
situation where a specific day has to be shown for the sub criterion the last day of competition
is selected. For example, in the PDF marking forms a sub criterion marked as being marked
on any day will show as being marked on the final day. It should also be noted that sub criteria
with this type of marking day will only have its marks locked when all marking days have been
locked.

6.8.3

Per Competitor
This option allows different Competitors to have this sub criterion marked on different days.
This is most often used for skills that are constrained by limited resources, such as skills that
have less equipment than Competitors and so require that Competitors use the equipment on
different days. Some skills also divide Competitors in to groups to do different modules on
different days.
When the Per Competitor option is selected from the select box the following window will be
displayed.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

55 of 89

Select the day of marking for each Competitor and click the Save button when complete.
6.9 Locking a Marking Scheme
Before any marks can be entered for a skill it must be locked. Once all Competitors and Experts have
been linked to the skill and the marking scheme is complete, go to the Skills & Skill Rules page (see
section 5.1) and check the Prevent further editing of marking scheme checkbox. Click the Save
button. The marking scheme for the skill can no longer be changed.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

56 of 89

6.10 Checking That Skills Are Ready For Mark Entry


To check that a skill is ready for mark entry it is easiest to view a report that gives us an overview of the
status of all skills marking schemes. To view the report, click on the Reports menu item located in the
Competition menu section. Then select the Marking Scheme Defined report.

This report shows for each skill whether the marking scheme has been locked, information about the
marking scheme such as the number of criteria, sub criteria and aspects it has, as well as information
about the marking days for the sub criteria. Skills that do not have a total of 100 marks defined appear
in a row with a red background.
In the above screenshot the Snowman Building skill has had its marking scheme locked as indicated by
the lock icon next to its name. The report also shows that all of the marking days have been defined by
the presence of the word Complete in the Marking Day column. This skill is ready to have marks
entered.
The Ice Sculpting skill in the screenshot also has a total of 100 marks defined. However, the marking
scheme has not been locked and sub criteria E4 and G1 dont have marking days selected. This skill is
not ready for mark entry.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

57 of 89

6.11 Marking Forms


CIS NG can generate a number of different PDF forms related to marking, such as forms for Experts to
record marks on while marking, forms with completed marks as recorded in the CIS, and a number of
signoff forms that are used to record Experts approval of marking schemes and mark entry.

6.11.1

Blank Forms

The generated PDF will contain one of each type of selected marking form containing no
marking scheme information. The three types of marking forms are:
Mark Summary Form This gives an overview of the marks achieved for each criterion and
sub criterion and indicates which day the tasks were assessed.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

58 of 89

Objective Marking Form For entering assessment data and marks for objective aspects

Subjective Marking Form For entering scores for subjective aspects.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

59 of 89

6.11.2

Marking Forms With Aspects

This option creates a single complete set of forms filled with criteria, sub criteria and aspect
information. Competitor information and marks are not included in these forms.
If you have access to more than one skill you will see a select box for choosing the skill to
generate forms for. You can also choose whether to generate forms that include all sub criteria
or just a single sub criterion. The forms can also be filtered to be generated for a single day of
the competition.
Here are some example forms for Snowman Building

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

60 of 89

If the marking scheme has not been locked, a Draft watermark is added to all pages to
indicate that the marking scheme has not been finalised.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

61 of 89

6.11.3

Marking Forms for Hand-Written Marks

This set of forms is for Experts to use on the workshop floor when recording marks. These
forms contain Competitor information at the top of each form.

The default options on the form will generate a document that contains marking sheets for
every Competitor in the skill. The form can be filtered to generate for a single sub criterion,
competitor, day or combination of all three.
The Collate Marking Forms By drop down box allows the user to choose how the forms are
grouped within the generated PDF document. The forms can be grouped by Sub Criterion,
Competitor or by Day.So in the screenshot above, the PDF document would contain forms for

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

62 of 89

all Sub Criteria for all Competitors for all days, starting with Sub Criterion A1 for all
Competitors followed by A2 for all Competitors and so on.
The Hide Requirements data from Objective Marking Forms checkbox will cause the
requirements column in the generated Objective Marking Forms to be greyed out. This option
exists because the requirements field may contain information that should not be revealed to
the Competitor, so it needs to be removed from the copy given to the Competitors at the start
of the Competition.

6.11.4

Landscape Forms for Hand-Written Marks

Some skills may require a marking form that allows them to mark multiple competitors for the
same aspect at the same time. This form lists the aspects down the left of the page, has space
for multiple competitors across the page and is in landscape format (as opposed to portrait).

These forms are harder to use when entering the data in to the CIS and should only be used if
absolutely necessary.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

63 of 89

6.11.5

Marking Forms With Aspects And Marks

This option creates a set of forms that contains all the criteria, sub criteria and aspect
information, as well as mark information. It will create a set of forms for each Competitor.

If you have access to more than one skill you will see a select box for choosing the skill to
generate forms for. You can also choose whether to generate forms that include all sub criteria
or just a single sub criterion. You can choose to generate forms for all Competitors or a single
selected Competitor. You can also choose to generate forms for a particular day.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

64 of 89

The Collate Marking Forms By drop down box allows the user to choose how the forms are
grouped within the generated PDF document. The forms can be grouped by Sub Criterion,
Competitor or by Day.So in the screenshot above, the PDF document would contain forms for
all Sub Criteria for all Competitors for all days, starting with Sub Criterion A1 for all
Competitors followed by A2 for all Competitors and so on.
If the marks have not been locked (see section 8.4), a Results Incomplete watermark is
added to all pages to indicate that the marks have not been finalised.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

65 of 89

6.11.6

Signoff Form for Marking Scheme

This form is a PDF document that lists each Expert for the skill and provides a space for them
leave a signature to indicate their approval of the marking scheme. This form can only be
generated once the marking scheme has been locked.
At the top of the form is the timestamp of when the marking scheme was locked. This
timestamp also appears on each of the marking forms outlined above. This allows us to check
that the aspects on the marking forms being used to mark the Competitors work are exactly
the same as the ones signed off by the Experts. If the timestamps do not match, then the
marking scheme has been altered in some way since the Experts signed the form.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

66 of 89

6.11.7

Signoff Form for Mark Entry

This form is a PDF document that lists each Expert for the skill and provides a space for them
leave a signature to indicate their approval that marks for their compatriot Competitor have
been entered in to the CIS correctly.
The user can select which day they would like to generate the form for. Days only appear in
the drop down once marks have been locked for that day.
At the top of the form is the timestamp of when the mark entry was locked for that day. This
timestamp also appears on each of the marking forms outlined above. This allows us to check
that the marks on the marking forms being are exactly the same as the ones signed off by the
Experts. If the timestamps do not match, then the marks may have been altered in some way
since the Experts signed the form.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

67 of 89

MULTI-SKILLS
Multi-Skill competitions allow the combination of several skills form a multi-skill. Multi-Skills dont have a
marking scheme and do not have marks entered for them. Instead they combine the results from each
skill for a Multi-Skill Team to arrive at a mark.
For example, in the EuroSkills competition there is a multi-skill named Cross Media Publishing that is
comprised of the Web Designer, Graphic Designer and Print Technician skills. To determine the mark
for the Belgian multi-skill team, the CIS takes the marks for the Belgian Competitor in Web Design, the
Competitor in Graphic Design and the Competitor for the Print Technician skill, weights them
accordingly and arrives at a mark out of 100 for the Belgian team.
Once multi-skills have been created, they will appear in various reports and results pages along with
ordinary skills.

7.1 Activating Multi-Skill functionality


The multi-skill functionality must activated on the Config screen before any multi-skills can be set up.
Once activated the Multi-Skill menu section will be available. See section 4.4.7 for more detail on the
Config screen

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

68 of 89

7.2 Creating a Multi-Skill


The Multi-Skills link in the menu leads to a screen that allows the creation and editing of multi-skills. In
the screenshot below a multi-skill called Frozen Water Construction has been created.

The first drop down field at the top of the page contains a list of the existing multi-skills. To edit a multiskill select it from this drop down.
The multi-skill has been assigned a skill number and given a name in English. The Exclude from
member results comparison checkbox will exclude that particular multi-skill from the member results
(see section 10.8). To exclude all multi-skills from the member results, simply leave the relevant
checkboxes on the Config screen unchecked. See section 4.4.8 and 4.4.9.
The next section of the screen is for adding ordinary skills to the multi-skill. All of the ordinary skills
appear in the drop down box. The Proportion field indicates what proportion of the multi-skill marks are
taken from that skill. Any whole number can be entered in this field. When calculating the multi-skill
mark for a team, the amount from each skill is calculated by taking the competitor result for the skill and
multiplying it by the proportion divided by the total of all the proportion values. So using the example in
the screenshot above, the Snowman Building skill has a proportion of 2 and the total of all the
proportion values is 3 (2 for Snowman Building plus 1 for Ice Sculpting), meaning that two thirds of the
marks for the multi-skill are taken from Snowman Building. Since any values can be used for the
proportion, it would also be valid to use values like 66 for the Snowman Building and 33 for Ice
Sculpting, approximating the percentage values. The result would be the same.
To remove a skill from the multi-skill, simply click the red minus button to the right of the proportion field.
The buttons at the bottom of the screen are for creating a new multi-skill, saving the current multi-skill
and deleting the current multi-skill.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

69 of 89

7.3 Multi-Skill Teams


The Multi-Skill Teams link in the menu takes the user to a page that allows them to select the
competitors for each skill to assemble in to a multi-skill team.

The multi-skill that teams are to be made for must be selected before the rest of the form will appear.
The Multi-Skill Team drop down box contains a list of existing teams for the multi-skill. Select one to
edit it.
A name for the team can be specified. If the name field is left blank, the name of the Member is used
instead.
Each multi-skill team must have a Member. Often this is as straight forward as choosing one of the
regular Members from the Member drop down, but occasionally teams need to be created that contain
Competitors from different Member organisations. In this case a pseudo-member is required. A
pseudo-member is a type of Member that only exists in the context of multi-skills and is used solely for
grouping together competitors from different Members. Once a pseudo-member has been created it will
appear in the drop down lists for multi-skill screens, so it can be re-used for other teams if desired. For
example, in the EuroSkills competition they often use a pseudo-member named Europe (EUR) when
creating teams that have Competitors from different Member organisations.
When multi-skills are included in the member results (see section 10.8), the points and medal points for
pseudo-members are divided among the members of the teams.
The Assign Team Members section is for selecting the Competitors for each of the skills to be
included in the multi-skill team. The drop down box for each skill contains a list of Competitors that
havent been assigned to any multi-skill teams for this skill.
The New button creates a new empty team, the Save button saves the current team, and the
Delete button deletes the current multi-skill team.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

70 of 89

7.4 Multi-Skill Results


7.4.1

100 Scale Marks


All multi-skills will have 100 scale marks that are calculated using whatever marks have been
entered in the ordinary skills up to the present moment. These marks can be viewed on the
View Marks screen (see section 9.1). The multi-skills appear in the skill drop down box at the
end of the list, after a dotted line as shown in the screenshot below.

When viewing the marks for a multi-skill it will only display the total marks, not the marks for
the daily totals and not the marks per Criterion.
7.4.2

500 Scale Marks


500 scale marks are generated for multi-skills once all the skills contained within the multiskills have locked each day of marking. The multi-skills are in the skill drop down box the same
way they are in the 100 scale mark page.
All the operations that you would perform on this screen on an ordinary skill (see section 9.2)
are available with multi-skills as well. The CIS NG software treats the multi-skill as if it were an
ordinary skill.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

71 of 89

DURING THE COMPETITION

8.1 Manage Application


The Manage Application menu item in the System section of the menu takes you to a screen that
gives an overview of all the users logged in to CIS NG and some basic server information.

In the above screenshot the admin user and Expert One are logged in. The report shows that Expert
One is an Expert in the Snowman Building skill. If the users name is clicked on the user interface is
redirected to the Edit Person screen (see section 5.3) for that user. Either of the users can be logged
out by clicking the Logout link at the end of their row.
From this screen it also possible to send a message to a group of users. Select the users you wish to
send a message to, type the message in the text area and press the Send button. Each of the users
will receive the message in a red box in the top right of the screen, similar to how an error message
looks. The message will disappear after a short period of time, or the user can close the message
themselves.
At the bottom of the screen is the version of the CIS NG software and the version of the Java virtual
machine that the software is using.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

72 of 89

8.2 Entering Marks


Click on the Enter Marks menu item in the Assessment section of the menu to start entering marks.

Lets take a look at the different parts of this screen.


8.2.1

Competitor Information
This section contains the summary information for the currently selected Competitor.

The first box indicates how many aspects have been marked in the current sub criterion for the
selected Competitor. The second box tells us how many marks have been entered for the
Competitor overall. The third box represents the amount of marks entered as a percentage.
The final box gives us the Competitors name. If there has been an image uploaded for the
Competitor, it will appear here above their name.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

73 of 89

8.2.2

Sub Criterion Selection


This part allows us to select a sub criterion for a particular Competitor.

If the user has access to more than one skill they will see the select box as in the screenshot
above to allow them to select the skill to enter marks for. Otherwise the name of the skill the
user has permission to enter marks for will appear there.
The Assessment Sub Criterion select box will only list sub criteria available for the selected
Competitor on the selected day. This information comes from the Marking Day information
entered for each sub criterion (see section 6.8). Changing the selected day or Competitor may
result in a completely different list of sub criteria in the select box. Selecting a sub criterion will
update the objective marking form and subjective marking form with the aspects contained
within the sub criterion.
Either side of the Competitor and Assessment Sub Criterion select boxes are arrow
buttons. These can be used to scroll to the next or previous item in the list.

8.2.3

Objective Mark Entry

This form is for entering values and marks for objective aspects. Value fields may be left blank
unless they are calculated marks (see below). The arrow keys or tab key can be used to move
between fields. While marks can be entered by simply typing in the digits, there are shortcuts if
the Competitor received full marks or zero marks. If the Competitor received full marks for the
aspect, simply type y in the mark field. CIS NG will convert it to the maximum mark for the
aspect. If the Competitor received zero, an n can be entered in the field and it will be
converted to zero. This allows marks to be entered quickly by simply typing y or n and using
the down arrow key.
In the screenshot above the first aspect has a triangle icon before the description. This
indicates that the description can be expanded to see extra description lines. Clicking on the
triangle expands the description.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

74 of 89

The above screenshot shows what mark entry looks like for calculated marking types. You will
notice that there is a value field but no mark field. In place of a mark field there is a clock icon.
This indicates that a mark cannot be calculated for this aspect until all Competitors have had
their values entered.. Once all Competitors have had their values for the aspect entered in to
CIS NG, the form will look like this:

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

75 of 89

8.2.4

Subjective Mark Entry

This form is for entering scores for subjective aspects. CIS NG calculates the final mark based
on the subjective judging rules for the skill.
In the above screenshot is a skill that has a subjective marking rule set that requires five
judges, so there is space for five scores for each aspect. Once all five scores for the aspect
have been entered and saved, the clock icon in the Mark Awarded column will be replaced
with the resulting mark. The mark is calculated according to the subjective marking rules
selected for the skill (see section 5.1.3). So for our example competition, the highest score and
lowest score will be ignored. The average of the remaining three scores will be used to
determine what percentage of the maximum mark for the aspect is awarded to the Competitor.
This skill has also been set to identify judges when entering subjective scores (see section
5.1.4) so the member abbreviation of the Expert who gave the score is shown next to each
score entered. In the screenshot the Austrian Expert gave a score of 5 and the Japanese
Expert gave a score of 8. How is the Expert set? At the top of each column there is an icon
that resembles a person. If this icon is clicked a drop down list of all Experts for the skill
appears. When an Expert is clicked their member abbreviation appears next to the icon. In the
screenshot above the third judge has been set to the Mexican Expert (MX). Any new scores
now entered in the third column will be attributed to the Mexican Expert. Note that this only
applies for entering new scores. For example, if the judge for the first column is changed to the
Indian Expert, the first score for aspect A1.S1 will still be attributed to the Austrian Expert. If a
score is now entered in the first column for A1.S2 it will be attributed to the Indian Expert. See
the screenshot below.

If a Competitor has not attempted a subjective aspect, they can be given a mark of zero by
checking the Non Attempt checkbox that appears to the left of the score fields as shown in
the screenshot below.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

76 of 89

8.3 Marking Progress and Missing Marks


There are two reports that are useful for tracking mark entry for each skill. They can be accessed from
the Reports screen.
8.3.1

Marked Aspects Report


This report shows the number of marks entered for each criterion for each skill.

The screenshot above shows the marks entered for the two skills in the example competition.
The numbers are arrived at by adding the number of mark entries for each Competitor. For
example, there are 5 aspects contained in criterion H of the Snowman Building skill and there
are 5 Competitors, giving us a total number of expected marks of 25.
Cells that are highlighted in yellow indicate that the marks for that criterion are incomplete. In
the screenshot above there havent been many marks entered so all cells are highlighted.
The last cell in the row indicates what percentage of marking has been done for the skill in
total.
Clicking on the contents of a cell pops up a window that breaks down the number of marks
entered for each aspect of the criterion. In the screenshot below there have only been marks
entered for 4 of the 5 Competitors in aspect A2.O1.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

77 of 89

8.3.2

Missing Marks Report


This report is for tracking down marks that may have been accidentally missed during mark
entry. It shows the number of marks entered each day for each Competitor. Incomplete marks
are highlighted in yellow.

In the above screenshot Competitor Five is missing a mark from Day 1. Clicking on the
contents of the cell for Competitor Five for Day 1 will pop up a window showing all the aspects
the Competitor was supposed to receive marks for.

This shows that Competitor Five is missing the mark for aspect A1.O3.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

78 of 89

8.4 Locking Marks


Once all marks have been entered for a day they should be locked to prevent further mark changes. On
the Enter Marks screen all objective and subjective mark fields for locked days will be disabled, so
marks can be viewed but not changed.
To get to this screen click the Lock Marks menu item in the Assessment menu section.

Days that have had all marks entered and are ready to be locked appear with a green background. To
lock the marking for that day, click on the word Unlocked in that cell. The word will change to Locked
and the cell background will change to grey. If there are no marks to be entered for a day then the cell
will be blank.

By default the Lock Marks screen will show the locks for the first skill in the drop down list. There is an
option in the drop down to show the lock status of all skills at once, but this may take some time to
generate if there are many skills.
Once all days have been locked the 500 scale results will be generated (see section 9.2).

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

79 of 89

AFTER MARK ENTRY

9.1 Viewing Marks


Marks on the 100 scale for each Competitor can be seen on the View Marks screen located in the
Assessment section of the menu.

Next to the skill select box is a second select box that provides several options for viewing the marks:
Total Marks Only Shows just the total for each Competitor
Include Daily Totals Shows the total mark as well as the totals for each day
Include Marks For Each Criterion Shows the total mark as well as the total marks for each criterion
The View Marks screen can also be seen during the course of the competition to show marks to that
point in time.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

80 of 89

9.2 500 Scale Marks & Medals


Once the marks for all days have been locked for a skill CIS NG will generate the 500 scale marks.
These can be viewed by clicking the Results menu item in the Assessment menu section.

CIS NG will automatically assign medals to the appropriate Competitors, as can be seen in the
screenshot above. These can be changed manually by selecting a different medal from the select box
and clicking the Save button.
Occasionally it may be necessary to adjust a Competitors mark, for example to apply a penalty. To do
this, click the green plus icon in the Adjustments column. The following window will pop up.

There are three different adjustment types:


Fixed Value Sets the 500 scale to a specified value

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

81 of 89

Deduction Deduct the specified number of marks from the 500 scale mark
Percent Deduction Deduct the specified percentage of marks from the 500 scale mark.
When the adjustment is saved, the marks are recalculated and medals re-assigned. The adjustment
appears in the Adjustments column. In the screenshot below a 15% penalty has been applied to the
Mexican Competitor.

9.3 Competitor Certificates


CIS NG can generate a certificate for each Competitor that shows a summary of their marks, their final
500 scale score and their position in the skill. Clicking on the Certificates link in the menu presents the
following screen.

The form can be left blank to generate a certificate for every Competitor in the competition, or list of
certificates can be filtered by skill and by Member.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

82 of 89

9.4 Exporting Data


To export data to a file, click the Export Data menu item in the System section. There are a number
of types of data that can be exported.
9.4.1

Exporting a Marking Scheme


A skills marking scheme can be exported to the standard skill template. The exported file is
able to be altered and/or imported in to CIS NG (either the same competition or a different
one) without any further editing of the file (see section 6.7.1 for more details on importing a
marking scheme).

9.4.2

Exporting People
All of the people data stored in CIS NG is able to be exported to either an Excel spreadsheet
or a CSV file. The exported file is in the correct format to be uploaded to CIS NG (see section
6.7.2). Please note that passwords are not included in the exported file.

9.4.3

Exporting Members
All members stored in CIS NG are able to be exported to either an Excel spreadsheet or a
CSV file. The exported file is in the correct format to be uploaded to another competition in CIS
NG (see section 6.7.3).

9.4.4

Exporting Results
The Competitor results for each skill can also be exported to an Excel spreadsheet. There is
also an Export medallists only checkbox that allows the user to hide any results that arent
medals.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

83 of 89

10 REPORTS
10.1 Experts Head to Head
This report provides an analysis of the subjective marking of each Expert for a skill. It shows the
number of assessments performed by each Expert, the number of times they gave the highest and
lowest scores, and the number of times they were above or below the average score. Clicking on the
name of an Expert will display the Marks by Single Expert report for that Expert.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

84 of 89

10.2 Marks by Single Expert


This report provides an analysis of subjective marking performed by a single Expert. It shows the
number of assessments the Expert performed for each Competitor, the number of times they gave the
Competitor the highest or lowest score, and the number of times they gave scores above or below the
average score.

10.3 Analysis of Experts


This report is another that provides analysis of subjective marking. There are four different
measurements that can be viewed: highest score, lowest score, above average score, below average
score.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

85 of 89

10.4 Skills Comparison


This report is for comparing statistics such as highest mark, average mark, etc between skills. Any
number of skills can be added to the report.

10.5 Proportion of Objective to Subjective


This report shows the number of objective and subjective aspects for each skill. It can display the
overall number for the skill or break it down to show per criterion.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

86 of 89

10.6 Range of Marks


This report is used to assess whether the skill had an appropriate level of difficulty and produced a
sufficient spread of marks. Each Competitors mark is broken down by criterion and displayed as a
chart, as well as having various statistics like average mark and median mark for each criterion.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

87 of 89

10.7 Albert Vidal Award


This report determines the top Competitor across all skills by comparing marks in the 500 scale.

10.8 Member Comparison


This report screen is used to generate PDF documents that rank the various members. There are five
different comparison reports: Member (ordered alphabetically), Total Medal Points, Average Medal
Points, Total Point Score and Average Point Score. Each report shows the number of Competitors for
each member and the total number of each medal type the member gained.
10.9 Member Medal Totals
This report screen is used to generate a PDF document that lists the Competitors for each member and
what their 500 scale mark was and what, if any, medal the Competitor won.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

88 of 89

10.10

Official Results

This report screen is used to generate a zip file containing all of the official results PDF documents. It
contains reports such as the Albert Vidal Award, the member comparison reports, the marking forms for
each skill grouped by member and skill, etc.

The File Prefix field supplies a prefix for each of the generated PDF file names. The field accepts
standard filename characters and has no restriction on length.
There is also a field for selecting a temporary folder to be used while generating the results. By default it
selects a path within the competitions images folder. The folder used should be empty. Since the
generation of the official results can be a lengthy process, CIS NG assumes that if there are already
files in the folder then someone else is in the middle of generating official results using the same folder
and it wont proceed. The user will receive an error notifying them that it cannot generate the results.
10.11

Mark Entry Times

This report screen is used to generate an Excel spreadsheet that shows the percentage of marks
entered for each skill over time.

CIS NG User Guide


WSI_UG01_CIS

Version: 1.4
Date: 16.11.11

89 of 89

You might also like