Data Loading...
COMPASS-BIFA User Manual Flipbook PDF
COMPASS-BIFA User Manual
139 Views
185 Downloads
FLIP PDF 1.65MB
COMPASS
Revision: 07 May 2020 Teuku Otman
Navigation Menu
225 kalimat, 120-150 menit ?????, 120-150 menit 25 paragraph, 30-45 menit 73 pertanyaan, 45-60 menit
COMPASS The COMPASS test measures the following competencies: 1. Eye-hand-foot co-ordination (Control) 2. Eye-hand co-ordination (Slalom) 3. Short term memory (Memory) COGNITIVE 4. Mental arithmetic (Mathematics) 5. Spatial Orientation (Orientation) 6. Multi Tasking (Task Manager) Optional: 1. Technical Comprehension (TechTest) 2. English for aviation (Conversation) 3. Verbal Reasoning (Verbal Reasoning) 4. Grammar 5. Listening
COGNITIVE
COGNITIVE • The cognitive abilities are assessed by MATHS and MEMORY. • Training organisations and airliners, besides these tests provided in COMPASS, can also make use of the Verbal Reasoning test and the TechTest. Further tests of Grammar, Listening and Conversation are available to assess the cognitive abilities of a candidate
MOTORIC • As well as cognitive abilities, good senso-motor skills are important in order to learn to fly. • Individuals with good flying aptitude will show as students that they learn more easily and faster than those who lack potential flying aptitude. For flying training organisations and airlines newly trained and licenced pilots will have to adjust to new (technical) situations and aircraft types. Pilots with a good flying aptitude learn new tasks faster, thus saving valuable training time and expenses. • The operational flying capabilities of candidates is assessed by flying aptitude tests, such as multi tasking (TASKMANAGER), spatial orientation (ORIENTATION), and eye-hand-(foot) co-ordination (CONTROL, SLALOM and CCT?).
2. Results of COMPASS • The results of the COMPASS tests are automatically computed by the system. • Computing the COMPASS scores of the test is a result of a statistic formula, based on a reference group of men and women in the age range 16 to 30 years old and who possess university entrance level academic qualifications. • The test results are presented in a grading from 1 to 7. – – – –
1 and 2 means below average 3 means just below average 4 means average 5, 6 and 7 means above average
2.1. Norms of COMPASS The norm EPST uses for cut-off is based on the total score of COMPASS, computed by the sum of the 6 basic tests: Control, Slalom, Memory, Maths, Orientation and Taskmanager. Based on 15 years of experience, EPST has set the cut off at the total sum of 24, in case of pre-selection. Pre-selection is followed by a simulator session (?). The total of the grades indicates the overall strength of the candidate’s performance. A total of 24 indicate an average overall performance. A grade total of 24 or above combined with grades of 3 or better in all the tests indicates a general aptitude for typical piloting tasks. A student with a sum less than 24 is highly likely to fail the SIM, as Figure 1 shows. However, note that a score lower than 24 is more or less a guarantee for failure, yet a score more than 24 does not guarantee success. It not only takes ability and flying aptitude to succeed, but also determination, motivation, a good personality and a lot of effort. If you do not make use of a simulator session and make use of COMPASS as a solely selection tool, EPST sets the cut off at a total score of 32 (!!!). As you can see in Figure 1, this cut-off is a good indicator for a successful training of a student.
PASS RATE
24
24 Plus Simulator Test
32
32 Without Simulator Test
3.3 Setting thresholds for COMPASS The results of the basic 6 tests are, using the cut-off of the best 50%: • In general 24 (this meets the cut-off used by EPST) • North America 21 • South America 18 • Africa 11 • Europe 25 • Oceania 24 • Asia 23 Note that the results of Africa are based on a relatively small population. Therefore these results have a reliability of 90% (instead of 95% or 99% for the other results).
4. Interpretation of the COMPASS score reports • •
The scores of the test performance of a candidate are graded from 1 (the lowest) to 7 (the highest). On the individual (Advanced) COMPASS reports the grade a candidate achieved is printed next to each of the tests. There is also a total grade mark underneath the test grades.
•
The score report also shows a graphic, which shows the obtained results for every single test. If you have set a threshold, the threshold settings create a red background in the result sheet so that you can see immediately if a candidate obtained the required scores.
•
If a candidate meets the required standard in general, yet failed one of the tests, you can decide to have the candidate retested for that single test. If he/she fails again, you can conclude that part of the requirements is not possessed by the candidate and put emphasis on it during training.
•
Mathematics, Memory and Orientation are considered to be intellectual abilities. In order to get a quick overview over a situation, sufficient general intellect is required. Overall, ability is fairly hard to develop. Especially for captains it is even more important to be able to realise the consequences of matters. Perseverance, effort and good preparation for the work are essential if problems in the intellectual level are present.
•
The eye-hand as well as the eye-hand-foot co-ordination (Control, Slalom and CCT) and Taskmanager are senso-motor skills. Those skills are required to handle an airplane smoothly and accurately.
4. Interpretation of the COMPASS score reports •
Both types of competencies can be improved by effort, perseverance and experience. However, a person having severe difficulties in mathematics for example will prove not to be an expert in numerical insight, even after training. For example, if a candidate has a good ability (average to above average scores on the tests Mathematics, Memory and Orientation), yet below average scores on the flying aptitude tests (Control, Clalom, CCT and Taskmanager), the candidate is expected to perform well during the theoretical part of the training or will get the overview quickly during the flight process, yet might have some difficulties in the physical performance during the flight. Simulator training can improve that performance.
•
Otherwise, if the flying aptitude is well developed, but a candidate performed less on the mental ability tests, it will take him/her some more time to get insight in information and as a consequence is expected to need more time to fully understand the situation, or needs more time and effort to success in the theoretical part of the training.
•
It appears that the results on the tests improve after successfully completing the flight school and being a (commercial) licenced pilot. Examination of the test results over the past two years shows an improvement of 54% (5% of the results decreased).
•
–
The scores for Mathematics increased 24%.
–
The scores for Memory also increased 24%.
–
The scores for Orientation increased 13%.
–
The scores for Taskmanager increased 2% (this may be due to the fact that the initial mean is high).
This may be an indication that practise can improve the operation.
6. CPP (Checklist Professional Profile) •
The personality of a student is quite important. Not only his/her intelligence and flying aptitude determine whether they will make their flight training into a success. Determination, discipline and motivation are important as well.
•
Since investigation shows that incidents and accidents in aviation for the most can be attributed to human failure, airliners and flight training organisations are interested by the personality of pilots.
•
A pilot is required to make major decisions during flight preparation and the actual flight. Especially when problems occur, a pilot will have to stay calm and will have to be able to get an overview of the situation quickly. Therefore, emotional stability, as well as leadership and conscientiousness are essential competencies.
•
EPST provides the CPP in order to assess the personality of candidates. CPP (Checklist Professional Profile) is a personality questionnaire, especially developed for screening ab initio as well as experienced pilots. During a follow up procedure (interview, COMPASS etc.) one can use the results of the questionnaire as a guideline for more specific questioning and observation.
•
Furthermore, this instrument can be applied as a departure point for training or coaching procedures of both ab initio and trained pilots.
6. CPP (Checklist Professional Profile) EPST provides the CPP in order to assess the personality of candidates. CPP (Checklist Professional Profile) is a personality questionnaire, especially developed for screening ab initio as well as experienced pilots. During a follow up procedure (interview, COMPASS etc.) one can use the results of the questionnaire as a guideline for more specific questioning and observation. Furthermore, this instrument can be applied as a departure point for training or coaching procedures of both ab initio and trained pilots. The automated report distinguishes four groups of competencies: the core competencies, the primary competencies, the personal competencies and the relational competencies. Within those four groups nine specific competencies are defined: 1. Core competency (most important competency): 1.
Personal stability
2. Primary competencies (crucial factors): 1. 2.
Conscientiousness Leadership
3. Personal competencies (have to be balanced): 1. 2. 3. 4.
Executive orientation Team orientation Decision making process Communication
4. Relational competencies: 1. 2.
Service orientation Sociability
7. Re-take of tests •
In general, it is important for candidates to be fit on the day of the assessment. Not feeling good, being ill, lack of sleep or other kind of inconveniences may affect the results in a negative way. Also it is important to be disciplined and dedicated. Sometimes candidates think the test will be easy or of no importance and therefore give not their best. We advise you to put emphasis on this matter when you invite candidates to do the assessment.
•
Re-take of the COMPASS tests on the day of the assessment is indicated (and can be provided by EPST without additional expenses) when: – –
a technical failure occurred during the test period. all results of a candidate show a good performance (F.E. all results are 5, 6 or 7), except for one or maximum two tests.
•
In the case of candidates who fail the test, it is possible to re-take the test after some period of time.
•
For COMPASS we recommend you to allow a re-test no sooner than after 3 months. This decreases the testretest effect, which may influence the outcome of the results. Furthermore, we advise you to allow only 1 re-take.
•
The re-take of the personality assessment by CCP can only be done after 1 year. Filling in the personality questionnaire can hardly be done wrong. A person is the way he/she is. Psychologists in general agree on the fact that the personality of an individual is a steady factor that is shaped until approximately a person has reached the age of 30. That means that under the age of 30 an individual can grow. Yet, this has to be given reasonable time. Therefore it is rather reasonless to re-take CCP before a wait of 1 year.
SUMMARY REASON ING
COMPASS (motoric)
Eyehandfoot coordin ation (Cont rol)
Eyehand coordin ation (Slalo m)
Spati al Orien tatio n (Orie ntatio n)
Multi Taski ng (Task Mana ger)
CCP (personality)
(cognitive)
Short term mem ory (Me mory )
Ment al arith metic (Mat hema tics)
Core XX
VV
comp etenc y
Primary competencie s
Consci entiou sness
Leader ship
competencie s:
competencies
Technical Comprehension (TechTest) Perso nal stabilit y
Relational
Personal
Execut ive orient ation
Team orient ation
Decisi on makin g proces s
Comm unicati on
Servic e orient ation
Sociab ility
CPP Report
CPP Report
CPP Report
CPP Report
COMPASS Report Urutan test COMPASS 1. Spatial Orientation (Orientation) 2. Multi Tasking (Task Manager) 3. Eye-hand-foot co-ordination (Control*) 4. Eye-hand co-ordination (Slalom*) 5. Short term memory (Memory) 6. Mental arithmetic (Mathematics) 7. Technical Comprehension (TechTest) add * dengan joystick dan pedal
Aviation English and Verbal Reasoning Report
BIFA-COMPASS Criteria (?) • MOTORIC (COMPASS) => Skill – COMPASS Score
: >32
• COGNITIF (VERBAL REASONING and TECHTEST) => Knowledge – VERBALREASONING Score – TECHTEST Score
: >4 (1-7) : >6 out of 15
• PERSONALITY (CPP) => Attitude – CPP Advice
: >Minor Concern
• OTHER – AVIATION ENGLISH (?)
: ??
SEKIAN