Efqm Self Assessment
Efqm Self Assessment
Efqm Self Assessment
EUROCONTROL EXPERIMENTAL
CENTRE
EFQM SELF-ASSESSMENT
2003
AWARD SIMULATION APPROACH
Version 2.0
02 May 2003
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2003 version 2.0
DOCUMENT APPROVAL
The following table identifies all management authorities that have successively approved the present
issue of this document.
DOCUMENT CONTROL
1.0 04 March 2002 List 1 below 2002 edition submitted for external assessment.
1.1 16 August 2002 Eric Watkins Incorporation of extensive comments from DEEC.
1.2 21 April 2003 List 2 below First consolidated draft for the 2003 exercise.
2.0 02 May 2003 List 2 All chapters updated, comments from core
management members included.
2003 edition submitted for external assessment
List 1 List 2
Page 2 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2003 version 2.0
TABLE OF CONTENTS
OVERVIEW ...................................................................................................................................................4
1 LEADERSHIP ...........................................................................................................................................10
2 POLICY AND STRATEGY .......................................................................................................................18
3 PEOPLE ...................................................................................................................................................24
4 PARTNERSHIPS AND RESOURCES .....................................................................................................30
5 PROCESSES ...........................................................................................................................................39
6 CUSTOMER RESULTS ...........................................................................................................................45
7 PEOPLE RESULTS..................................................................................................................................48
8 SOCIETY RESULTS ................................................................................................................................51
9 KEY PERFORMANCE RESULTS............................................................................................................53
GLOSSARY .................................................................................................................................................60
Page 3 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2003 version 2.0
OVERVIEW
This submission is being made at a time when the Competition for the EEC has been virtually non-
EEC is undergoing an important transition. Major existent since both ATC service provision and
initiatives have taken place in the ATM sector national research and development centres were
namely the ACARE initiative of the European government activities. Cooperation and
Commission and the formation of new industry collaboration has taken place but the absence of
alliances. In order to meet the challenges of this an overall view and management of research and
rapidly changing context, the EEC conducted a far development in Europe, has led to duplication and
nd
reaching strategy review in the 2 half of 2002 overlap of activities and wasted investment.
followed by a reorganisation to align the EEC
structure with the revised strategy. The former 9 Since the beginning of the 90s, many States have
business areas (pre 2003) were readjusted and privatised or corporatised their ATS providers
consolidated into 6 business areas in order to fully and/or their R&D Centres. The EEC now finds
align with ACARE and the revised ATM2000+ itself in an environment where competition and the
strategy. This transitional situation should be kept need to demonstrate cost effectiveness must be
in mind by the reader. carefully married with collaboration to ensure the
most efficient use of the overall European
investment in ATM research and development.
History
The EUROCONTROL Experimental Centre (EEC) In this context, the EEC has regularly reviewed its
was officially established as an external service of position and its role. Extensive discussions with
the EUROCONTROL Agency on 10 June 1963. the main stakeholders, through the EEC
The initial responsibilities were defined as: Consultation Group took place to define for each
• operational research and the testing of ATC type of activity the funding, the work allocation
methods mechanisms and the EEC role. The EEC does
• operational demonstrations of the validity of hold a unique position in European ATM, it being
the ATC system proposed the only European ATM R&D establishment, but
• operational and technical evaluation of control nevertheless in many aspects it is a peer among
centre equipment several players.
The EEC was the first establishment in the world Over many years, the EEC has gradually build a
to execute a totally digital real time simulation for strong partnership with the European
ATC. Commission. In Q1 2003 after long negotiations
inside and outside the Agency, this partnership
The resources and scope of the EEC have been has been further consolidated with EATM, and the
gradually increased over the years and the EEC EEC has been given full responsibility for ATM
has become a leader in the provision of ATM R&D in Europe. This transition, referred to at the
simulation services and a major ATM/CNS R&D beginning of this chapter, will see the EEC and
centre. the European Commission constitute a Joint
Programme Board which will oversee ATM R&D
Page 4 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2003 version 2.0
in Europe articulated through an ATM R&D and to set short-term capacity targets for ANSPs.
Master Plan. Detailed working arrangements are Other projects explore the feasibility and benefits
currently being developed. of new airspace organisations, and new working
methods as applied to current operational
systems, and recommendations are often
Business of the EEC implemented in the short term.
The mission of the EEC is to carry out research
and development in order to improve Air Traffic Most of the other business areas are concerned
Management in Europe. with medium to long term research. One
example, and a key EEC project is COSPACE.
We deliver this mission through 6 business areas: Its objectives are essentially to determine the
operational feasibility, applicability, and potential
EEC Business Areas (2003) benefits, in terms of safety, capacity and overall
APT Airport throughput efficiency, of partial delegation of separation
ERIS EATMP reference industry-based simulation assurance from ground ATC to aircrew. If this line
platform
INO Innovative research
of research delivers the expected benefits,
NCD Network capacity and demand management operations could be in the 2015 timeframe.
SEE Society, Environment and Economy
SPP Sector Safety and Productivity The EEC develops a large range of software
applications for its own use. It is not the business
As any research centre, the activities comprise of the EEC to develop and deliver operational
experiments, studies, validation, tests, and products, that is the business of industry, but
prototyping. A major tool is simulation, ranging simulators, tools, prototypes and demonstrators
from analytical modeling through to real time which achieve a high level of maturity can interest
simulation and field trials. Simulations are an the ATM community at large. These spin-off
instrument for evaluation, validation and products are made available normally free of
acceptability testing of R&D products. They are charge. See chapter 6
also provided as a service to member states and
ANSPs in order to support improvement actions
such as airspace reorganisation, changes in
working procedures, and the introduction of new Funding and Resourcing
tools. A major EEC activity is software All 2003 budget figures in this report correspond
development, of simulators, tools, and to the state at the time of writing. The budget of
middleware, and of prototype components of ATM the EEC is a component of part 1 of the Agency
systems. budget, which is funded by Member State
contributions according to Agency rules. In 2003
The work of the EEC is organised as a set of this amounts to 57.72 MEUR and covers staff
projects, and a project is managed by one of the costs, operating expenditure and investment
business areas. The totality of the projects credits. This EEC budget is augmented by 20.33
constitute the work programme. The following MEUR in the form of delegations from other
types of deliverable are project outcomes: sponsors, both internal and external to the
• Reports Agency, in payment for work done.
• Publications in learned journals and
conferences Budget delegations
• simulators Origin Amount
(MEUR)
• tools Other Agency directorates, 12.37
• prototype ATM system components mainly EATM and CFMU
• demonstrators External to the Agency, 7.96
mainly European
Commission, ENAV, FAA
Different projects in the EEC work programme Total 20.33
address different periods in the research time
spectrum, from short term through medium term With the addition of delegations, the total budget
to long term. Experience shows that there is managed by the EEC in 2003 is 78.05 MEUR.
normally a constant of 10-20 years to bring new
concepts into operations. The chart below shows the amount of resources
allocated to the different business areas,
Some projects in deliver benefit in the short term. enablers, and support in 2003. Funds are
For example, NCD provides a unique capacity allocated based on agreed plans in the Business
planning service to the ATM community to deliver Plan complemented by subsequent negotiation
ATFM delay forecasts and yearly capacity plans during budget execution.
Page 5 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2003 version 2.0
EEC Organisation
The EEC operates a matrix organisation across the whole of its organisation, core business and support.
There are 6 business areas and 4 principal business enablers on the vertical axis and 6 centres of expertise
on the horizontal axis. A business area contains projects which deliver outcomes to customers. A business
enabler contains services and projects which deliver outcomes to other units of the EEC. A centre of
expertise gathers a pool of specialist knowledge and supplies skills in a dynamic manner to projects. A
centre of expertise supplies skills to projects and services in business areas and business enablers as the
needs arise. It is the responsibility of a centre of expertise to manage staff and skills and their development.
Key methodologies auch as safety, validation, software engineering, reside in centres of expertise and are
developed and promoted and supported by the centre of expertise. Key methodologies are applied across
all core business projects.
, el
g f ic ure onn
t i s t
Centres of rin n ce y c rs
ru e
ee ie d vi lit st & P
S in Sc t an S er aci t ra
Expertise CN E
ng
an
d
en on na
l F n Inf ion s
n e t r
Business n d ms sis pmrati tio t io em ce, ma ide
a te l y o
l g ra a
l a g an or v
e u o
Areas/Enablers M ys
An
a v te
Op
e m an Fin inf pr
AT S De In Si M
Network Capacity
Airport Throughput
Society Core
Airports
Airports
Safety
Safety
Software
Software
Business
Innovative R&D Database
Database Validation
Validation Engineering
Engineering Manager
GEN-
GEN- Simulation
Simulation
Unit
Unit
EATMP Reference Industry-based ATM Human
Human
Space
Space exploitation
exploitation
Simulation and Trials Platform BADA
BADA Factors
Factors Outsourcing
Outsourcing Support
Laboratory
Laboratory
Finance and Project Support Business
Manager
Infrastructure
Human Resources
Communication
Page 6 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2003 version 2.0
For work which the EEC conducts for EATMP, Agency Stakeholders
CM composition
DEEC
Core Business Manager
Support Business Manager
R&D coordinator
Special Advisor
Page 7 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2003 version 2.0
Journey to Excellence
Page 8 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2003 version 2.0
Page 9 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
1 LEADERSHIP
Excellent leaders develop and facilitate the achievement of the mission and vision. They develop
organisational values and systems required for sustainable success and implement these via their actions
and behaviours. During periods of change they retain a constancy of purpose. Where required, such
leaders are able to change the direction of the organsation and inspire others to follow.
Effectiveness of leadership is reviewed firstly
The EEC policy of subsidiarity requires that through a series of questions in the staff
leadership competencies exist at several levels satisfaction survey, and secondly through the
of the organisation. Leadership is expected annual performance appraisal. Core
from all levels of management as well as from management away-days are organised once a
people in situational leadership positions during year, each one focusing on a particular theme.
specific meetings or interactions. The next one, for example, will focus on the
conclusions to be drawn from the Values study
described above. The conclusions of core
1a Leaders develop the mission, vision, management away-days are reported on at all
values and ethics and are role models of a staff meetings. To review and improve the
culture of Excellence effectiveness of core management leadership is
The mission and vision of the EEC were the declared objective of these meetings, which
developed in 1995 through a process of staff are usually facilitated by an external consultant.
consultation and wide debate led by the Core Informally, leadership effectiveness is also
Management Special Advisor. The resulting reviewed through the open and democratic
vision expresses the fundamental values of the culture of the EEC, through personal interaction
EEC culture. The mission and vision are and through wide use of the electronic
systematically deployed to all EEC activities via newsgroups. DEEC, and to a lesser extent
the strategy and work programme and are some senior managers, dialogue directly with
reviewed on an annual basis as part of the the staff through the electronic newsgroups.
Business Plan revision cycle.
Trust and empowerment are key elements of the
In 2002 a Task Force was established to EEC organisation. Since 1995, the traditional,
investigate more closely the values of the EEC. rigid, hierarchical structure has been replaced by
With the support of external consultants, the a flatter organisational structure which, through
group used a survey of all staff to identify what subsequent and regular assessment and review
are, and what people feel should be, the values actions, has been transformed into the current
of the EEC. The findings of this group are being powerful and flexible balanced matrix
discussed with staff at present through a series organisation. Such an organisation facilitates
of presentation. Each presentation was given and encourages empowerment, the latter being
several times to ensure maximum effectiveness. further developed through coaching and training.
The aim of the project is to improve the collective Project and unit managers at the EEC have full
understanding and move the EEC towards the responsibility for budget and staff and other
common goals. resources and are accountable both horizontally
and vertically through regular assessment and
EEC Leaders, both members of core review processes. Budget reviews are held
management and middle management, act as quarterly and all budget holders are required to
role models for a culture of excellence by account for transactions and confirm planning.
personal and active involvement in improvement Similarly people managers have been
activities. Improvement projects are either encouraged to extend the performance appraisal
generated from EFQM self assessments, or are process by holding intermediate review
generated by regular assessment and review meetings with their staff and this has become
activities, or are generated spontaneously from standard practise in each Centre of Expertise.
the continuous improvement culture. The Core
Management Special Advisor is a member of the Communication has been identified as a key
suggestions box board. Many of the major success factor for the EEC and was a topic that
improvement actions such as strategy reviews, emerged from staff surveys as needing more
organisational realignments, outsourcing, attention. Based on this feedback it was decided
facilities management, drive for business to reinforce the role of the various management
excellence etc., have all been triggered by core meetings as a means of ensuring
management. communication in both directions.
Page 10 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Minutes from Core Management Meetings CMM The section Overview-Journey to Excellence
are published on the Intranet. Attendance at the above shows that the EEC has undergone
CMM is high. Since July 2001 there have been several major reorganisations in order to
28 CMM. At least 4 Core Managers were respond to changing context. More recently, the
present at 26 of these meetings and there was EEC underwent a major restructuring in mid-
full attendance at 19 of them. 2000 which resulted in its core business being
Collaboration is the essence of a matrix organised as a classical matrix. People
organisation where people and resources come management activities, grouped into ‘Centres of
together in project teams to achieve a clear set Expertise’, were placed along one axis, and
of objectives. In 2002, in reaction to feedback projects, grouped into ‘Business Areas’ on the
from the Staff Satisfaction Survey, the CM other. The choice and naming of Centres of
participated in team-building exercises Expertise and Business Areas is highly
supported by an external consultant. significant, as they incorporate the strategic
Collaboration is also encouraged on a less elements of the EEC and its deployment
formal basis through voluntary participation in framework.
consultative committees such as for the canteen
and for major building projects. EEC Business Areas (2000)
ACS ATM concepts and studies
ATI ATM implementation
The EEC adopted an approach of continuous CNS Communication, navigation and surveillance
improvement over fifteen years ago. This ENV Environment
initially used total quality principles and then ERS EATMP reference industry-based platform
transitioned to continuous improvement when GNS Satellite navigation
the activities were formalised around the EFQM INO Innovative research
PFE Performance, flow and economics
model and techniques in 1998. Throughout this
SAF Safety
period, staff members have been encouraged to
participate in improvement projects on a
In 2002 the matrix was extended to include the
voluntary basis. Senior managers also will lead
center’s support activities through the
or participate in improvement projects. It is part
appointment of Business Enabling Managers
of the approach that managers allocate time for
(BEMs) and the addition of a sixth Center of
continuous improvement activities.
Expertise. They are listed below:
Appropriate training was provided through the EEC Centres of Expertise (2002)
quality module of the project management ACE ATM and CNS system engineering
training and more recently through specific SAS Safety analysis and scientific
EFQM training: both introductory and assessor DAI Development and integration
training. There are also regular internal OPS Operational services
SFM Simulation facility management
presentations. In 2003, 3 middle managers FIP Finance, infrastructure, iformation and
have followed the EFQM self assessment people provider
training and one scientist has qualified as a
EFQM European Excellence Assessor. EEC Business Enablers (2002)
MIM Marketing & information management
This document, the report for the EFQM self- ITM Information technology management
AMI Administrative and management information
assessment award simulation, is being written
software
by a team of 7 people, all volunteers, some HRM Human resources management
managers, who are drawn from different EEC SMU Social medical unit
units. Many other people contributed to the SPP Service for prevention and protection at work
development of the report via interviews and by TIG Transport & mail infrastructure general
support
their supplying data for the results chapters of
FIN Finance
the report. FPA Financial planning and analysis
PSO Programme support office
Page 11 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
EEC Business Areas (2003) The Gantt chart on the powerpoint slide below
APT Airport throughput depicts the business planning process which
ERIS EATMP reference industry-based simulation
platform
drives the re-orientation process. This slide also
INO Innovative research shows the way that the process is
NCD Network capacity and demand management communicated and explained to staff and to
SEE Society, Environment and Economy stakeholders. This slide is part of standard EEC
SPP Sector Safety and Productivity presentations.
The EEC reorganisation implementing the This ability to respond to the evolving
“reorientation” was described and agreed by the environment demonstrates the effectiveness of
EUROCONTROL Director General in Decision the EEC’s matrix structure to accommodate
N° VII/1(2003) on 13 January 2003. change and reflect the needs of its stakeholders.
Management board
ECCG
Page 12 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
An Intranet tool, the "How to?" Guide, has been introduction of the Business Planning process, a
developed to facilitate access to intranet more systematic approach to performance
information including processes. In addition a indicators has been initiated and these
separate process indexing mechanism has been constitute chapter 7 of the current Business
developed, accessible from the intranet home Plan. These indicators are assessed and
page. reviewed by core management and the KPI
owners on a quarterly basis (see section 2b).
Assessment and review of processes is Performance indicators are co-ordinated at the
gradually becoming more systematic. For level of the Agency and this resulted, during the
example there are systematic annual reviews of 2001 assessment and review, in the introduction
the business planning process and the of two new indicators, the timeliness of project
promotion process. This and previous self- milestones (see section 6b), and the project
assessment exercises as well as the increasing management quality index (see section 9b).
maturity of the organisation have acted as Systems have been developed as part of ACB to
catalysts for a more systematic examination of support the measurement of these performance
key business processes. It should be noted that indicators. See section 3a below for further
many processes especially in the finance, details of ACB.
procurement, and human resource domains, are
mandated at the level of the Agency. In these The EEC is recognised as one of the best
cases the EEC seeks, through appropriate performing directorates in the Agency, for
training, to ensure that EEC staff understand example, budget expenditure performance
and correctly apply Agency processes. Training consistently exceeds 95%, and the EEC is
material has recently been developed on the leading the Agency in the use of Balanced
subjects of outsourcing and procurement to help Scorecard techniques. Nevertheless, the EEC
project managers deal with changes to Agency is very aware that performance can always be
procedures. improved. Leaders constantly encourage staff
to work on improvement activities by allocating
The EEC has been instrumental in introducing time to continuous improvement at management
improved processes at the level of the Agency. meetings, by personal involvement in the
Examples are performance appraisal, business identification of improvements and the
planning, staff planning, budget monitoring and establishment of performance indicators and by
framework contract. their support of self assessment, staff surveys,
and customer surveys.
Since 1997 the EEC has adopted the industry
best practise of using a Business Plan to
communicate and deliver strategy. The Director
General approved the first EEC Business Plan in
1999, after wide consultation with external 1c Leaders interact with customers, partners
stakeholders and Agency staff. The Business and representatives of society
Plan explains the strategy and indicates how the The EEC has established several approaches to
strategy is deployed throughout EEC operations understand and respond to the needs and
via the work programme and support activities. expectations of stakeholders. Leaders, both at
This is further supported by the matrix senior and other levels, are fully involved in the
organisation as explained earlier in this section. initiation and operation of the associated
The Business Plan process ensures that the processes.
Business Plan is assessed and reviewed on an
annual basis linked to the annual budgetary All EEC leaders are encouraged to network with
cycle. Approval of Business Plans is recorded in stakeholders on a regular basis in order to keep
the Overview- Journey to Excellence. The EEC abreast of changing needs and expectations.
has been instrumental in introducing a Since the EEC is a research centre, the main
harmonised Business Planning process delivery chain is the project, and stakeholder
throughout the Agency, and the EEC Business involvement is paramount from initial
Plan is viewed as best practice throughout the requirements elicitation through to final
Agency. acceptance of deliverables in order to ensure
continuing alignment with evolving stakeholder
For over a decade the EEC has been measuring needs. Specific activities in the project lifecycle
performance indicators linked to the delivery of process ensure full stakeholder involvement and
simulations, which has been its core business these are supported by the provision of
since the establishment of the EEC in the early adequate funding for visits to stakeholder sites.
1960s. More recently and due to the
Page 13 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
A special programme of VIP visits to the EEC standardisation, and seeks to accelerate the
was started in 2000 and is led by the DEEC. operational deployment of research results.
The objective of this approach is to invite to the Partnership with ATM service providers, with
EEC on a regular basis the CEOs of stakeholder EATMP our number one stakeholder, and with
organisations in order to exchange views, other stakeholders is essential to ensure that
understand the strategy and needs of EEC activities respond to the global needs of
stakeholders, explain EEC and Agency strategy, ATM in Europe and the world. Partnership with
and explore opportunities for collaboration. A the European Commission (EC) seeks to
visitors database application was created in contribute to the EC R&D effort in the most
2003 in order to better track and follow up efficient manner by making EEC resources and
stakeholder visits and contacts. expertise available to consortia working on EC
projects. Since 1999 the EEC has provided a
A stakeholder survey has been carried out every staff member on secondment to the EC to
two years since 1997. This is a primary source consolidate this partnership. The EC's high
of objective feedback that is used to gauge regard for the EEC is evidenced by the recent
stakeholder needs and expectations, to assess decision to establish a Joint (EEC-EC)
alignment of EEC strategy, to measure Programme Board (JPB) to oversee all ATM
stakeholder satisfaction and to obtain R&D in Europe.
stakeholder perception of EEC operations and
performance. Improvement actions are planned Partnership is also important in the support
and implemented based on the results of the activities where outsourcing has been used to
survey. Senior management actively supports improve EEC performance and to allow EEC
this process and fully participates in customising staff, where possible, to be retrained and
the questionnaire according to evolving needs transferred from support activities to core
and context. business activities. The following activities have
been outsourced:
The Experimental Centre Consultation Group • IT service provision
(ECCG) was established in 1998 to advise the • Print shop service provision
EEC and the Director General on the role, • Building maintenance
strategy, and performance of the EEC. (See • Mission service provision, partnership with a
section Overview-Governance above). The travel agency
ECCG is the only forum that is dedicated to all • Mission expenses, partnership with a
EEC stakeholders. The principal working financial services company
papers are the draft Business Plan of year n and
the Annual Report of year n-1 and these are the One particular partnership, the framework
vehicles for debate and advice concerning the contract, has greatly improved the procurement
role, strategy, and performance of the EEC. The of contractor support especially for core
draft Business Plan is modified as a result of the business. A framework contract has been
stakeholder advice before being submitted to the concluded with a set of consortia who have
EEC Management Board and the Director agreed to maintain the required pools of
General for final approval. In addition to the expertise and to reply extremely rapidly to
standard agenda, each meeting comprises one requests for support at agreed rates.
or more special themes, determined by the Time to procure contract support has diminished
evolving EEC strategy e.g. safety, environmental from 2-6 months to 3-4 weeks.
issues, flow management and economic issues. The EEC pioneered this technique in the
Agency. Now several other directorates have
Partnership is of paramount importance to a adopted a similar framework contract.
research organisation through all phases of
delivery. Partnership is thus an important part of The support activity partnerships are subject to
EEC strategy. An overview of partnership is regular assessment and review with the partners
given here. Further details are provided in in order to identify areas for improvement and to
section 4a, and indicators and results pertinent organise joint improvement actions.
to partnership are documented in sections 9a
and 9b. Senior managers fully support and participate in
joint improvement actions with other Agency
Partnership with other research units and directorates. Some examples are:
universities stimulates creativity, maximises • DEEC initiated regular meetings with other
synergy, and optimises the combined use of Agency Directorates in order to dialogue on
resources. Partnership with the ATM system a regular basis and to identify ways that the
supply industry seeks to advance Agency as a whole can improve. Through
Page 14 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
this mechanism the EEC has succeeded in beginning of 2001 a policy decision was taken to
transferring best practice to the rest of the increase the EEC contribution to the global ATM
Agency in the domains of human resources, research effort through the publication of
finance, and technology. research papers. Business areas were
• Business Plan Task Force which seeks to encouraged to publish research papers and
harmonise the business planning process budget was increased to allow greater
throughout the Agency contribution to conferences. Results are
• Improvement of the performance appraisal recorded in section 6b.
process
• Improvement of contractor procurement The Director himself regularly speaks on the
through the framework contract subject of ATM research and development at
• Promotion of an intranet culture in the important conferences in the ATM community.
Agency He has also participated as expert witness in
• Improvement of dialogue with unions and two debates broadcast on radio. He has also
staff committee throughout the Agency participated as an authority on ATM in four
Many of these actions have necessitated strong colloquia at the French parliament:
senior EEC management participation in order • Activites aeroportuaires, amenagement de
th
to lobby for their adoption at the level of the territoire et developpement durable, 7
Agency February 2001
• La croissance du transport aerien en Europe
st
The main EEC stakeholder forum, the ECCG, is est-elle encore gerable?, 31 May 2001.
always encouraged to give advice to the EEC in • Reconcilier developpement du transport
order to improve performance, not only technical aerien et qualite de l'environnement urbain,
th
and operational performance , but also 7 June 2001
organisational and management performance. • Les retombé es é conomiques et fiscales des
st
Recommendations to this effect are recorded in grands sites aé roportuaires francais, 21
ECCG meeting minutes. October 2002
The EEC's senior management have adopted The EEC is co-sponsor and co-chair of the
the following approach to recognise stakeholder USA/Europe Air Traffic Management R&D
contributions: Seminar. This seminar is organised in turns
• Explicit recognition and thanks from the under the leadership of the US Federal Aviation
Director in the Introduction to the EEC Administration or the EEC and takes place every
Annual Report 18 months, alternately in the US and Europe.
• Written acknowledgement of valuable About 150 researchers from both sides of the
stakeholder participation included in project Atlantic participate.
reports.
• Personal recognition and thanks at end of One of the four main orientations of the EEC
project events, delivered orally by the strategy is to support sustainable growth of the
Director or other manager. aviation industry. To this end a dedicated
business area was established in 2000 to
In addition, a feedback brochure is sent to all address environmental issues. As a result of the
stakeholders to thank them for participating in most recent re-organisation of 2002, this
the regular stakeholder survey and to provide Business Area has been expanded to include
them with a summary of the main findings and the impact on society at large of aviation. The
planned actions. business area has four main threads:
• Noise an air quality nuisance around airports
Participation in conferences and seminars is one • Fuel burn and emissions
of the main vehicles to disseminate and discuss • Social attitudes to aviation
research results. This process is fully supported • Sustainable aviation
by EEC senior management. In 1999, the EEC The EEC approach is to gradually increase
made a presentation of the its continuous funding of this business area.
improvement strategy and actions at the
EUROCONTROL Quality Forum, to attendees ENV funding in MEUR
from all over Europe. The same presentation 2000 2001 2002 2003
was also given at the ISTIA Quality Seminar to planned
15 participants from all over Europe. 0.9 1.8 3.1 5.5
Researchers regularly submit and present
papers to conferences and seminars. This is
part of the researchers way of life. At the
Page 15 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Page 16 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Page 17 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
2a Policy and Strategy are based on the A further consideration is the fact that some of
present and future needs and our member states, which formerly had
expectations of stakeholders substantial government-funded facilities, are
looking to reduce their own costs. Under these
circumstances R&D is often an early casualty,
Eurocontrol Experimental Centre stakeholders and EEC is therefore increasingly regarded as
range from public service providers to an agent useful in the coordinated dispersion of
commercial organisations, from ordinary citizens European ATM R&D activities.
(which could be airline passengers or residents
in an airport environment) to government The strategy loop
ministers. The institutional context of the Given our complex and changing context, the
Eurocontrol Agency, which includes the setting of strategy and policy is a continuous and
Experimental Centre, is constantly under review. dynamic process. It can be characterised by the
Issues include; the need to separate regulatory following loop:
functions from service provision, the tendency
towards greater ‘corporatisation’, and changes in
our relationship with political bodies such as the Business
European Commission. For all these reasons a context and
key requirement in the establishment of policy drivers
and strategy for the Experimental Centre is
flexibility and responsiveness, while remaining
confident in, and building upon, our particular
strengths and special identity.
Develop
Market context strategy and
policy
The Experimental Centre executes research and
development (R&D) in the area of Air Traffic
Management (ATM). Our immediate Stakeholder
stakeholders, those for whom we most directly feedback
work, are the air traffic service providers of our
member states. There exist other organisations
within Europe and beyond which also perform Publish and
ATM R&D, and there is potential for conflict communicate
between these organisations and ourselves.
One reason for this is that the Agency is an
intergovernmental organisation with an ‘internal’
supply of funding originating from
EUROCONTROL member states or, more
precisely, from the collection of route charges. Broadly speaking, policy and strategy is
This means that some of our products can developed on the basis of:
subsequently be made available to states within
the EUROCONTROL Organisation without − our legacy of skills and experience
charge. Other R&D organisations, however, are embodied in an existing strategy,
increasingly obliged to compete on a
− moderation and amendment by stakeholder
commercial basis, marketing and selling their feedback,
expertise and products. The potential exists
therefore for market distortion, and our policy − yearly review in the light of a changing
and strategy must take this into account. In business context.
practice we have made specific efforts to include
In 2002 this included input from a task force
senior representatives of such ‘competing’
asked to explore the direction the EEC should
organisations in our strategic consultative
take in the light of the 2020 Vision from ACARE,
processes to obviate this problem.
new ATM actors such as Boeing and the ATM
Alliance. The task force proposals are published
Page 18 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
in “Proposed EEC Re-Orientation V2.” The some specific project requests. Input also comes
proposals drove the realignment of the EEC from our particular knowledge of the state of Air
organisation in 2003. Traffic Management based on analytical data
and forecasts, which are often generated by our
Stakeholder feedback own internal projects.
Stakeholder feedback is critical to keep EEC
policy, strategy, services, products, and projects
aligned with stakeholder present and future Market watch activities comprise careful reading
needs. Key inputs are: of air transport trade magazines, the specialised
• Stakeholder/market survey and general press, company annual reports,
• ECCG web sites of companies and organisations such
• Visits as the European Commission. Articles and
• R&D co-ordination information are systematically placed on the
• Market watch intranet and/or distributed to senior and middle
management depending on the type of
Stakeholder/market survey process information. Market watch activities contribute
The process has two objectives: to our general understanding of market evolution
1. Identification of stakeholder future needs which we feed into Business Plan development.
2. Extraction of stakeholder satisfaction. The draft Business Plan is presented to the
The two aspects are combined in a Experimental Centre Consultation Group
questionnaire. The survey is conducted every (ECCG) for comment and discussion.
two years. All EEC stakeholders receive the
questionnaire. The survey is contracted to a Comments and feedback from the ECCG are
specialist consultancy in order to benefit from taken into account when developing the final
their specialist knowledge and to ensure version of the Business Plan, which is then
objectivity. Additionally in 2002 a specific survey presented to the EEC Management Board for
was conducted amongst ECCG members at final approval. Details of the ECCG and EEC
their meeting in May. Results have been used to MB are provided in the section Overview-
re-orient EEC strategy and activities. Governance above. The main role of the EEC
Stakeholders receive a synthesis of the results MB is to ensure that all considerations and
and the EEC responses. Results are provided guidelines coming from EUROCONTROL
in section 6a. Agency controlling bodies are suitably taken into
account in the Business Plan, and to give final
approval for the document.
The Business Plan
The principal expression of our policy and
strategy is to be found in our Business Plan.
2b Policy and Strategy are based on
This is based on a standardised format for information from performance
EUROCONTROL Business Units and is updated measurement, research, learning and
each year, with its fifth edition to be published in external related activities
May 2003. The annual process by which the
Business Plan is developed is shown in the The origins of policy and strategy as embodied
Gantt chart above. in the Business Plan are varied. Three
significant contributions in 2002 include the task
force report on “ EEC Reorientation”, the Agency
Development starts in the Spring. The first part reorganisation and the results from the 2002
of this process involves a complete review of the Stakeholder Survey. Inputs also come from the
previous Business Plan, with sections updated Balanced Scorecard approach, instituted in
and rewritten as necessary. This is the 2002. See Chapter 9.
responsibility of the Core Business Manager, Additionally in a response to a need to better
with relevant sections written by the Business target our resources and expertise we have
Area Managers, who have a more direct day-to- pursued our policy of support to EATMP and
day contact with stakeholders for their particular European Commission programmes which are
areas. In addition we take into account the of benefit to all EUROCONTROL members in
requirements of our Agency partners such as preference to support to individual states.
EATMP and CFMU, and external partners,
especially the European Commission. The We are in addition responsible for performing a
content at this stage is derived from our number of studies related to the current day
understanding of stakeholder requirements performance of European ATC, and studies to
accumulated during the previous year including forecast future ATC capacity and demand. This
Page 19 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
means that we have direct and early access to of general and specialised press, of European
much of the source data which is used to drive Union and national government official
plans for Europe-wide ATC systems publications, and by regular monitoring of
development and harmonisation, and this is relevant web sites.
included in our own strategic thinking.
On the more creative side, we continue the
A different, and equally important input to our internal ‘brainstorming’ sessions, held in both in
strategy results from the role of the Experimental 2000 and in 2001. These were organised as full
Centre as leader of the ATM community in day open sessions in which all staff was
research and development, which means that encouraged to participate, and express
parts of our Business Planning is ‘proactive’ and themselves on various ATM issues. They were
breaks new ground. The novel elements of our led by a single ‘facilitator’ and, apart from some
strategy are sometimes potentially controversial. basic rules of courtesy and protocol, participants
Examples of leading-edge planning include the were encouraged to freely express their views.
introduction of research into societal trends These brainstorms provided some animated
while maintaining the emphasis on debate, and many of the ideas expressed
environmental studies and the pursuit of safety therein have been integrated into our strategic
as an end in itself. A safety culture survey has thinking. Recent brainstorm topics have included
been conducted to measure the implementation EEC Values and placement of external
of safety culture within the EEC. Results are contracts.
reported in section 9a.
New technologies
In order to allow comparison of our strategy with
that of other institutions, EEC projects are To support strategy and policy development, the
1
included in the ARDEP database. This is a Experimental Centre stays abreast of new
Europe-wide census which collects and technologies in two specific ways.
categorises information on R&D projects in Air
Traffic Management. Positioning ourselves in a − First, we keep our experimental
wider context gives two specific benefits. First, infrastructure up-to-date. This is necessary
we are able to avoid duplicating research that is since our experimental facilities, software
being done elsewhere, and second, we are able and hardware, need to simulate increasingly
to identify gaps in current activities. This was, for complex models and tools, which amongst
example, one of the mechanisms by which the other things require constantly increasing
chronic lack of investment in innovative research computing power. In addition, we are
was identified (ARDEP ‘Yellow Book’, 1998), something of a ‘showcase’ for new
resulting in new initiatives at EEC in this technologies applicable to ATM. One
direction. example of this is the progressive upgrade
of the controller ATC displays used in
We have initiated an annual R&D symposium simulations to use the latest large flat panel
targeted at high level management of ATM R&D. devices. A second example is the AudioLan
This is a forum where current trends and future product where the EEC was the leader in
prospects of European activities are discussed. developing voice over IP functionality.
US contributors are also invited to these
meetings. Much valuable feedback is derived − Second, we have an entire Business Area
from these. dedicated uniquely to innovation. By
definition this area looks into new, and
A general understanding of social, political, sometimes radical, technologies with the
economic, institutional, operational, and expectation that some of results can be fed
technical issues as they affect ATM are an into the other Business Areas. One of the
essential input to Policy and Strategy benefits of this work is an increased contact
formulation and evolution. This is achieved with universities, where academics are
through the creation of a Business Area actively encouraged, sometimes by means
addressing social, economic and environmental of financial support, to engage in research in
issues in the context of ATM. In addition we are ATM. Currently 11 PhD or MSc students are
in the process of determining a social and supported with theses such as: Air-rail
environmental policy with regard to our intermodality from the Passenger’s
interaction with the non-ATM community. These Perspective and Modelling of Aircraft
actions are supplemented by a regular reading Trajectory Uncertainty with Semi-Markov
Model.
1
Analysis of Research and Development in
Eurocontrol Programmes.
http://www.eurocontrol.int/ardep
Page 20 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
2c Policy and Strategy are developed, least 8 European Commission projects. Such
reviewed and updated cooperation did not previously exist.
− We should set more realistic objectives and
Depends on EEC mission and vision properly complete projects, “make it work
Our strategy accommodates a mix of short and properly before moving on to the next
long-term activities, and the balance between technology horizon”. In response to this we
these is important. have initiated specific project structures to
ensure completion and reusability of our
On one hand our stakeholders expect result, for example c.f. Business Plan 2002
increasingly rapid results, since they themselves and the AGI project structure. We are also
are more and more subject to short-term building on in-house simulation results by
commercial constraints. Some of our fast turn- taking platforms out into operations rooms
around activities include analysis of delay and connecting to live data feeds cf MTCD
figures and forecasts for, say, one year into the in Malmo, Maastrict and Rome,– this is a
future. Another example is the direct support we significant new contribution to the overall
provide to air traffic service providers when they validation process. See also section 9a.
wish to prototype and test their new controller
interface designs. Results of such work have − We should improve analysis methods. In
been implemented directly in operations rooms, response we have launched a major
a good example is operational application of initiative to implement high quality validation
Medium Term Conflict Detection in the Rome methodologies and have created a
ATCC. validation cell within the SAS CoE . We are
implementing this by providing validation
On the other hand the EEC is one of the few management for the major EC Gate to Gate
organisations capable of centralising longer-term project.
activities, and our stakeholders understand and
encourage this. Here, for example, we perform Our most recent (IPSOS) stakeholder survey
longer term forecasting activities up to 2010 and conducted in 2002 has identified:
beyond, for example in the Constraints to
• a need to improve the communication of our
Growth project, and develop innovative products
results. Efforts are in hand to address part of
within our Innovative Research Business Area.
this element through improvements to the
A further business scenario that we have Activity Report, and through the compilation
recently embraced is one of industrialisation, of a web based external newsletter sent to
where we have decided to identify products over 4000 subscribers every quarter.
which could be further developed by partners
• to be more operational and concrete in the
outside the Experimental Centre, and to make
work produced. We seek to put more
the necessary agreements to do this. This is one
emphasis on field trials.
way in which we are developing a sense of
commercial awareness that was previously • to remain neutral and independent.
absent. Industrialisation is further described in
section 4a. • continue in the pursuit of creative and
productive research. We seek to increase
Evaluating relevance/success factors partnership with universities and maintain or
increase funding to the Innovative research
Stakeholder/market surveys (section 2a) give business area.
the EEC important insights which have had a
significant influence on our policies and strategy.
In the1997 survey was a clear message that we 2d Policy and Strategy are
should adapt our environment to changing communicated and deployed through a
demand, and in particular take on a central role framework of key processes
as coordinator of European ATM R&D. In
response to this we appointed a full time R&D Key processes for delivery of strategy
coordinator who forms part of the Core
During 2002 and 2003, a large effort was
Management team.
devoted to mapping and documenting processes
The 1999 survey indicated: and reaching consensus on the framework of
key processes which implement strategy. This
We were asked to better cooperate with projects
work was based on the strategy review of late
external to the EEC. Part of our response has
2002 and the subsequent reorganisation of
been to become active consortium partners in at
Page 21 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Page 22 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
http://www.eurocontrol.fr/ Support
a nd Public
Re la tions
4% Mana ge m ent Budget :
2001
77 M€
Servic e s 8%
1 9% Staff : 274
Contractors: 240
Core Business
2000
R & ve
pm tor
gem ity
isa ce
nt
on gt,
con ATM
D
S
ty
ts
ent.
e nt
n
ati
SS
y
tim spa
international R&D conferences, for example the
me
CN
na acil
velo ula
Ec Mn
tio
om
cep
fe
2001
nov
GN
Sa
on
Op Air
De Sim
Ma o n F
w
w
vir
In
Ne
Flo
En
ti
ula
Europe/US ATM2002 R&D conference, and the
rf;
Sim
Pe
EUROCONTROL Experimental Centre
Page 23 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
3 PEOPLE
Excellent organisations manage, develop and release the full potential of their people at an individual,
team-based and organisational level. They promote fairness and equality and involve and empower their
people. They care for, communicate, reward and recognise, in a way that motivates staff and builds
commitment to using their skills and knowledge for the benefit of the organisation.
Page 24 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Clearly, in order to remain useful, the Staff Plan time due to the need for EEC HR staff to double-
has to be maintained on a regular basis. It is check input made at HQ. The Director EEC has
reviewed continuously by the Heads of CoE and taken an initiative with the support of HRM to
HR at the Resource Allocation Management further decentralise data base processes, and a
meetings (RAMM). During a review of the first meeting was held on April 14 with a senior
defined skills contained in the Staff Plan which manager from HR Brussels during which a
took place in March 2003, the number of highest number of processes were identified as potential
level skills has been reduced from 36 to 19, for optimisation.
grouped for the most part by CoE.
HR processees
By using the Staff Plan to identify skill shortages,
it has been possible to develop our recruitment Many HR processes and procedures are
strategy. A list of recruitment priorities has been documented on the intranet under the "Services"
agreed, along with a timetable based on the section. The process documentation initiative is
anticipated retirements of the next 5 years. The being pursued as well as the integration of HR
posts which will become available in this period processes into the key process framework as
will be allocated according to the Staff Plan. The described in section 2d The EEC recruitment
application of this process at the EEC, agreed process has recently been updated and has
by DHR and DG, has enabled the EEC to been approved by the PMM (People
streamline the recruitment process. The fact that Management Meeting).
the EEC has the lowest rate of unfilled posts in
the Agency is evidence of the effectiveness of Staff Satisfaction Surveys
the overall recruitment process at the EEC.
Staff Satisfaction surveys have been performed
A web-based tool, ACB (Access to Business), at the EEC in 1998, 2000 and 2002. Response
monitors the EEC’s work programme and rates in the first two were relatively low possibly
budget, and supports the application of the Staff due to the design of the survey and concerns of
Plan. As well as containing information on all the confidentiality. In 2002 a standard Agency
active projects of the EEC, the ACB tool is survey was used and measures taken to assure
available to track which staff are assigned to anonymity of all respondents. The result was an
which projects and over what duration. The exceptionally high return rate of 85%: which is
allocation of staff to CoEs is extracted from the one of the best in the Agency. Results are
HiRIS data base. Project Managers can also use communicated to everyone through reports
the tool to note their requirements in terms of posted on the intranet and through presentations
resources. at all staff meetings, management meetings, and
at a Weekly Information Corner. Improvement
HR Tools actions are derived and all people are
encouraged to participate in improvement
The HR database HiRIS, is updated by HRM projects. The next survey at the EEC will take
and maintained by the AMI support service. place in Quarter 3, 2003. Results of staff
Graphical presentations of the staff satisfaction surveys are provided in section 7a
demographics are updated weekly on the EEC
Intranet. Human Resources Management Unit
The data base contains comprehensive
information on staff members. However many of HR processes at the EEC are owned by the
the processes are managed by Headquarters, Human Resources Management (HRM)
which leads to some inefficiency in terms of lost Business Enabler (BE). These processes
Page 25 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
include Recruitment, Training and Staff of the Training Plan is to identify training needs
Management. The unit shares the management according to strategic requirements, while at the
of processess with the Core and Middle same time, recognising individual training needs.
Managements as appropriate. The link between the Business Plan, the Staff
With a view to improving its service to internal Plan and the Training Plan is being
customers, HRM requested an internal audit of consolidated, leading to the development of a
its activities and services. A series of interviews more coherent and planned training strategy. In
of a sample of staff members was carried out by Parallel, a Task Force has been set up to
a staff member with experience in Continuous monitor training effectiveness.
Improvement. The results of the survey were
presented to all staff at a Weekly Information Staff are encouraged during the Performance
Corner in January 2003, and the complete report Appraisal process (see this section below) to
is available on the Intranet. think about their training requirements. These
HRM is committed to addressing the findings of requirements are fed into the training plan.
the survey, which although not of a statistical
nature, nevertheless highlight areas for Finally, all staff have access to training support
improvement. As a quick win, the Staff via the Educational Assistance and Scholarship
Management office now has published opening programmes. Currently 3 staff are availing of the
hours each morning during which staff may support provided by the Scholarship scheme to
come with questions and problems of an follow higher educational courses such as MBA.
administrative nature. This initiative has allowed Staff who wish to undertake study in their own
the HRM staff concerned to better manage time are encouraged to do so if the nature of the
workload by having un-interrupted time in the study has relevance to their professional
afternoon, and so being able to deal more development. They receive financial support
rapidly with routine tasks from the training budget and are entitled to time
off work for the preparation and sitting of
examinations.
Page 26 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Page 27 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Page 28 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
possibilities at A grade level as compared to B with quarterly reviews of the impact of this way
and C grades. This has led to some frustration of working on the staff member and his
especially at the lower grade. The EEC has colleagues. Staff are allowed to work at home
made considerable effort in the past to rectify for a maximum of three days per fortnight.
the perceived imbalance in the number of Others also benefit from ad-hoc home-working
promotions given to A-grade staff in comparison which allows staff to work in this manner on up
with B and C grade staff. The Director EEC and to 30 days per year and for specific tasks.
the Staff Committee attach high importance to Results are provided in section 8b below.
ensuring as far as is possible, an equitable
distribution of promotions across the grades. Building improvements
The contribution of staff to collective activities
outside their normal professional activities are The EEC building was completely renovated
taken into account as secondary criteria for over a period of 2 years from 1998 to 2000. The
promotion. The EEC ensures the greatest working conditions are now excellent, and in the
possible level of openness in how the process is latest phase of improvement, an air conditioning
handled locally and continues to support efforts system was installed in the area known as the
to have the process revised at the Agency level. extension which was built in 1995. Another
simple but effective innovation has been the
Job Management installation of water fountains in all conference
rooms.
The objective of this project is to develop clear
and standardised information on all Agency jobs, Environment and social responsibilty
and to ensure that individual staff members are
assigned the grade which corresponds to the To promote world environment day on June 5 a
actual work they are doing. The principle series of exhibitions and events is being
outcome from the first phase of the project is organised. The aim is to raise the awareness of
that about 60 staff should benefit from an up- environmental issues amongst the people
grade. This further indicates the principle of working on the Bretigny site:
empowerment which exists at the EEC, whereby § an art and photography competition for staff
capable people are allowed to take on and their children
responsibilities which would normally § promotion of public transport with an extra
correspond to a higher grade. shuttle
§ exhibition on water and the environment
Safety at Work and Welfare Officers § "bio" products stand
The EEC had a Welfare Officer under contract at § "bio" meals at the canteen at lunchtime
the EEC from 1996. In 2001 this position was § visits to the local waste disposal/recycling
made into an Agency post. The Welfare Officer site
is active in the integration of newcomers but is § films on ecology themes in the auditorium
also available to all staff with personal or family
difficulties. The first full-time Welfare Officer is
no longer with the Agency and a recruitment is
in progress to fill the vacancy.
A post was also created for a Safety and
Prevention and Protection at Work Officer.
Several benefits have already been seen such
as regular fire drills, and staff are being trained
as fire wardens and first aiders.
Page 29 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
An EEC Strategy Task Force of 10 EEC staff Industrial Partnership and Industrialisation
was created in July 2002 to define a strategy for Policy
the EEC that would benefit the whole ATM A report on the relationships between the
system. It reported in October 2002 with the first Agency and Industry was produced in1997 by
version of the ‘Proposed EEC Strategy’ for the Industrial Policy and Supplier Relations Task
presentation and discussion at ECCG in April Group. The EEC contributed to this work and
2003. The report formed the basis of a subsequently built on this foundation in order to
reorganisation of EEC Core Business carried out develop its own industrialisation policy. An EEC
st
in the 1 quarter of 2003 and approved by the Task Force on Industrialisation Policy was set
Director General. Version 5 of the EEC Business up from October 1997 to April 1998 to evaluate
plan will be based on the agreed strategy. the different options to be considered for the
deployment of R&D products by industry so that
The principal feedback on EEC performance proper support, maintenance and training would
from strategic partners comes through the be ensured by industrial partners. Its report was
stakeholder/market survey. See section 2a endorsed by ECCG in November 1998.
above. Results are provided in section 6a
below. The development of partnerships with industry is
now a cornerstone of EEC strategy. The EEC
Business Plan contains an action to further
develop co-operation with Industry. The EC-
Forming value added supply chain th
sponsored 5 FP and TEN-T projects encourage
partnerships the involvement of Industry in the specification
and development of EEC simulation platforms.
Framework contract A framework was defined in co-operation with
Since 1996 the EEC procures external the legal service of EUROCONTROL HQ to
assistance using a ‘framework contract’ with address licensing and intellectual property rights
industry consortia. The objective of the contract issues. A standard licensing agreement was
is to set up partnerships with the consortia that developed that can be used most cases. This
are able to provide support to EEC in the EEC policy was widely presented to and was
execution of its work programme. This well received by industry.
arrangement has reduced the time to let a
contract to an average of 6-7 weeks. The A notable success of the industrialisation
contract is renewed every 3 years the most strategy was the AudioLAN product, an
recent being April 2002. innovative venture exploiting voice-over-IP
technology, which is now commercialised with a
The emphasis in using external assistance is
increasingly on fixed-price tasking undertaken
Page 30 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Page 31 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Page 32 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
The EEC has started a cycle of visits to its peer The EEC also receives requests from trainees
research establishments in order to complement who wish to take part in our activities. An
the mutual information and actions. Results are internal committee makes the selection of
provided in section 9b below. Such visits are an candidates. Results are provided in section 8a.
opportunity to inform partner establishments on
the strategy and the work programme as well as Other contacts with universities are taken by all
getting direct feedback on the approach. The business area managers on subjects of direct
contact allows to better position the EEC concern to their activities.
business plan prior to presentation to the ECCG.
The Innovative Research Advisory Board was Creating synergy in working together to
set up in 2002, comprising three external improve processes and add value to the
prominent scientists and experts, among which customer/supplier chain.
1 University Professor from the US, and 1 Head
of National Research Center in ATM from
Europe. The board is functioning and provides The EUROCONTROL Agency has developed a
input to all proposals and theses. series of Action Plans in co-operation with the
US FAA. The EEC contributes to the planning
Generating and supporting innovative and implementation of these co-operative
and creative thinking through the use of actions in all areas of common interest. The
partnerships topics covered include: ASAS, VDL, Decision
Support Tools, Flow Management, ATC Working
Methods, and Wake Vortex. The practical
Research Co-ordination. development of the co-operation is performed
A research and development review process through Technical Interchange Meetings, which
exists in the Agency in the form of the R&D allow an exchange of views as well as sharing of
Review Group. Although this process is data, methods, and software. The overall
currently being revised, the data gathering process is monitored twice a year through
process which is the key element of the review meetings of a dedicated R&D Committee
is still in place under the form of the ARDEP including staff from the two Agencies, FAA and
database. The EEC contributes to the provision EUROCONTROL.
of data to ARDEP.
The US/Europe ATM R&D seminar, which
An annual review, led by EUROCONTROL convenes every 18 months, is another forum
headquarters, of the ARDEP data is conducted where the ATM community exchanges research
by all R&D establishments. ARDEP web site: results. A selection committee examines and
http://www.eurocontrol.int/ardep. selects research papers for inclusion in the
seminar. The papers are made available on an
A similar framework (ARDA) to ARDEP has Internet site managed by the EEC.
been established in the US by the FAA to collect
information on Aviation R&D in the US. This
action is co-ordinated with EUROCONTROL and
includes a common classification by domains of
European and US R&D. 4b Finances are managed
Page 33 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
approved by the Agency governing bodies deliverables by expense managers and project
based on the AFG proposal. leaders.
The Local Procurement Review Group (LPRC) A specific support is provided in all aspects
meets weekly to review procurements in order to linked to the management of contracts with the
verify that financial regulations are followed and European Commission. This support covers the
procurements are in line with EEC strategy. The preparation of formal responses to call for
LPRC regularly issues process measures. proposals, setting up of contracts, and setting up
of cash flow. In addition, support is given to
The Financial Unit of the EEC operates as a facilitate relationships with consortia members.
service to Project Leaders/Expense Managers,
in the implementation of procurement requests. Missions Office
Approval of the agreed procurements is given by
designated officials from the Core Management, The provision of a travel service for EEC staff
or the head of the financial unit, or by the missions has been outsourced to a travel agent
Director of the EEC depending on the amount of under the framework of the Agency Travel
the procurement. The Technical Manager Policy. The fixed costs of the travel agency are
confirms that a service or good has been financed by EUROCONTROL, while as a
delivered according to contract. After counterpart, the commission obtained by the
confirmation, the accounting department pays agency is refunded to EUROCONTROL.
the invoices.
In order to facilitate the reimbursement of
Budget Monitoring mission expenses to staff, an agreement has
The use of the budget is monitored though a been signed with a finance company, which
series of quarterly budget checkpoints. Initial provides staff with corporate individual credit
budget allocations to expense managers are cards. An extensive partnership in this area
based on the agreed annual allocations derived would facilitate the invoicing of mission
from the Business Plan and hence from the Five expenses.
Year Plan. Budget checkpoints are based on a
number of indicators showing the performance
of payment planning and the use of the allocated
budget to date. Credits allocated are 4c Buildings, equipment and materials
renegotiated based on new planned needs and are managed.
cash flow planning and financial performance to
date. The ACB tool has been updated with Infrastructure management
features allowing Project Managers to enter their Most aspects linked to buildings, equipment and
own Planned Payments. materials are managed as outsourced projects
monitored by the TIG unit.
Cash flow management
An increasing level of performance in budget st,
Since January 1 2001, for a period of 3 years,
consumption has been achieved since 1996. the EEC building maintenance has been let to
Once contracts are passed with service an external company. This single outsourcing
providers, the payments can be monitored contract replaced over 30 individual contracts.
directly by the expense managers through the
The contract covers air conditioning, purification,
ACB. The ACB has in 2002 been enhanced with power etc. The company keeps a
reports showing budget allocation, usage and representative permanently at the EEC site, and
payments The actual payment of services and a team of four people, which can be extended to
goods is subject to a validation process initiated ten people, can be called on if required. The
by the financial services who seek approval of problems are managed using a GMAO system
(Computer Assisted Maintenance Management)
Page 34 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
which allows the monitoring of problems and projects and it monitors progress during the
provides maintenance checklists for each piece implementation phase.
of equipment on the basis of information
gathered during the renovation of the building. A During 2002 a contracts were let to install air
hotline service is provided using a generic email conditioning in the so-called extension. As well
address, and problems are tracked and solution as the installations themselves, work was done
reports are provided to the initiators of requests. to provide temporary accommodation to staff
It is planned to introduce a more direct interface and to move them out and back in stages so that
with the GMAO system on the Intranet, which work disruption was kept to a minimum.
will provide more widely visible feedback.
Transport and Mail
Building reconstruction, evolution, The TIG unit manages EEC Service Vehicles,
maintenance which is in charge of the monitoring of their use
The EEC building renovation was initiated in and their maintenance. More extensive
1998 following an expert examination regarding transport requirements, for example to transport
conformity to building regulations. A staff the controllers participating in real time
monitoring group was created in order to simulations, are also managed by TIG.
guarantee that staff opinions and interests were
taken into account. Although the reconstruction The handling of mail and parcels has been
was heavily constrained by the initial structure of contracted to an external company, which also
the building the facilities were designed to allow assures the internal mail distribution.
high degrees of synergy and interaction within
the building. The renovation was successfully Print shop service
completed, within time and budget, in July 2000. Since September 1999, the printing facilities of
The renovated building was inaugurated on 29 the EEC are provided under an external
September 2000 in the presence of the contract. This includes:
President of the EUROCONTROL Permanent • a printshop facility onsite for large print
Commission, the French Minister for requests;
Infrastructure, Transport and Housing, the • a number of self-service print facilities by
President of the EUROCONTROL Provisional means of networked printers/copiers;
Council, the Director of the European • the management of supplies (paper, toner).
Commission's Air Transport Directorate, and the
EUROCONTROL Director General. Staff previously allocated to the printshop were
reallocated to other tasks.
New infrastructure projects are managed
depending on the magnitude of their funding. During 2002 a project was initiated and
For projects over 100K€, it is considered that the completed to replace all network printers.
corresponding proposals should be aligned and
reflected in the Business Plan. Once validated, Meals and refreshments
and the budget agreed, initial contracts may be During the building renovation, meals and
initiated to prepare technical requirements, with refreshment facilities were created which would
possible sub-contracts to address specific facilitate and encourage staff to mix and meet in
requirements issues (security, supervision). An informal surroundings. This increases formal
overall consultation for the main project is then and informal information exchange and fosters
launched on the basis of the technical internal and external communication. A large
requirements. and attractive cafeteria is located in the central
area of the building, close to the atrium, meeting
Smaller infrastructure projects, up to 100K€, rooms, and showroom. This is the place to meet
(which may concern limited improvements to the people from outside the normal professional
infrastructure) can be initiated on the basis of a circle and the place to meet and talk to visitors.
request formulated to the TIG unit, which enters The second informal meeting point is the
in a cycle of budget allocation and execution, modern canteen, which is also situated near to
most generally through an external contract. the centre of the building complex. The catering
service is outsourced, and provides lunch to
To ensure that staff concerns and expectations over 250 people each day, including visitors. A
are taken into account wherever possible, a separate room, which anyone can reserve and
consultation group of staff representatives has use, is available for small groups.
been created: Groupe de Co-ordination
Infrastructure (GCI). This group is consulted General Support
during the initiation phase of infrastructure
Page 35 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Page 36 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
The procedures dealing with the services 4e Information and knowledge are
provided are being progressively documented managed
and published through a web site on the
Intranet, as part of the quality improvement effort
of the EEC. Knowledge management.
Both the Think-Tank initiative of 2001 and the
The ITM unit in co-operation with its Peer feedback from the 2002 EFQM self-assessment
Agency unit, DF/MIS, manages specific pointed out the lack of a knowledge
information technology projects. Such projects management policy and system at the EEC.
have included Agency wide corporate tools such This is of special concern to the EEC because of
as electronic mail and calendar, information the probability of early retirement which will
security systems. The governing body at the result in much knowledge being lost, and
Agency level is the Corporate Information because of the large number of contract staff
Systems Committee (CISC). working on key projects.
During 2002 the ITM unit conducted an internal To respond to these concerns the EEC has
satisfaction survey. The results of this will be launched a knowledge management study
examined and needed improvements supported by a specialist consultant to see what
implemented starting in 2003. approach to knowledge management would best
fit the EEC situation and needs. The EEC is
determined to take a very practical approach.
4d Technology is managed Initial conclusions of the study will be available
in July 2003. A questionnaire has been issued
Managing technology - Technology watch. to senior and middle management to start to
All business areas and units where it is relevant map the current state of knowledge at the EEC.
monitor the evolution of technology. In the
External communication
domain of large ATC screens and simulation
equipment, a common EUROCONTROL policy
including CRDS and EHQ has been elaborated The creation of a Marketing and Information
with the aim to set up a framework agreement Management unit in 1999 has contributed to an
for the procurement of simulation equipment. overall reflection on how marketing approaches
could be relevant to a research establishment
Leading edge technology such as the EEC. Although most of the
Advanced display technology is monitored for its stakeholders and partners are well known in the
potential applicability in the fields of ATM. ATM environment, the reflection around the
Exploratory projects involving 3-D visual and preparation of regular stakeholder surveys
sound systems development have been allows to review the existing range of partners
launched in view of augmenting the realism of while consulting the current base of
data representation in a more human-centred stakeholders. The evolution of the strategy is
direction. Examples of investigations include taken into account by including in the survey
Controller Working Positions using techniques in those partners who are becoming directly
Augmented Reality for applications such as concerned by the EEC actions. It is planned to
Stack Management at Airports and 3D volume include lobbies and pressure groups in the next
sectorisation at Terminal Areas (Project stakeholder survey, considering the increased
VIRTUAL and 3 Ph.D. Theses). Other importance of society and environmental
alternatives for short-term capacity improvement aspects in the EEC strategy.
are also explored by focusing on the use of
proven technology to suggest new operational A large part of external communication at the
procedures. EEC is based on the dissemination of the EEC
reports and technical notes. The reports and
The latest Internet technology was exploited to notes are distributed to around 250
develop the voice-over-IP functionality, which representatives of our stakeholders. Since 2001,
culminated in the AudioLAN product, see section taking into account the wider use of the Internet,
2b above. the reports and notes are announced to our
stakeholders by emails pointing to the download
Web technology is used to implement many address of the reports. Postal mailings of reports
administrative support tools to provide and notes are maintained for a smaller number
generalised access. See sections 3a and 4b of requests, either in paper form or in CDROM
above. form. This approach has greatly reduced paper
consumption. See results in section 8b.
Page 37 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Information is also communicated through Infocentre allows the creation of categories and
participation to conferences, the organisation of subcategories and to manage the documents.
internal workshops, seminars or events as well
as numerous visits. Procedures have been set A classical library service is available which
up to deploy these communication actions. offers subscriptions to periodicals, purchase of
books, loan of books, as well as assistance for
The installation of a permanent showroom in the information search through databases. External
renovated building has given the ability to database searching is co-ordinated with other
perform demonstrations without pre-notification Directorates.
on a series of selected projects. Projects in the
showroom are changed several times per year. While electronic mail has been extensively used
for professional external and internal
Short interviews with the press and the media communication since 1996, questions of general
are sometimes provided either by the Director and social interest to staff are also posted and
EEC or by staff members. These declarations discussed on dedicated internal newsgroups.
are co-ordinated with EUROCONTROL
headquarters when the subject goes beyond the
work programme of the EEC. During 2001, two
French TV magazines, broadcast on ARTE and
FR3, featured sequences shot at the EEC.
Internal Communication
All staff meetings are held twice per year, in
June and December. Middle management
meetings which target different domains of EEC
activity are held quarterly. Following the
recommendation of the think-tank in Q4 2001,
these information meetings have been
complemented from 2002 by a “weekly
information corner” and by an internal
newsletter. These two new media, as well as
internal communication in general, are
monitored by an internal information monitoring
group in order to detect information needs and
opportunities, and to respond to these needs
Page 38 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
5 PROCESSES
Excellent organisations design, manage and improve processes in order to fully satisfy, and generate
increasing value for, customers and other stakeholders.
Stakeholders
Internal
Business
Plan
Communication, General Services,
Communication Prevention, Health)
Page 39 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
guides staff via the intranet to useful procedures financial processes and the testing processes of
and information. the real time simulation life cycle. This has lead
to documenting the corresponding processes.
Applying standards
In the field of software development, the SEU Innovation and creativity is stimulated at the
promotes the use of norms and standards, for EEC through the open and democratic trust
EEC project management. A series of culture and the flat matrix organisation. This has
references to standards are provided on the not only benefited core business activities but
intranet . also support activities and continuous
improvement. Opportunities for process
SEU standards are based on IEEE software improvement are sought from as many sources
engineering standards and ISO9000 standards. as possible, and have resulted in incremental
changes and some breakthroughs. In this flat
SEU also provides support for software quality in organisation the development of methodologies
three areas: is the role of the Centres of Expertiise as well as
their promotion to staff. This is particular the
1. Quality assurance techniques case for the common validation methodology
2. Definition of quality requirements which has been introduced as a specific process
3. Software quality audits mentored by a dedicated unit created in ???.
Page 40 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Page 41 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Page 42 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
explore the feasibility and benefits of new section 4a above. Further results concerning
airspace organisations, new traffic flow spin-off products and services are given in
management schemes, and new working section 6b below.
methods and systems. The EEC offers the
unique service of large multi-ATC-centre, multi-
state real time simulations. The total lifecycle of 5e Customer relationships are managed
a large real time simulation lasts up to 18 and enhanced
months. The ANSP customers are involved
from the very beginning of the project to
accurately specify the requirements, and An essential feature of the matrix organisation,
controllers from the participating member states (see "Overview") is that the responsibility for
work at the EEC for up to 4 weeks during the customer relations related to our products is
simulation execution. The results of the project centred on the Business Areas (BAs). When
are a set of recommendations to improve the looking at each BA it becomes clear that the
efficiency of the airspace under consideration. types of customers and the products are
These recommendations are then considered for different for each BA. Different BAs have
operational deployment by the participating different customers that range from airlines,
ANSPs. airports, ATM service providers to the European
Commission and other Eurocontrol units. Each
In the field of flow management research, the Business Area Manager (BAM) is responsible
EEC is providing the Central Flow Management for the improvements in his own BA.
Unit and its stakeholders with a research
environment where the exploration of specific A project for a corporate contact management
flow management issues can be performed. tool was launched in late 2000; the selection of
Such projects result in recommendation for new the relevant products was made in 2001 an
operational procedures as well as prototypes 2002 was dedicated to the population of the
which are then raised to the standard of real database and correction of discrepancies. The
time systems. The use of macroscopic recording of customer details and contact
simulations allows to evaluate the potential management is now made through the
improvement identified and eventually to check deployment and use of this agency contact
their performance following their implementation. database which allows to identify the links to the
numerous working groups ; this corporate tool
An industrialisation process (section 4a) was allows as well to perform targeted mailing lists.
started in 1998 as a direct result of feedback to be expanded...
obtained from the 1997 stakeholder survey. The
objective was to transfer EEC products to Stakeholder/market surveys (section 2a) are
industry thereby allowing the EEC to better designed to provide satisfaction levels for
focus on research projects. different aspects of the stakeholder relationship
such as EEC ability to deliver results on time,
There is one notable exception to the policy of the professionalism of EEC staff, the availability
focusing on research rather than the support of of EEC staff, and the relevance of services
operational products, and this concerns the EEC offered. Results are detailed in section 6.
real time simulation platform based on the
ESCAPE, IPAS, and AudioLan components. On a project basis, the greatest numerical
This simulation platform is probably the most involvement of customers occurs in real time
powerful real time ATC simulation platform in the simulation execution where up to 40 controllers
world, but its complexity is such that until now can participate in a real time simulation. After
industrialisation is judged to be impossible. each simulation we ask the participating air
Instances are deployed at three Agency sites, traffic controllers to rate our performance. An
Luxembourg, Maastricht, and Budapest. To example of improvement based on this feedback
reduce to a minimum the support workload on concerns the simplification of the payment of
the EEC, extensive training is provided to daily allowance to the controllers. The simplified
recipients so that they can be as autonomous as procedure satisfied controller wishes and
possible. Platform development is centralised at simplified the administration for the EEC.
the EEC and new versions are delivered to other
sites after they have been validated at the EEC. Proactive involvement of customers has been
The EEC has set up the SFM coordination cell organised for customers of the ESCAPE real
which interfaces with remote sites to co-ordinate time simulation platform. User groups have been
deployment and to provide a hotline service. established and meetings are organised on a
ESCAPE deployment is further described in regular basis to discuss their needs and
Page 43 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
2001 2002
Workshops, seminars 12 17
Major Visits, VIPs 51 10
Visitors 220 347
Page 44 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
6 CUSTOMER RESULTS
Excellent organisations comprehensively measure and achieve outstanding results with respect to their
customers.
Page 45 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
return rate. Because of the exceptional return staffing and controller involvement. A dedicated
rate of 1997, a significant decrease was questionnaire is sent to sponsors after project
expected in 1999. The decrease in 1999 and completion in order to obtain specific feedback.
2002 can also be attributed to the lack of The table illustrates the results for the three
maintenance of the stakeholder database. This largest real time simulations in 2002:
weakness is being tackled in 2003 by the MIM LINK2000+, COSIBA, and TRAMS.
business area in collaboration with the Business
Development Manager.
Real Time simulation sponsor satisfaction
2002 target
Link Cosiba Trams
Qualitative market survey 2000+
Overall satisfaction 80% 85% 70% 80%
In 2002 for the first time a qualitative market
survey was carried out by a specialist Project management 75% 75% 100% 90%
consultancy, IPSOS. High ranking managers in Meeting timescales 100% 100% 75% 90%
Meeting objectives 75% 75% 75% 90%
the air transport industry were interviewed to Simulation facilities 75% 75% 75% 90%
obtain their views on sector evolution, Analysis and reporting 50% 100% 25% 90%
EUROCONTROL, and the EEC. See section 2a
above.
Page 46 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Products
Services
EEC Service
unit
SSP Validation of ARTAS v6
Validation of VDL2 for ICAO
Aircraft and transponder monitoring
for the Mode-S implementation
programme
SAS ACAS analysis
ACE BADA
SFM ESCAPE support
NCD Capacity planning
RVSM height monitoring
SEE Noise studies
Page 47 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
7 PEOPLE RESULTS
Excellent organisations comprehensively measure and achieve outstanding results with respect to their
people.
7a Perception Measures
The EEC has conducted three staff satisfaction surveys in 1998, 2000,and 2002. As a consequence of
the EEC’s first EFQM self-assessment in 1998, a ‘people satisfaction’ task force was formed and
entrusted with developing a questionnaire for the EEC. The same questionnaire with minor modifications
was used in 2000. The Agency has recognised the importance of staff satisfaction surveys and the 2002
survey was the first one to be conducted Agency-wide with a unique Agency developed questionnaire,
thus allowing for comparison and transparency within the Agency. This questionnaire was more
comprehensive than the EEC local questionnaire but key questions remained enabling trend
identification.
The conduct of staff satisfaction surveys is now part of the annual EEC operational cycle. The
aggregated overall staff satisfaction and the response rate are both elements of the EEC balanced
scorecard. The survey results are communicated internally, via the EEC’s Intranet and at a dedicated
weekly information corner for all staff. A detailed and comprehensive action plan is set up and executed
in order to address the issues identified by the survey results.
The coding of benchmarks in the last column is as follows: Ip=IPSOS, Isr=ISR. The list of measures
which were taken as a result of the 2002 survey are provided in section 3a above.
Page 48 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Accident frequency
2000 2001 2002
Staff satisfaction survey return rate 4.33 0.00 3.94
Page 49 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Suggestions By Status
60
50
Implementation
Implementation
40
Refused
Implemented
30
Not Supported
20
Supported
10 Under Review
w
n
d
ed tion
d
tio
te
te
te
ie
en
or
or
ev
ta
us a
ef ent
pp
pp
en
em
rR
Su
Su
em
em
e
pl
nd
Im
ot
pl
pl
U
Im
Im
N
R
AIPE subsidy
2002 2003
21000 21000
Page 50 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
8 SOCIETY RESULTS
Excellent organisations comprehensively measure and achieve outstanding results with respect to
society.
Students at EEC
2001 2002 2003 to
date
18 17 7
8b Performance Indicators
The EEC has introduced a scheme to
encourage staff to contribute small amounts of
foreign currency to charity when they return from
Ecological impact
mission. A collection box is placed in the EEC
main entrance. The charity "Secour Populaire"
Home-working
received the donation. The figure in the table is
The EEC has pioneered home-working in the
in euros.
Agency. See section 3e. This facility gives
Donations to significant added flexibility to staff who need it
charity and it also has a positive impact on the
2002 environment by reducing the number of
224 kilometers driven.
A partnership has been entered into with 2001 2002 2003 Target
another local employer, SNCF, the French Number of staff 5 15 24 ↑
national rail company, to ensure the viability of a home-working
Estimated kms not 3100 ↑
local childrens' activity centre. The activity driven per month
centre was threatened with closure because of a
reduction in the numbers of children. The
Eurokids project has delivered benefits on all Printer paper consumption
sides, to local children, and to the children of Despite the steady increase in the number of
EUROCONTROL staff. The increase in the persons working on site there has been a steady
numbers of children has ensured the decrease in the amount of printer paper
sustainability of the activity centre and has consumed. This has been due to two
enabled more ambitious and interesting approaches. Firstly research reports and notes
activities to be undertaken. are now made available and distributed
electronically, and secondly, printing equipment
Eurokids (number of kids)
has been continually upgraded to enable easy
2001 2002 2003
printing recto-verso and 2-up. Recto-verso
February 19 22 printing is now the default printing mode.
April 25 26
Summer 52 50 Printer paper consumption/tons/yr
1999 2000 2001 2002 target
Autumn 12 20
19.5 18 16.5 15.3 ↓
Wednesdays 10 10
Christmas Show 17 50
Page 51 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Utilities
2001 2002 Target
Electricity (kw/m2/yr) 373 321 ↓
Water (m3/m2/yr 0.38 0.34 ↓
Recycling
Waste recycling
The figures in the table are in numbers of
standard skips.
Batteries
Page 52 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
The EEC has identified and tracked performance indicators for many years, and is continuously
seeking to improve. During 2002 in collaboration with other directorates in the Agency, an EEC
balanced scorecard (BSC) was developed. This enabled the EEC to identify and mitigate
shortcomings in the coverage of EEC performance indicators.
CUSTOMER
2001 2002 2003
kpi result result target
Milestones 72% 68% 85%
Publications 92 93 91
EEC Balanced
Scorecard Stakeholder 80% 82% 85%
31.3.2003 satisfaction (1999) LEARNING AND GROWTH
RT sim volume 795 900 1000 2001 2002 2003
kpi
result result target
INTERNAL BUSINESS R&D diversity 12.9% 10.1% 15% Training 9,8 9,3 10
2001 2002 2003 Skill 9 6 6
kpi result result target orientation
Project 76% 80% 95% People 70% 80% 80%
management satisfaction (2000)
Business 306 350 400 PA completed 89% 90% 90%
Excellence (2000) SSS return 21% 86% 80%
Matrix 68% 80% 85% rate (2000)
efficiency Suggestions 92 88 90
FINANCIAL
Filled posts 97% 100% 98% Staff ratio x 33% 33%
2001 2002 2003 (min)
kpi result result target
OPS 37% 63% 66%
Cash flow 98% 98% 100% reallocation
efficiency
Overhead 27% 29% 30%
Funding ext 5 3 8
The EEC BSC is a distillation of the most important EEC performance indicators and contains selected
indicators from customer, people, and key performance results. The BSC is reviewed quarterly in a
joint meeting of core management and performance indicator owners. Corrective action is triggered if
an indicator is off track regarding its target. The EEC BSC is an integral part of EEC management and
it is included in the standard EEC visitor presentation. See chapter 2 for further details.
These measures are key results defined by the The three year trends in the second table
organisation and agreed in their policy and demonstrate that the EEC has largely
strategies. succeeded in aligning funding with strategy by
increasing funding to the main strategy
Funding the strategy implementing BAs.
Page 53 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Strategy implementation:
Safety first
In 2002 the EEC was set an objective by its Business area SAF implemented the safety first
governing body to increase internal and strategy. The extract from the table above
external funding in order to increase the total shows that funding is aligned with strategy.
amount of funding available to research.
Internal funding is defined as funding originating Funding aligned with strategy
BA 2000 2001 2002 Trend Strategy
from other directorates in the Agency, currently
SAF 1.72 1.94 3.00 ↑ ↑
mainly EATM, and external funding is defined
as funding originating from outside the Agency,
Safety is an essential aspect of research and
currently mainly from the European
design in ATM and therefore it is important that
Commission. In order to gain insight into recent
the EEC strives for higher levels of safety
behaviour, the figures for 2001 were calculated
awareness, more positive attitudes, and
in retrospect. Figures are in meur.
commitment to safety. The deployment of this
Internal funding
safety culture strategy at the EEC is measured
2001 2002 target by a set of leading indicators, and a series of
14.5 12 14 lagging indicators based on a Safety Culture
Maturity Model (SCMM) survey.
External funding
2001 2002 target Safety culture deployment (leading)
5 3 8 2002 2003
planned
PMPs addressing safety 18% 40%
Safety related training - people 38 49
Safety related training - days 49 100
Skilling the strategy
Within the skill orientation plan a second level The SCMM survey was carried out in the EEC
strategy aims to gradually reallocate a major during March 2003. There were 36
part of the operational skills (ex controllers) respondents from different projects and
from working on current operations projects to business areas. Both staff and contractors
working on research projects. This indicator is participated. The survey characterised each
the % of operational staff working on research level of maturity of each safety culture element,
projects. and respondents gave their opinion of where
the EEC was positioned.
OPS reallocation
2001 2002 target
37% 63% 66%
Page 54 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
The overall results indicate that the EEC is at level 2.38, indicating that we are between level 2
(managing) and level 3 (involving. The overall standard deviation between respondents was +/-
0.88,indicating that respondents generally had similar points of view. A follow-up survey is planned for
2004.
Page 55 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Strategy implementation:
Towards a real implementation of new concepts
Business area ACS is the prime implementer of the "towards a real implementation of new concepts"
strategy. The extract from the table above shows the steady increase in funding which is aligned with
strategy.
As explained in BP section 4.1.2, one of the principal approaches to implement this element of strategy
consists of technical consolidation of the live trials platforms and more systematic use of these platforms
in the validation process. This allows us both to perform more realistic validations and to reach a wider
audience of ATC controllers through the installation of prototyping platforms close to the operations
rooms. This helps to obtain a real buy-in from ATC controllers and from ANSPs, which is a vital step
towards real implementation. The following table depicts the current state of the results of this strategy.
1) The DSI controller working position HMI specifications were developed by the EEC over many
years in collaboration with ANSPs and industry. They were used as input to the specifications for
the new Swedish ATC system currently undergoing pre-operational trials in Malmo. The main
supplier is Thales who are basing their new core product on this system, S2K. Follow on clients
include: Hungarocontrol (H), Skyguide (CH), ANA (PL), and Naviair (DK). All these ANSPs used
the real time facilities of the EEC to develop their understanding of stripless systems and to
prepare system requirements.
Page 56 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
A powerful approach to implement this strategy The total INO sponsored PhD theses and
is to ensure that all projects, not only those university studies is shown in the following table.
which belong to the ENV and PFE business
areas, address economic and environmental INO sponsored PhD theses and
issues. This requirement is systematically university studies
checked in the regular project review cycle. The 2002 2003 target
objective if that all projects shall comply. The 17 20 ↑
EEC is at the beginning of the deployment of
this approach.
Page 57 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Page 58 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
Continuous improvement
Continuous improvement
funding
2001 2002 2003 to
date
119 264 308
Page 59 of 60
EUROCONTROL EXPERIMENTAL CENTRE
EFQM self assessment 2002 version 2.0
GLOSSARY
ACARE Advisory Council for Aeronautics EPDA EATMP Project Delegation Agreement
Research in Europe ERS EATMP Reference Industry-based ATM
ACB Access to Business Information Simulation and Trials Platform (BA)
ACE ATM and CNS Systems Engineering ESCAPE EUROCONTROL Simulation Capability
(CoE) and Platform for Experimentation
ACS ATM Concepts and Studies (BA) EUROCAE European Organisation for Civil Aviation
ADP Aeroports de Paris Electronics
AECMA European Association of Aerospace FAA Federal Aviation Administration (US)
Industries FIN Finances (SET)
AFG Advisory Financial Group FREER Free Route Experimental Encounter
AMAN Arrival Manager Resolution
AMI Administrative & Management GNS Satellite Navigation (BA)
Information Software (SET) HQ/MIS Head Quarters/Management Information
ANSP Air Navigation Service Provider Service
ARDEP Analysis of Research and Development HRM Human Resources Management (SET)
in EUROCONTROL Programmes IANS Institute of Air Navigation Services
AS Administrative Services (EUROCONTROL)
ASAS Airborne Separation Assurance System IATA International Air Transport Association
ASC Analysis and Scientific (CoE) IEEE Institute of Electrical and Electronics
ATC Air Traffic Control Engineers
ATCEUC Air Traffic Controllers European Unions IFATCA International Federation of Air Traffic
Coordination Controllers Associations
ATFM Air Traffic Flow Management IFS Infrastructure, Finance, Staff (EEC Core
ATI ATM Implementation (BA) Manager
ATM Air Traffic Management INDRA Spanish ATM system provider
BA Business Area INO Innovative Research (BA)
BP Business Plan INSEAD European Institute for Administration
CARE Co-operative Actions of R&D in IP Internet Protocol
EUROCONTROL ITM Information Technology Management
CEATS Central European Air Traffic Services (SET)
CENA Centre d'Etudes de la Navigation LPRC Local Procurement Review Committee
Aerienne MEUR Millions of Euros
CFMU Central Flow Management Unit MUAC Maastricht Upper Area Control Centre
CIC Continuous Improvement Centre ODID Operational display and input
CM Core Management development
CNS Communication Navigation Surveillance OPS Operational Services (CoE)
(BA) PFE Performance, Flow Management,
CoE Centre of Expertise Economics and Efficiency (BA)
COSAAC Common Simulator to Access ATFM PMP Project Management Plan
Concepts PRIF Procurement InterfaceTool
CRDS CEATS Research Development and PRU Performance Review Unit
Simulation Centre R&D Research and Development
DAI Development and Integration (CoE) RADAR Results, Approach, Deployment,
DEEC Director EEC Assessment and Review (EFQM)
DFS Deutsche Flugsicherung RTCA Requirements and Technical Concepts
(German ANSP) for Aviation
DG Director General SAF Safety (BA)
DGAC Direction Generale de l'Aviation Civile (F) SDR Special Advisor (EEC Core Manager)
DG RTD Directorate General Research and SET Services Enabling Team
Technological Development (EC) SFM Simulation Facility Management (CoE)
DSI Denmark Sweden Interface SICTA Sistemi Innovativi per il Controllo del
EATMP European Air traffic Management Traffico Aereo
Programme SMU Social Medical Unit (SET)
EC European Commission SSS Staff Satisfaction Survey
EEC EUROCONTROL Experimental Centre TIG Transports & Mail Infrastructure General
EHQ EUROCONTROL Headquarters Support (SET)
EMB EEC Management Board TQ Total Quality
EMC EATMP Management Committee TQA Total quality Agent
EMM Extended Management Meeting TRS Task Requirement Specification
ENAC Ecole Nationale de l"Aviation Civile TS Technical Services
ENAV Italian ATM Provider VDL VHF data link
ENV Environment (BA)
Page 60 of 60