Quality Indicators of Adult Education - S. Mozina
Quality Indicators of Adult Education - S. Mozina
Quality Indicators of Adult Education - S. Mozina
IN ADULT EDUCATION
The project is financed by the European Union from the European Social Fund and
the Ministry of Education, Science and Sport of the Republic of Slovenia. The project
is a part of the Operational Programme for Human Resources Development for the
period 2007–2013, the priority axes Development of Human Resources and of
the Life-long Learning and Improving the Quality and Effectiveness of
Education and Qualification Systems.
Page 3 od 116
TABLE OF CONTENTS
PAGE
I. A COLLECTION OF QUALITY INDICATORS IN 7
ADULT EDUCATION
The purpose of quality assessment and development for which 7
we can use the collection of quality indicators
Types of adult education for which we can use the collection of 9
quality indicators
How the quality indicators collection is structured 11
Professional glossary used in the collection of quality indicators 15
II. HOW TO USE THE COLLECTION OF QUALITY 17
INDICATORS
III. OVERVIEW AND DESCRIPTION OF AREAS, 21
SUBAREAS AND QUALITY INDICATORS IN
ADULT EDUCATION
IV. QUALITY AREAS 21
1 MANAGEMENT AND ADMINISTRATION 24
1.1 Management 25
1.1.1 Vision 26
1.1.2 Mission 26
1.1.3 Values 26
1.1.4 Long-term and short-term goals 26
1.1.5 Organisational structure and work organisation 27
1.1.6 Communication and information flow 27
1.1.7 Money management 28
1.2 Quality assessment and development 29
1.2.1 Internal quality system 30
1.2.2 Self-evaluation plan 30
1.2.3 Implementation of self-evaluation 30
1.2.4 Quality report 30
1.2.5 Action plans for quality development 31
1.3 Cooperation with partners 32
1.3.1 Established partner cooperation 33
1.3.2 Information flow in partners networks 33
1.3.3 Partner cooperation in common projects 33
1.3.4 Cooperation of partners in education 33
1.3.5 Cooperation of partners in assessing and developing the quality of 34
education
1.4 Organisation of status 35
1.4.1 Adult education in normative acts 36
1.4.2 Systemisation of workplaces for adult education 36
1.4.3 Decisions made by staff in adult education 36
1.4.4 Transparency of adult education financing 36
Page 4 od 116
6 PLANNING EDUCATION 65
6.1 Implementation planning on the level of the educational 66
programme
6.1.1 Implementation curriculum for an educational programme 67
6.1.2 Evaluation and recognition of previously acquired knowledge and 68
experience
6.1.3 Analysis of the characteristics and educational need of a study group 68
and individuals
6.1.4 Implementation plan for a study group 69
6.1.5 Implementation plan for individual organisational models 69
6.2 Implementation planning on the level of programme units 71
6.2.1 Implementation planning in group organisational models on the level 72
of programme unit
6.2.2 Implementation planning in individual organisational forms of 72
education on the level of programme unit
7 IMPLEMENTATION OF EDUCATION 73
7.1 Educational process 74
7.1.1 Implementation of the educational process 75
7.1.2 Communication in the learning process 75
7.1.3 Ways and methods of testing and evaluating the participants’ 76
achievements
7.2 Learning sources 77
7.2.1 Types of learning sources 78
7.2.1 Didactic characteristics of learning sources 78
8 DEVELOPMENT WORK IN SUPPORT OF EDUCATION 79
8.1 Development work 80
8.1.1 Forms of connections in development work 81
8.1.2 Participation in expert groups 81
8.1.3 Participation in projects outside the organisation that ensure 82
development and experience exchange and good practice
8.1.4 Cooperation with professional institutions, associations 82
8.1.5 Participation at panels of experts, conferences and other professional 83
meetings
9 SUPPORT FOR INDIVIDUALS IN EDUCATION AND 84
LEARNING
9.1 Diversity and accessibility of support for individual 85
9.1.1 Diversity of support for individual in education and learning 86
9.1.2 Accessibility of support for individual 86
9.1.3 Informing individual about the forms of support within the 86
organisation
9.1.4 Informing individual about the forms of support outside the 87
organisation
9.2 Study support for individual 88
9.2.1 Study help 89
9.2.2 Consultations and mentorship 90
9.3 Guidance support for individual 91
9.3.1 Guidance for individual before and during matriculation into 92
education
9.3.2 Initial interview 92
Page 6 od 116
We can use the reformed collection of quality indicators in adult education for two
main purposes:
This fundamental decision on the purposes for which we can use quality indicators
later influences how quality assessment and development will be realised and, even
more importantly, who will lead the project.
The next basis we set when we were reforming quality indicators was in fact the
distribution of responsibility between different actors in adult education,
because all those who assess adult education, encourage it and direct its
development on the national level as well as those who put it into practice are
equally responsible for its quality.
Colleges and schools that develop andragogy and related sciences can also be
considered as essential in development of this activity.
But of course the central leaders of the adult education on the regional and
local levels are the educational and other organisation that carry out this
activity (their managements and staff), and all other subjects that are
connected to them or are interested in their activities (employers,
development and other factors from the environment, municipalities etc.)
Page 8 od 116
Emanating from the two basic objectives, for which the collection can be used, and
the distributed responsibility for quality assessment and development among the
actors, the reformed collection of quality indicators includes different methods for
quality assessment and development. These are:
1
When the collection of quality indicators in adult education was created, the accreditation hasn't been formally
introduced into practice yet, so the goal of the reform and the new recommendation is also to encourage its
systemic implementation. In this model, we're presenting accreditation as one of the constituent parts of the
framework for quality assessment and development of adult education. The definition which quality indicators,
standards and criteria can be the subject of accreditation has been prepared only in the form of
recommendations and guidelines for the bodies competent for making decisions on which quality indicators and
corresponding standards and criteria will be included in the accreditation processes and thus be given a
normative value.
Page 9 od 116
Figure 1: Levels, methods and project leaders responsible for quality assessment
The reformed collection of quality indicators can also be used if we decide for
combined approach. In Slovenia, for example, we have been implementing
expert external evaluation: it is intended to assess the quality of adult education
organisations' activities externally and in includes a combined approach. If we
decide to use the reformed collection it would first be used by the organisation
staff which would prepare self-assessment of the situation for the selected fields
based on quality indicators. In the continuation, the same quality indicators would
be used by external assessors who would carry out the expert external quality
assessment of the selected fields.
Types of adult education for which we can use the collection of quality
indicators
In addition to the basis that influenced the creation of the reformed collection of
quality indicators for adult education that we have already presented, we would
like to add that we conceived it primarily with the thought that it would be used in
the part of adult education that is in public interest and is financed by
the state, so it is particularly important that at least minimal quality standards of
education are ensured.
Page 10 od 116
The collection can be used to assess formal and informal adult education.
Because formal education is, in its nature, more structured and regulated than the
informal one, some quality indicators included in the collection are very important
for assessing the quality of formal adult education, but less important or
inappropriate for the quality assessment of non-formal education. In such cases,
individual quality indicators are marked to be used in assessing formal education
only, or that it should only be used for non-formal education when it would be
sensible to do so. The majority of quality indicators, however, can be used in
quality assessment for formal and non-formal adult education.
The collection itself, at least on a more general level, allows the quality
assessment of the infrastructural activities in adult education, such as
self-learning centres, ISIO guidance centres, knowledge exchange portal, and
similar. However, it is primarily created to assess and develop quality in
educational activities. The fields and quality indicators follow the conceptual
structure of andragogical cycle and vocabulary in the collection reflects that.
However, certain fields, for example, management, staff development and others,
can be sensibly used when assessing the quality of infrastructural activities. But
the quality indicators don't encompass all the aspects and particularities of these
activities, so some infrastructural activities of adult education have already
developed tailored quality models, which also means collection of indicators (for
example the ISIO guidance centres2), and others might follow in the future.
We also have so say that in the cases of levels of education covered by the
reformed collection of quality indicators, parts of the collection can be used on the
level of organisation – for example the field of management and
administration, and in some cases it can be used on the level of individual
educational programme – for example when we are assessing if the staff fulfils
the formal conditions to carry out a certain educational programme. Some quality
indicators can be used by teachers on the level of a programme unit, when,
for example they assess how well it was realised, while the same quality indicators
can be used by the manager of adult education or a quality group to assess the
realisation within an educational programme, or all educational programmes
carried out by the adult education organisation. Thus our basic recommendation is
to use the collection with consideration and professional responsibility. There are
no recipes on how to use it. If we use it professionally and thoughtfully, it offers
numerous combinations and the use on different levels of education, and for
different types of education.
2
The model of quality assessment and development in ISIO guidance centres is accessible at:
http://kakovost.acs.si/doc/N-470-1.pdf.
Page 11 od 116
quality areas,
quality subareas,
quality indicators,
quality standards and
quality criteria.
Quality areas are self-contained units of content, they provide the collection with a
wholesome approach to different aspects we need to be careful about in assessing
and developing quality in adult education in an adult education organisation or other
organisations that also educate adults.
Quality areas are further structured into quality subareas. The latter steer us more
precisely to some narrower aspects dealt with within a particular quality areas. These
are units wholesome in their contents, which define or direct more precisely the
activities for quality assessment and development in particular quality area. They
help us limit the wider basic quality area in contents and focus our attention more on
the selected aspects of the organisation activities that the quality area deals with in
basic terms.
Quality indicators direct us towards the most important quality factors in a certain
field or subarea. We need them to describe more in detail those aspects whose
Page 12 od 116
quality we assess. When using them, we must pay attention to the connections
between different areas and subareas. Quality indicators are interlinked, just as the
work in an educational organisation or another organisation that educates adults is
interlinked.
Quality standards are statements that describe the expected/desired quality of the
most important aspects of the functioning of an adult educational or similar
organisation. On the most general level, creating quality standards helps us answer
the question what kind of adult education we want.
Here we need to explain that the same criterion can have a different role or aim in
different types of assessment. Professionally, we know different classifications of
indicators and corresponding quality criteria. One of the most widely adopted
classifications is the one in which indicators and criteria, depending on their
objective, are determined as analytical, communication and normative.4 Considering
that the same criterion can be used for different purposes and that these purposes
are often intertwined, analytical criteria are mostly intended for us to better
understand the causal or/and systemic connections within the working of the
educational system, organisation, programme, as well as the connections between
education and society more generally.
izobraževanje odraslih [A model for quality assessment and development in guidance centres for adult
education]. Ljubljana, Slovenian Institute for Adult Education.
4
Lassnigg, L. (2003). Indicators for Quality in VET. European experience. Institute for Advanced
Studies, Vienna.
Page 13 od 116
Normative criteria should be the ones most linked to the achievements in the
society or a certain system (including a quality model). From this point of view, they
are also the most binding or have the most direct and immediately observable
consequences.
In the continuation we will use presented classification to help ourselves answer the
question what are the consequences if an educational (or similar)
organisation for adults doesn't meet certain criteria and consequently
doesn't meet the defined standard of quality in full. Let's explain this on
examples of different types of quality assessment. When, for example, an
organisation finds out in self-evaluation that it doesn't meet a certain criterion, this
will become its basis to plan activities for improvement so the criterion can be met in
future. We could then say that the criterion will be used in analytical and
communication purposes. The responsibility for taking action thus remains in the
domain of the organisation and the staff working in it.
The procedure will have an even greater, normative effect, when it is used in the
process of accreditation. In the accreditation models standards and criteria have a
normative value. It means that they represent the minimal agreed quality the
organisation has to achieve in order to be able to carry out a certain activity or
programme. Such criteria are for example connected to providing adequate
premises, formal education programme providers must have etc. If an organisation
doesn't meet the determined standards it can't begin the activity (if it's the first
accreditation) or can't continue with it (if it's the case of repeat accreditation).
In the approach we're presenting in this manual, this would mean the following:
If the criteria are used in accreditation, the organisation that doesn't meet
them won’t get accredited to carry out an activity, a programme and similar.
The organisation might get accredited even if it doesn't meet a criterion only if
the model of accreditation specifically allows for organisation to obtain
accreditation without meeting a certain criterion. To give an example: maybe
it is required that an organisation wishing to provide public service in adult
education has a self-study centre. But self-study centres are a part of a public
network, and the expansion of the network is a matter of national politics: it
can happen that in certain times the expansion is not possible for different
reasons (financial or others) and the organisation has no possible way of
opening a self-study centre that would be a part of the national network. In
such case, it could be agreed that the organisation obtain the accreditation
even though it doesn't comply with the criterion. A second example would be
if the model of accreditation presumed that some criteria are of a nature that
an organisation must meet in order to begin the activity, while others can be
assessed at re-accreditation. If the organisation didn't meet certain criteria at
the first accreditation, it could still get accredited, and would have to prove
compliance with the rest at re-accreditation. An example for this would be the
recommendation of accreditation criteria for establishing and work of
dislocated units of the ISIO guidance centres.5
5
Model for quality evaluation and development in ISIO guidance centres. Publication accessible at:
http://kakovost.acs.si/doc/N-470-1.pdf.
Page 15 od 116
In the continuation, we'll explain certain expressions we use in the quality indicators
collection.
Staff in the organisation that educates adults: Because the quality indicators
collection will be used in different types of organisations, we will come across very
different expressions to mean the staff dealing with adult education as well as
different forms of their actual employment. We thus know adult education managers
and organisers, programme fields managers, teachers, mentors, experts who carry
out activities supporting education, administrative-technical staff etc. we decided to
use the following expression in the collection, as needed:
Staff: will be used when the contents include all the staff regardless of their
special tasks;
Experts, andragogical staff: when we're using these two expressions we'll
be talking about all the expert staff that participate in adult education: the
part of the staff that realises the actual educational process, the staff that
takes care of planning and organisation of education, and the staff that works
in supporting activities for adult education. The expression “experts” will be
used in certain parts to simply name that part of expert staff that isn't directly
involved in education. So this expression will be used when it is important to
show the difference between staff involved in direct education process (for
example teachers, mentors) and other expert personnel;
the adult education organisation and those who work with the organisation as
external collaborators;
Teacher, mentor: there are different names in adult education for people
who carry out direct education. The classic expression is still the most often
used, but often mentor is used, while we also know coaches etc. In the
collection, we'll use “teacher” as the widest term that encompasses all these
notions. When we write about a teacher, we will thus also include mentors,
coaches etc. If there is a particular need to draw attention to possible
differences or specific traits of particular roles (for example PYLA mentor,
study circle mentor, e-mentor) we will also use mentor;
Organised form of education: when we're talking about education that can
be carried out in different organisational forms (for example a course, study
circle, e-education);
Study circle, course, e-education etc. when it's about the specifics of
individual organisational forms that need to be considered when we're
assessing and developing quality of adult education.
Page 17 od 116
As we have shown so far, we’ve conceived the quality indicators collection in a way
that it can be used for different purposes and use different procedures for assessing
and developing quality. If we consider the objective and the procedure, the quality
indicator collection can be a useful tool for:
ministries and other bodies who will monitor adult education and award
accreditations to educational programmes or entire education organisations,
We would like to recommend that all those who are planning internal or external
monitoring, self-evaluation or external evaluation or accreditation of the educational
or other organisation that educates adults, an educational programme or
infrastructural activities in the field of adult education consult the manual as soon as
they begin deciding what should the subject of quality assessment be.
The manual uses the term teacher, but numerous statements are true also when a a mentor appears
6
in a programme (for example, in the programme PLYA – project learning for young adults, a mentor
of study circles, a mentor in the centre for self-learning, an e-mentor, or when we have a group of
teachers brought together by work with certain target groups of adults or specific educational
programmes, for example, a teacher in literacy programmes.
Page 18 od 116
Figure 3: Procedures of quality assessment in which we can use the manual Quality
indicators in adult education
We can use the manual when deciding in which quality area we will carry
out internal or external monitoring, self-evaluation, external evaluation or
accreditation. The selected quality area reflects the idea which areas or
activities are so important within the organisation that they require periodic
quality assessment to ensure quality standards, and implement improvements
if necessary.
In the third step we’re even more concrete. By selecting quality indicators
that will be the subject of the analysis, we deepen the quality assessment and
direct it into a precisely determined subject of analysis.
Once we’ve selected the quality indicators that will be the subject of our analysis,
we can continue using the manual which will help us to deepen our understanding
of the contents we’ve been directed to by the quality indicators. Let us now take a
look at the elements every quality indicator contains and how they can be helpful.
Page 19 od 116
For every quality indicator, there is a defined quality standard. This tells us
what is the defined or anticipated level of quality for the indicator. Quality
criteria are also determined, they help us assess whether the educational
organisation meets the defined quality standard fully or partly.
Let’s look at an example for the selected field RESULTS and a subfield GENERAL
SUCCESS OF INDIVIDUALS IN EDUCATION.
Table 1: a case of a defined quality indicator, quality standard and quality criteria
From this aspect, the manual can be used in different phases of external and internal
monitoring, self-evaluation, external evaluation or accreditation. First in the planning,
when we pose different (self-)evaluation questions which will help us assess whether
quality standard is met. And again when we have gathered data ready to be
analysed and evaluated to find out how much we meet quality standard. And finally
when we plan measures for improvement if we find out that the quality standard is
not fully met.
The manual offers recommendations and directives for all these cases. Every quality
indicator has the following contents structure:
Page 20 od 116
We’ve already explained the meaning and the purpose of quality standards and
criteria. It is recommended that we study them carefully when we begin planning the
questions that will use for quality assessment, because they help us understand what
we’re actually measuring.
The manual is conceived so that when we’re creating quality assessment questions it
directs us even in the section in which the quality indicator is described. That section
includes a number of examples for what we need to pay attention to, the
questions we need to ask to get the answers on how much the quality
standard is met. Of course, we’re here only listing examples, and each evaluator
will be able to form different questions when she or he decides that they make sense
and are necessary in regard of the aspect of quality she or he is assessing and in
regard of the purpose and type of evaluation she or he is carrying out.
We must point out that not every quality factor can or should be assessed with all
the methods of quality assessment. Therefore, we have listed recommendations
when each quality indicator should be used in the self evaluation process,
at internal or external monitoring, external evaluation or accreditation. The
same indicator can be used, for example for self-evaluation and external evaluation.
The manual is again helpful in the phase when data and information have already
been collected, evaluated and we have found out to what extent the quality standard
has been met and we can plan for necessary improvements. For every quality
indicator, the examples for possible measures for quality development are
Page 21 od 116
The overview and description of fields, subfields and quality indicators leads us
through all the factors that we can say define the quality of adult education.
The method we chose to define the reformed collection of quality indicators in adult
education stems from a methodological starting point that quality fields and subfields
as well as their corresponding quality indicators can and should be interlinked.
External and internal connections are both important. The external connection
tells us that the areas, subareas and quality indicators must be linked with the
objectives of the activity for which the quality indicators collections will be used.
Internal connection means that the quality indicators set within a certain quality field
must be harmonised and linked and shouldn’t contradict each other.
Knowing the results and effects of adult education is for example one of the basic
pieces of information that tells us about the quality of the activity, its effectiveness
and at the same time on what return of investment into it did we get. However,
when we’re talking about improving the quality of education, simply knowing the
results and effects isn’t enough. The data on participant (dis)satisfaction with
education, percentage of drop-outs etc. don’t explain what caused the
(dis)satisfaction, and what the main reasons for dropping out were. Only when we
look into the input and process factors and their quality can we understand the
achievements and the effects, and it is with the influence the improvement of these
factors that we can improve the output factors, measurable in achievements and
effects.
It is for this reason that we delved into the very concept of the existing collection of
quality indicators in adult education and completely reformed it in the process of
preparing a new collection. We used the process model of quality7.
Accordingly, the quality areas are structured depending on whether they represent:
7
This is the expansion of the originally economic model as a tool of narrow economic analyses to the entire
development, which in addition to the economic includes also social, political and other aspects. The model
established itself as a wider development model after World War II and gradually, in addition to the initial
elementary categories of input and output factors also included the categories of immediate effect (“outcome”,
“result”), indirect effect or influence (“impact”), process, context and some other categories. In education, this
model is known as the CIPP model (“context”, “input”, “process”, “output”), and the author of its application to
the education field is D. Stufflebeam (1983, 2000).
Page 22 od 116
The first group of factors – the transverse factors – includes activities and processes
that cannot simply be placed among the input, process or output factors, but they
touch all of them. Among the transverse factors we’ve listed management and
administration, which define the quality of the management and administration
processes from organisational and contents point of view, on different levels, in
different processes. Without the awareness how management and administration
influence all the processes of planning and execution of adult education and, of
course, without the directed activities for the quality of these processes, it would be
difficult or even impossible to achieve quality in other fields.
they need for their work and self-realisation – all these are conditions that need to
be met to expect good results and effects of adult education.
Thinking about the process factors helps us to clearly define the basic educational
process and its characteristics. At the same time, we define supporting processes
among the process factors – these are the processes that can help the quality of the
basic process and support it.
Among the process factors we’ve emphasised the planning of education and the
implementation of education – the two central areas that have to be the focus of
our attention when we’re dealing with the questions of adult education quality. Of
almost equal importance are the fields development work to support the
education process and the support of individual in education, which
importantly complement the previous two fields, because in adult education support
to individuals is almost as important as the education itself, and without development
work it is difficult to imagine any kind of progress, particularly progress in quality
development.
This is a group of factors that are seen as the results and effects of education
activities. In different classifications, some use a unified category “results” when
defining outcome factors. But increasingly often, the division of outcome factors into
“results” and “effects” is used. In our case, the results are the direct, immediate
results of the educational activity, while the effects mean measuring consequences,
effects that the results have on individual participant and the immediate or wider
environment. Precisely because various factors influence the effects, they are hard to
distribute in education, and especially hard to measure. Despite such methodological
snags it makes sense to consider the basic effects adult education causes and
attempt to define them.
The last group of factors thus includes two fields that could also be considered the
end goal of the entire activity. These are the fields results and effects, in which we
assess the quality of results that can be measured or assessed at the end of the
educational process, or the quality of the long-term effects adult education has on an
individual, as well as on the society.
Every field is further divided, as we have explained before into a greater or smaller
number of subfields. In order to define more precisely what our interest is in each of
the subfields, we introduce them with short descriptions, a sort of an expert starting
point explaining what interest us in this subfield that is related to quality, and at the
same time we’re briefly introducing the next level of structure, the quality indicators.
With brief descriptions, we set and found them in the subfield – and explain why
these particular indicators, alone and in combination, define the quality of adult
education.
Page 24 od 116
QUALITY AREA
MANAGEMENT
SUBAREA
MANAGEMENT
INDICATOR: VISION
INDICATOR: MISSION
INDICATOR: VALUES
Quality Adult education organisation has defined values for its activity.
standard
Criteria Values of the adult organisation work are recorded and defined.
The employees have actively participated in defining values.
Values are used in public (promotional brochures, the web etc.).
The most important pieces of information about the course of work with adults
in an adult education organisation are available for the staff in writing.
For a more effective informing intranet and other up-to-date information-
communication methods are available.
SUBAREA
QUALITY
ASSESSMENT AND
DEVELOPMENT
INDICATOR INDICATOR
Quality report Action plan for
quality
development
Page 30 od 116
SUBAREA
COOPERATION WITH
PARTNERS
INDICATOR INDICATOR
Established cooperation Information flow within
with partners the partner networks
ORGANISATION OF STATUS8
SUBAREA
ORGANISATION OF
STATUS
INDICATOR INDICATOR
Adult education in Systemization of
normative acts workplaces for adult
education
INDICATOR INDICATOR
Decisions made by staff Transparency of adult
in adult education education financing
Relevant when adult education is not the only activity of the educational or other organisation.
8
Page 36 od 116
Quality The field of adult education has a formal and legal status within
standard an organisation.
Criteria The field of adult education has a defined status in normative acts.
The organisation has a defined status for the manager of adult education.
The organisation has all the legal acts that allow it to carry out adult education
without interruptions.
SUBAREA
STAFF DEVELOPMENT
AND CREATIVE
ATMOSPHERE
INDICATOR INDICATOR
The organisation pays particular attention to the training to carry out the entire
andragogical cycle when it plans for the continuous professional training for the
employees and external collaborators: training for assessing educational needs of
the community and the individuals, creating new educational programmes,
encouraging adults to take part in education, planning the implementation of
curriculum, preparing teaching materials, methods of learning for adults, assessing
and evaluating knowledge, evaluation of the achievements of education.
The plan for continuous professional training for work in adult education is
implemented by organising internal education.
The plan for continuous professional training for work in adult education is
implemented by sending employees and external collaborators to education and
training outside the organisation.
Self-directing learning is made possible for the employees and external
collaborators (space, technology, learning sources.) The organisation encourages
such self-education.
Organisation ensures that employees and external collaborators are continuously
informed about the possibilities for education and training.
For every employee and external collaborator who works with the organisation
extensively, organisation keeps records of their participation in education and
training and uses this data to update their individual plan of professional
development.
AREA
EDUCATIONAL PROGRAMMES
INDICATOR
Conditions to create
a programme scheme
Page 41 od 116
SUBAREA
IDENTIFYING
EDUCATIONAL
NEEDS
Quality Adult education organisation is familiar with the needs for adult
standard education in individual sectors or professions for which it wants
to provide education, or is already providing it.
Criteria Adult education organisation has established contacts with factors of
development in the sectors and professions for which it wants to provide
education or is already providing it.
Adult education organisation regularly monitors, analyses, and studies what is
going on in sectors and professions for which it wants to provide education or is
already providing it, and identifies educational needs based on this.
Adult education organisation carries out the analyses of needs in the labour
market.
Adult education organisation knows the educational structure of the workforce
and the nomenclature of the professions in sectors or professions or which it
wants to provide education or is already providing it and on the basis of this
identifies the shortcomings in education.
Adult education organisation has trained professional workers for identification
of educational needs of individual sectors or professions.
Quality Adult education organisation is familiar with the needs for adult
standard education in the local, regional and national environment.
Criteria Adult education organisation has established contacts with factors of
development in the local and regional environment.
Adult education organisation regularly monitors, analyses and studies what is
going on in local and regional environment and identifies educational needs on
this basis.
Adult education organisation is familiar with the development strategies of local
and regional environment in which it works.
Adult education organisation is familiar with the national development politics
and the national strategies of education development.
Adult education organisation has trained experts who identify and analyse
educational needs in the local and regional environment.
SUBAREA
DEVELOPMENT OF
OWN EDUCATIONAL
PROGRAMMES
INDICATOR INDICATOR
Development and Implementing,
modernisation of establishing new or
educational reformed programmes
programmes
Page 44 od 116
Quality When new educational programmes are created or old ones are
standard reformed, adult education organisation makes sure they are
implemented or established.
Criteria New or reformed programmes of the adult education organisation are published
and accessible to interested public.
When creating a new programme or reforming the existing ones, different target
groups (potential participants, employers, financiers, expert public) are
acquainted with them.
Page 45 od 116
SUBAREA
CREATING
PROGRAMME
SCHEME
INDICATOR INDICATOR
Formal educational Conditions for creating
programmes in the the programme
programme scheme scheme
Page 46 od 116
AREA
PROMOTION OF ADULT
EDUCATION AND ENCOURAGING
ADULTS FOR EDUCATION
SUBAREA SUBAREA
PROMOTION OF ENCOURAGING
ADULT EDUCATION ADULTS FOR
EDUCATION
INDICATOR INDICATOR
General General
promotion of encouraging for
adult education participation in
education
INDICATOR INDICATOR
Directed Encouragement
promotion of for participation
adult education in individual
programmes
Page 49 od 116
SUBAREA
PROMOTION OF
ADULT EDUCATION
INDICATOR INDICATOR
General promotion of Directed promotion of
adult education adult education
Page 50 od 116
SUBAREA
ENCOURAGING
ADULTS FOR
EDUCATION
INDICATOR INDICATOR
AREA
STAFF
SUBAREA SUBAREA
INDICATOR INDICATOR
Type of staff Educational conditions
INDICATOR INDICATOR
Number of staff Special expert training
Page 54 od 116
SUBAREA
INDICATOR INDICATOR
9
If normative or other legal provisions are prescribed to carry out for a particular type of educational programmes or
supporting activities (for example, the necessity to have a quality committee in formal vocational education and training
implicates the need for staff who carry out quality assessment and development in the organisation), we take them as the
most important in evaluating this criterion or achieving standards. But not all types of adult education or supporting
activities have set standards. For them it is also important that we assess the appropriate number of staff in regard to the
scope and method of adult education activity and from the point of view of expert principles that encourage implementation
of a particular activity (e.g. the requirement of quality in formal vocational education and training).
Page 56 od 116
SUBAREA
QUALIFICATIONS FOR
IMPLEMENTATION OF
EDUCATIONAL
PROGRAMMES AND
ACTIVITIES FOR ADULT
EDUCATION
INDICATOR INDICATOR
Educational Particular expert
requirements training
Page 57 od 116
10
Over time, many expert roles have developed in adult education, which require that educators have not only basic
pedagigical-andragogical knowledge and appropriate education, but also special professional training. Let us mention some
of it: a mentor in the PLYA programme, a teacher in the Lifelong Learning programmes, a mentor of study groups, a
counsellor in the ISIO guidance centres for adults, quality counsellor etc. Because these cases all include work with specific
target groups (for example young adults, adults with low levels of literacy), or work in supporting activities which developed
in adult education (for example, organised self study, information and guidance for adults) these programmes or activities
can often foresee that the staff needs additional training in the programmes of basic training to carry out these tasks. With
the quality indicator we assess if the staff meets the special conditions of expert training once these conditions have been
determined.
Page 58 od 116
AREA
SUBAREA SUBAREA
PREMISES EQUIPMENT
INDICATOR INDICATOR
Study premises General equipment of
premises and
information-
communication
technology
INDICATOR INDICATOR
Premises for the Didactic equipment
work of the staff
INDICATOR
Premises for
supporting activities
for adult education
Page 59 od 116
PREMISES
SUBAREA
PREMISES
EQUIPMENT
SUBAREA
EQUIPMENT
INDICATOR INDICATOR
AREA
PLANNING
EDUCATION
RTOVANJE
IZOBRAŽEVANJA
SUBAREA SUBAREA
IMPLEMENTATION IMPLEMENTATION
PLANNING ON THE PLANNING ON THE
LEVEL OF LEVEL OF
EDUCATIONAL PROGRAMME UNITS
PROGRAMME
INDICATOR INDICATOR
Implementation Implementation
curriculum for an planning in group
educational programme organisational models
on the level of a
programme unit
INDICATOR INDICATOR
Evaluation and
Implementation
recognition of previously
planning in individual
acquired knowledge and organisational models
experience on the level of
programme unit
INDICATOR
Analysis of a study group
characteristics
INDICATOR
Implementation plan for
group organisational
models
INDICATOR
Implementation plan for
individual organisational
models
Page 66 od 116
SUBAREA
IMPLEMENTATION
PLANNING ON THE
LEVEL OF AN
EDUCATIONAL
PROGRAMME
INDICATOR INDICATOR
Implementation Implementation
plan for group plan for individual
organisational organisational
models models
Page 67 od 116
11
This is the level of implementation planning we carry out before we invite participants to join education. The
indicator can be used for more structured educational programmes for adults that earn them publicly accredited
certificate, as well as more or less structured non-formal education programmes which can be realised as long
seminars, courses, workshops, study circles. Because we usually don’t use the term “educational programme” for
study circles and similar forms of non-formal education, we can also think about the “framework plan of
education” which is the basis for the implementation activities when planning education in study circles. When we
use it, it makes sense to start in the characteristics of one and the other type of organisation and greater or
lesser structuralisation of the educational programme.
12
Programme units: subjects, modules or larger contents units.
Page 68 od 116
13
Indicator can be used in formal and non-formal education. The analysis of the study group may not be
meaningful for very short forms of non-formal education, but can be of great help to providers in longer ones. In
unstructured forms of non-formal education it would be wise to adjust some criteria. In study groups, the mentor
leading the group will probably be the one analysing the characteristics of the participants. Here it is thus not
sensible to use the criterion explaining that the data on characteristics of the participants are passed on to
teachers. But as soon as the mentor invites an external expert for the chosen theme to the study group, it will
become important again, because it will matter that the mentor tells the external expert about the characteristics,
expectations and goals the participants have set for themselves.
Page 69 od 116
14
Indicator can be used in longer formal and non-formal forms of education. Whether it is sensible to use it is
decided on the basis of selected cases. In some cases, the indicator can also be used in non-formal education, for
example study circles. Example: if we have planned, when preparing the implementation plan before the
matriculation process, five meetings with the study circles participants, we might – after meeting actual
participants and analysed their needs – find out that more meeting are needed, or fewer.
15
The indicator can be used to assess the longer formal and non-formal forms of adult education. Whether it
makes sense to prepare it for shorter types of non-formal education are assesses on the basis of individual cases.
Page 70 od 116
SUBAREA
IMPLEMENTATION PLANNING
ON THE LEVEL OF
PROGRAMME UNIT
INDICATOR INDICATOR
Implementation planning in Implementation planning in
group organisational models individual organisational
on the level of programme models on the level of
unit programme unit
Page 72 od 116
AREA
IMPLEMENTATION OF
EDUCATION
SUBAREA SUBAREA
EDUCATIONAL LEARNING
PROCESS SOURCES
INDICATOR INDICATOR
Implementation Types of learning
of the educational sources
process
INDICATOR INDICATOR
Communication in Didactic
educational characteristics of
process learning sources
INDICATOR
Types, ways and
methods of
assessing and
evaluating
learning
achievements
Page 74 od 116
EDUCATIONAL PROCESS
SUBAREA
EDUCATIONAL PROCESS
INDICATOR INDICATOR
Implementation of Learning
educational strategies and
process methods
INDICATOR INDICATOR
Communication in Types, ways and
educational methods of
process assessing and
evaluating
learning
achievements
Page 75 od 116
LEARNING SOURCES
SUBAREA
LEARNING SOURCES
INDICATOR INDICATOR
Types of learning Didactic
sources characteristics of
learning sources
Page 78 od 116
AREA
DEVELOPMENT WORK
IN SUPPORT OF
EDUCATION
SUBAREA
DEVELOPMENT WORK
INDICATOR INDICATOR
Forms of connections Participation in expert
in development work groups
INDICATOR INDICATOR
Participation in Cooperation with
projects that allow external expert
development and institutions, expert
exchange of associations, societies
experience
INDICATOR
Participation in panels of
experts, conferences and
other expert meetings
Page 80 od 116
DEVELOPMENT WORK
SUBAREA
DEVELOPMENT
WORK
INDICATOR INDICATOR
Cooperation with Participation in panels
external expert of experts,
institutions, expert conferences and other
associations, societies expert meetings
Page 81 od 116
Quality indicator is immediately tied to expert groups that operate within formal education of
16
adults and have been introduced by legislation. If we assess the quality of development work in
non-formal education, we can use it when we have expert groups for this type of education as
well, or if the same expert groups cover formal and non-formal education. An example would be if
teachers who are in an expert group for English would take part in the subject for a publicly
accredited programme, as well as a non-formal English language course.
Page 82 od 116
AREA
SUPPORT FOR
INDIVIDUALS IN
EDUCATION AND
LEARNING
Informing INDICATOR
individual about
Guidance to
the potential
individual at the
support outside
end of the
the
education
organisation
process
Page 85 od 116
SUBFIELD
SUBAREA
INDICATOR INDICATOR
Diversity of support for Accessibility of support
individual in education for individual in
and learning education and learning
INDICATOR INDICATOR
Informing individual Informing individual
about the potential about the potential
support within the support outside the
organisation organisation
Page 86 od 116
SUBAREA
STUDY SUPPORT
FOR INDIVIDUAL
POSAMEZNIKU
INDICATOR INDICATOR
Study help Consultations and
mentorship
Page 89 od 116
SUBAREA
GUIDANCE SUPPORT
FOR INDIVIDUAL
INDICATOR
Guidance for
individual before
and during
matriculation into
education
INDICATOR INDICATOR
Personal learning plan Introductory
SVETOVANJE interview
INDICATOR INDICATOR
Guidance for Guidance for
individual during individual at the end
education of the education
Page 92 od 116
SUBAREA
SELF-DIRECTED LEARNING
INDICATOR INDICATOR
SUPPORT IN
SOLVING/REMOVING
OBSTACLES IN EDUCATION
INDICATOR INDICATOR
Removing situational Removing institutional
obstacles obstacles
Page 98 od 116
AREA
RESULTS
INDICATOR INDICATOR
Success of adults Development of
in internal vocational
assessment of competences
knowledge
INDICATOR
Success of adults
in external
assessment of
knowledge
INDICATOR
Adult drop-outs
from education
Page 100 od 116
SUBAREA
PARTICIPATION OF
ADULTS IN
EDUCATION
INDICATOR INDICATOR
For example formal and non-formal educational programmes, study circles, language courses etc.
17
For example ISIO guidance centre, centre for self-directed learning, study help etc.
18
Page 102 od 116
SUBAREA
GENERAL SUCCESS
OF ADULTS IN
EDUCATION
INDICATOR INDICATOR
Success in Number of adults
external who successfully
evaluation of complete
knowledge education
Page 103 od 116
19
Quality indicator is primarily intended to be used when the educational programme or other forms of organised education
suppose that the participants must complete certain tasks in order to progress and continue education. When the
programme or implementation plans don’t define such points of passage, this inductor should be used as needed.
20
Quality indicator is aimed in particular for the use in those types of adult education that suppose internal evaluation of
knowledge.
Page 104 od 116
21
Quality indicator is aimed in particular for the use in those types of adult education that suppose external
evaluation of knowledge.
Page 105 od 116
ACHIEVEMENTS IN KNOWLEDGE
SUBAREA
ACHIEVEMENTS IN
KNOWLEDGE
22
Quality indicator is used when necessary, depending on the type of education. We can use it, for example,
when we assess the achievements of the participants in education primarily intended to strengthen their key
competencies. In the field of adult education, literacy programmes would be an example. It is possible, that such
programmes don't include all of the key competences listed above, and they can predict the development of only
certain of them. We will include this starting point and use the criteria listed above sensibly. If the programme,
for example, doesn't suppose the development of ability to communicate in the first language, then this criterion
might not be relevant when assessing the achievements of key competency in this programme. However, we
have to be careful that key competencies can be included in education also as diagonal or integral competencies.
In such cases, we would assess how well key competencies were integrated into a particular education
programme (study circle etc.) and how much this contributed to the development of basic abilities in adults. For
example, teacher in an informal educational programme on marketing, which supposes that the students will
design their own business card, can carry this out so that the students design the card using a computer. With
this, the programme that was primarily intended for the participants to gain knowledge on marketing, included as
a tangential basic ability the development of the basic ability to use information-communication technology. This
quality indicator is thus intended for the assessment of how different forms of education include and develop key
competences, whether they are included in the program on the level of programme objectives, as well as when
they're integrated as tangential or integral competencies.
Page 107 od 116
23
Quality indicator is used in formal or informal vocational education and training of adults.
Page 108 od 116
SUBAREA
PARTICIPANT AND
PARTNER
SATISFACTION
INDICATOR INDICATOR
Participant Partner
satisfaction satisfaction
Page 109 od 116
Quality Partners are satisfied with the cooperation with the adult
standard education organisation.
Criteria Adult education organisation has a formulated method of assessing partner
satisfaction in cooperation.
Partners are satisfied with the possibilities for cooperation in developing new
educational programmes.
Partners are satisfied with the possibilities for cooperation in realisation of
education.
Partners are satisfied with the possibilities for cooperation in assessment of
the quality of educational activity and proposing suggestions for changes and
development.
Partners are satisfied with the ways of informing about the activities of the
adult education organisation.
Partners are satisfied with the ways of established cooperation with the adult
education organisation.
Partners are satisfied with the ways the adult education organisation positions
their development priorities into its activities.
Page 110 od 116
AREA
EFFECTS
SUBAREA
PARTICIPATION IN
LIFELONG
LEARNING
INDICATOR INDICATOR
Participation in Participation in
further formal informal
education education and
learning
Page 112 od 116
SUBAREA
STRENGTHENING
THE POSITION OF
ADULTS IN THE
LABOUR MARKET
INDICATOR INDICATOR
Increased Workplace
employment promotion
possibilities
Page 114 od 116
24
This quality indicator is intended mostly for the type of education which trains participants to achieve a higher
level of education, professional training or professional knowledge. We can also use it to assess the quality of
those types of education that help participants strengthen key competences that will help them be more active
when finding employment or improve their position in the labour market.
25
Quality indicator is intended primarily for those types of education in which participants train to achieve a
higher level of education, vocational training, and receive vocational knowledge. We can also use it to assess the
quality of those types of education that help participants strengthen key competences that will help them be
more active in finding employment or improving their position on the labour market. The indicator can only be
used when establishing the effect on the participants who have already been employed.
Page 115 od 116
SUBAREA
STRENGTHENING
SOCIAL TIES AND
ACTIVITIES IN THE
SOCIETY
INDICATOR INDICATOR
Strengthening Active
social ties participation in
the society
Page 116 od 116
Quality indicator is primarily used in those forms of education that aim and target to strengthen
26
social ties of adults; this shows, for example, in an increased participation of adults in different social
networks, Likewise, the criteria with which we measure if quality standard is met are to be used
sensibly, depending on the goals and different forms of education.