Regional Innovation Scoreboard 2025 Methodology
Regional Innovation Scoreboard 2025 Methodology
Scoreboard 2025
Methodology Report
Regional Innovation Scoreboard 2025 – Methodology Report
European Commission
Directorate-General for Research and Innovation
Directorate G — Common Policy Centre
Unit G.1 — Common R&I Strategy & Foresight Service
Contact Paolo Pasimeni, Chief Economist and Head of Unit G.1
Athina Karvounaraki
Haya Al-Ajlani
Email RTD-STATISTICS@[Link]
RTD-PUBLICATIONS@[Link]
European Commission
B-1049 Brussels
The contents of this publication do not necessarily reflect the position or opinion of the European Commission.
The Commission’s reuse policy is implemented under Commission Decision 2011/833/EU of 12 December 2011 on the reuse of Commission documents
(OJ L 330, 14.12.2011, p. 39, ELI: [Link]
Unless otherwise noted, the reuse of this document is authorised under the Creative Commons Attribution 4.0 International (CC BY 4.0) licence
([Link] This means that reuse is allowed, provided appropriate credit is given and any changes are
indicated.
EUROPEAN COMMISSION
Regional Innovation
Scoreboard 2025
Methodology Report
for the European Commission, Directorate-General for Research and Innovation under the Specific
Contract LC-03213706
implementing framework contract European Innovation Scoreboard (EIS) and the Regional Innovation
Scoreboard (RIS) 2024-2027 N° FW-00154786
Annex B: Report of a statistical audit of RIS done by JRC – COIN team… ............... 62
2
1. Introduction
The Regional Innovation Scoreboard (RIS) is the regional extension of the European Innovation
Scoreboard (EIS), which provides insights at a national level. Regions are crucial engines of
economic development, and measuring innovation performance at the regional level has
become ever more important. The RIS uses the EIS indicators or their proxies for which regional
level data is available and provides a comparative assessment of the performance of innovation
systems across regions. The RIS 2025 follows the methodology of the EIS 2025 and uses data
for 23 of the 32 indicators used in the EIS 2025. RIS 2025 covers 241 regions in 22 EU Member
States, Norway, Serbia, Switzerland, and the United Kingdom (UK). Five countries (Cyprus,
Estonia, Latvia, Luxembourg, and Malta) are included in the RIS only at the country level
because their NUTS 1 and NUTS 2 regions are identical to their national territory.
Chapter 2 of the RIS Methodology Report presents the RIS measurement framework and how
it differs from the EIS, describes the indicators included in RIS 2025, and provides information
on regional coverage and data availability. Chapter 3 presents the methodology used to
calculate the composite indicator (regional innovation index) in detail, including information on
imputation techniques, treatment of data breaks, treatment of outliers, and the approach to
calculating the regional innovation index and relative to EU performance. Chapter 4 presents
the rationale and definitions for the structural indicators used in regional profiles and the online
tool. In addition, Annex A provides a detailed manual for extracting and compiling RIS indicators,
while Annex B presents the report of a statistical audit of RIS done by the JRC – COIN team.
Investments: Financial resources play a vital role in developing new solutions and facilitating
their adoption by the market or firms. The RIS, therefore, evaluates the investments directed
towards R&D and innovation coming from diverse sources such as the public sector and
businesses. In addition, the RIS assesses the use of cloud computing services and employed
ICT specialists, acknowledging the expanding role of digitalisation in Europe and globally.
Innovation activities: To assess regional innovation activities, the RIS places an emphasis
on small and medium enterprises (SMEs). In this way, excessive concentration of innovation
data around company headquarters (typically located in capital cities), is avoided. In addition,
when large enterprises are included in the analysis, confidentiality concerns may limit data
availability for certain regions. This dimension measures the extent to which SMEs introduce
3
novel products or business processes and engage in collaboration or co-publication across
different sectors. An invention must be successfully commercialised or exploited to be
considered an innovation. Therefore, the RIS examines how often companies in a region
translate inventions into marketed products or related assets, using the number of patents,
trademarks, or designs.
Impacts: Lastly, the RIS evaluates the impact of innovation activities on employment, sales,
environmental sustainability, and labour productivity. The RIS assesses the success of new
product innovations in generating sales revenue. In addition, the RIS goes beyond economic
metrics and evaluates environmental impacts and labour productivity, underlining the intricate
relationship between innovation, economic development, and environmental sustainability.
As part of a small-scale revision of the indicator framework for the EIS and RIS in late 2024 and
early 2025, four indicators were updated1. The revision fine-tuned the measurement framework
in light of newly available data and to better reflect evolving European R&I policy priorities. It
introduced four new indicators designed to better capture the factors driving innovation, address
gaps identified during the review, and respond to emerging priorities such as digitalisation,
industrial resilience, and societal impact. These changes are implemented in the 2025 editions
of the EIS and RIS. The changes to the RIS indicators are described in Box 1.
Box 1: Description of changes in the 2025 RIS framework
Broadband penetration (proxy for High-speed internet access in EIS, 1.3.1) replaces the
previous indicator measuring broadband penetration in enterprises, which did not have regional
data. The new RIS indicator measures share of households with broadband access. As a result,
Individuals with above basic overall digital skills (1.3.2) is removed, as it was previously measured
with a proxy indicator regionalising the EIS indicator based on the regional score for Households
with broadband access2.
Cloud computing in enterprises (2.3.1) assesses the share of businesses using advanced
online services like data storage, accounting, or customer management tools. It reflects the extent
to which enterprises are adopting more advanced digital technologies.
Sales of new-to-market and new-to-firm innovations is retained within the framework but now
replaces Employment in knowledge-intensive activities (4.1.1).
Exports of medium and high technology products (4.2.1) was added to the Trade impacts
dimension. It is a proxy calculated based on the FIGARO regional dataset 3 and EIS indicator
values. The indicator was selected after an analysis of five alternatives.
Labour productivity (4.3.3) reflects how much economic value is created for each hour worked.
Higher scores reflect greater efficiency and innovation-driven growth.
Ideally, the RIS should use the same measurement framework as the EIS, i.e. using regional
data for the same indicators applied to measure innovation performance at the country level.
1
Reid, A., et al. (2025). European Innovation Scoreboard 2025: Technical report on the revision of the scoreboard
methodology. Independent expert report prepared for the European Commission, Directorate-General for
Research and Innovation.
2
The indicator was calculated using the following formula: Individuals with above basic overall digital skills =
Regional score for Households with broadband access / Country score for Households with broadband access *
Country score for Individuals with above basic overall digital skills.
3
Lopez Alvarez, Jorge; Galiano Bastarrica, Luis Antonio; Rueda-Cantuche, José Manuel (2017): FIGARO-REG
2017 10 sectors. European Commission, Joint Research Centre (JRC) [Dataset]
PID: [Link]
4
However, for several indicators used in the EIS, regional data are not available, therefore, the
RIS is limited to using data for 23 of the 32 EIS indicators. For seven indicators, slightly different
definitions have been applied to reflect the underlying regional data (see also Table 1 for an
overview):
• Regional data is not available for High-speed internet access. Therefore, Households
with broadband access is used as a proxy, as both indicators refer to household-level
connectivity. While the EIS indicator specifically measures household access to very
high-capacity fixed networks (VHCN), the RIS indicator covers a broader range of
broadband technologies and serves as the closest available proxy at the regional level.
• For the three indicators using expenditure data from the Community Innovation Survey
(CIS) – Non-R&D innovation expenditures, Innovation expenditures per person
employed in innovation active enterprises, and Sales of new-to-market and new-to-
enterprise innovations – the data in the RIS refer only to SMEs and not to all
enterprises4.
• Regional data are not available for Employed ICT specialists. The indicator correlates
highly at the country level with Employment in information and communication (NACE
J). Regional data for the latter are available from Eurostat and is used to calculate
regional estimates for this indicator using the following formula:
Regional score for Employed ICT specialists = Regional score for
Employment in information and communication (NACE J) / Country score
for Employment in information and communication (NACE J) * Country
score for employed ICT specialists.
• Exports of medium and high technology products is not available at the regional level.
A proxy for this indicator is calculated using 2017 FIGARO regional dataset5 and the
EIS indicator values. Regional shares derived from the 2017 data are applied to the
latest country-level values to estimate regional scores. The indicator is calculated in the
following steps:
1) Calculating ratio between exports at region and country level based on 2017
FIGARO data:
𝑇𝑜𝑡𝑎𝑙 𝑒𝑥𝑝𝑜𝑟𝑡𝑠 𝑖𝑛 𝐸𝑈𝑅𝑟𝑒𝑔𝑖𝑜𝑛𝑎𝑙 𝑀𝐻𝑇 𝑒𝑥𝑝𝑜𝑟𝑡𝑠 𝑖𝑛 𝐸𝑈𝑅𝑟𝑒𝑔𝑖𝑜𝑛𝑎𝑙
𝑅𝑎𝑡𝑖𝑜𝑇𝑜𝑡𝑎𝑙 = ; 𝑅𝑎𝑡𝑖𝑜𝑀𝐻𝑇 =
𝑇𝑜𝑡𝑎𝑙 𝑒𝑥𝑝𝑜𝑟𝑡𝑠 𝑖𝑛 𝐸𝑈𝑅𝑐𝑜𝑢𝑛𝑡𝑟𝑦 𝑀𝐻𝑇 𝑒𝑥𝑝𝑜𝑟𝑡𝑠 𝑖𝑛 𝐸𝑈𝑅𝑐𝑜𝑢𝑛𝑡𝑟𝑦
4
The CIS assigns the innovation activities of multi-establishment enterprises to the region where the head office
is located. There is a risk that regions without head offices score lower on the CIS indicators, as some of the
activities in these regions are assigned to other regions with head offices. To minimise this risk, the regional CIS
data excludes large firms - which are more likely to have multiple establishments in different regions - and focuses
on SMEs only.
5
Lopez Alvarez, Jorge; Galiano Bastarrica, Luis Antonio; Rueda-Cantuche, José Manuel (2017): FIGARO-REG
2017 10 sectors. European Commission, Joint Research Centre (JRC) [Dataset]
PID: [Link]
5
Table 1: A comparison of the indicators included in the European Innovation Scoreboard and the Regional
Innovation Scoreboard
6
Categories and Indicator in EIS Indicator in RIS
dimensions
3.2.2 Public-private co- Identical
publications
3.2.3 Job-to-job mobility of No regional data
HRST
3.3.1 PCT patent Identical
applications
Intellectual assets
3.3.2 Trademark applications Identical
3.3.3 Design applications Identical
Impacts
Same indicator but data only for
4.1.1 Sales of new-to-market
enterprises with 10-249
Sales and employment and new-to-firm innovations
employees, inclusive
impacts
4.1.2 Employment in Identical
innovative enterprises
4.2.1 Exports of medium and Proxy using EIS indicator data
high technology products and FIGARO regional dataset6
4.2.2 Knowledge-intensive No regional data
Trade impacts
services exports
4.2.3 High tech imports from No regional data
partners outside of the EU27
4.3.1 Resource productivity No regional data
Resource and labour 4.3.2 Production-based CO2 Air emissions by fine
productivity productivity particulates as a proxy
4.3.3 Labour productivity Identical
Human resources
1.1.2 Population with tertiary education
Numerator Number of persons in age class with some form of post-secondary education
Denominator Population between and including 25 and 34 years
Rationale This is a general indicator of the supply of advanced skills. It is not limited to
science and technical fields, because the adoption of innovations in many
areas, including the service sectors, depends on a wide range of skills. The
6
While FIGARO provides regional data only for 2017, the indicator is updated to 2024 using regional shares
derived from 2017 and applied to the most recent country-level data from the EIS. In addition, NACE aggregation
in FIGARO database is available only at a high level, thus the following is considered medium and high technology
products: NACE B-E. As a result, the calculations include sectors that are not considered as medium and high
technology sectors by Eurostat. See Annex A for a detailed description of indicator calculation. FIGARO regional
dataset available at: Lopez Alvarez, Jorge; Galiano Bastarrica, Luis Antonio; Rueda-Cantuche, José Manuel
(2017): FIGARO-REG 2017 10 sectors. European Commission, Joint Research Centre (JRC) [Dataset]
PID: [Link]
7
indicator focuses on a narrow share of the population aged 25 to 34 and will
relatively quickly reflect changes in educational policies leading to more
tertiary graduates.
Data source Eurostat [edat_lfse_04]
Data availability NUTS 2: 2000-2024
Digitalisation
1.3.1 Broadband penetration
Numerator Households with broadband access
Denominator Total number of households
Rationale The indicator serves as a regional proxy for High-speed internet access in the
EIS. It provides a measure of digitalisation at the household level.
8
Difference from Broadband penetration as a proxy for High-speed internet access
EIS
Data source Eurostat [isoc_r_broad_h]
Data availability NUTS 2: 2006-2021
Firm investments
2.2.1 R&D expenditure in the business sector
Numerator All R&D expenditures in the business sector (BERD)
Denominator Regional Gross Domestic Product
Rationale The indicator captures the formal creation of new knowledge within firms. It is
particularly important in the science-based sector (pharmaceuticals,
chemicals and some areas of electronics), where most new knowledge is
created in or near R&D laboratories.
Data source Eurostat [rd_e_gerdreg]
Data availability NUTS 2: 2000-2023
9
Difference from EIS indicator also includes large enterprises
EIS
Data source Numerator: Eurostat CIS 2022 [inn_cis13_exp_r]
Denominator: Eurostat CIS 2022 [inn_cis13_bas_r]
Regional data from CIS 2014-2020 have been collected from the National
Statistical Offices (NSOs) in several data requests as part of preparation of
the previous RIS editions
Data availability NUTS 1 and 2 for different countries for CIS 2014, CIS 2016, CIS 2018, CIS
2020, CIS 2022
Innovators
10
3.1.2 SMEs introducing business process innovations
Numerator Number of SMEs who introduced at least one business process innovation
Denominator Total number of SMEs
Rationale Many firms innovate not by improving new products but by improving their
business processes. Business process innovations include process,
marketing and organisational innovations.
Data source Eurostat CIS 2022 [inn_cis13_bas_r]
Regional data from CIS 2014-2020 have been collected from the National
Statistical Offices (NSOs) in several data requests as part of preparation of
the previous RIS editions
Data availability NUTS 1 and 2 for different countries for CIS 2014, CIS 2016, CIS 2018, CIS
2020, CIS 2022
Linkages
Intellectual assets
11
Rationale The capacity of firms to develop new products determines their competitive
advantage. One indicator of the rate of new product innovation is the number
of patent applications
Data source Numerator: OECD, REGPAT
Denominator: Eurostat [nama_10r_2gd] and OECD (for CH and UK)
Data availability NUTS 2: two-year averages for 2000-2022
12
Regional data from CIS 2014-2020 have been collected from the National
Statistical Offices (NSOs) in several data requests as part of preparation of
the previous RIS editions
Data availability NUTS 1 and 2 for different countries for CIS 2014, CIS 2016, CIS 2018, CIS
2020, CIS 2022
Trade impacts
7
Lopez Alvarez, Jorge; Galiano Bastarrica, Luis Antonio; Rueda-Cantuche, José Manuel (2017): FIGARO-REG
2017 10 sectors. European Commission, Joint Research Centre (JRC) [Dataset] PID:
[Link]
13
4.3.3 Labour productivity
Numerator GDP in constant prices
Denominator Hours worked
Rationale Labour productivity per hour worked can serve as an impact indicator. By
measuring the real economic output generated per hour of work, it captures
the broader effects of technological advancements, digitalisation, and process
improvements on productivity.
Data source Annual Regional Database of the European Commission (ARDECO)
Data availability NUTS 3: 1980-2026
8
More information on the NUTS2024 revision can be found here: [Link]
[Link]
14
Table 2: NUTS 1 and NUTS 2 regions included in RIS 2025 by country
Number of Average
regions at population Regions (NUTS code)
Country
NUTS level size (2024)
1 2
Austria 3 -- 3,052,917 Ostösterreich (AT1) Westösterreich (AT3)
Südösterreich (AT2)
Belgium 3 -- 3,939,032 Région de Bruxelles- Vlaams Gewest (BE2)
Capitale/Brussels Région wallonne (BE3)
Hoofdstedelijk Gewest (BE1)
Bulgaria -- 6 1,074,247 Severozapaden (BG31) Yugoiztochen (BG34)
Severen tsentralen (BG32) Yugozapaden (BG41)
Severoiztochen (BG33) Yuzhen tsentralen (BG42)
Croatia -- 4 965,492 Panonska Hrvatska (HR02) Grad Zagreb (HR05)
Jadranska Hrvatska (HR03) Sjeverna Hrvatska (HR06)
Czechia -- 8 1,362,569 Praha (CZ01) Severovýchod (CZ05)
Střední Čechy (CZ02) Jihovýchod (CZ06)
Jihozápad (CZ03) Střední Morava (CZ07)
Severozápad (CZ04) Moravskoslezsko (CZ08)
Denmark -- 5 1,192,250 Hovedstaden (DK01) Midtjylland (DK04)
Sjælland (DK02) Nordjylland (DK05)
Syddanmark (DK03)
Finland 1 4 1,120,770 Länsi-Suomi (FI19) Pohjois- ja Itä-Suomi (FI1D)
Helsinki-Uusimaa (FI1B) Åland (FI2)
Etelä-Suomi (FI1C)
France 14 -- 4,890,526 Ile-de-France (FR1) Occitanie (FRJ)
Centre — Val de Loire (FRB) Auvergne-Rhône-Alpes
Bourgogne-Franche-Comté (FRK)
(FRC) Provence-Alpes-Côte
Normandie (FRD) d’Azur (FRL)
Hauts-de-France (FRE) Corse (FRM)
Grand Est (FRF) RUP FR — Régions
Pays de la Loire (FRG) Ultrapériphériques
Bretagne (FRH) Françaises (FRY)
Nouvelle-Aquitaine (FRI)
Germany 9 29 2,196,212 Stuttgart (DE11) Braunschweig (DE91)
Karlsruhe (DE12) Hannover (DE92)
Freiburg (DE13) Lüneburg (DE93)
Tübingen (DE14) Weser-Ems (DE94)
Oberbayern (DE21) Düsseldorf (DEA1)
Niederbayern (DE22) Köln (DEA2)
Oberpfalz (DE23) Münster (DEA3)
Oberfranken (DE24) Detmold (DEA4)
Mittelfranken (DE25) Arnsberg (DEA5)
Unterfranken (DE26) Koblenz (DEB1)
Schwaben (DE27) Trier (DEB2)
Berlin (DE3) Rheinhessen-Pfalz (DEB3)
Brandenburg (DE4) Saarland (DEC)
Bremen (DE5) Dresden (DED2)
Hamburg (DE6) Chemnitz (DED4)
Darmstadt (DE71) Leipzig (DED5)
Gießen (DE72) Sachsen-Anhalt (DEE)
Kassel (DE73) Schleswig-Holstein (DEF)
Mecklenburg-Vorpommern Thüringen (DEG)
(DE8)
Greece -- 13 800,055 Attiki (EL30) Ipeiros (EL54)
Voreio Aigaio (EL41) Thessalia (EL61)
Notio Aigaio (EL42) Ionia Nisia (EL62)
Kriti (EL43) Dytiki Elláda (EL63)
Sterea Elláda (EL64)
15
Number of Average
regions at population Regions (NUTS code)
Country
NUTS level size (2024)
1 2
Anatoliki Makedonia Thraki Peloponnisos (EL65)
(EL51)
Kentriki Makedonia (EL52)
Dytiki Makedonia (EL53)
Hungary -- 8 1,198,078 Budapest (HU11) Dél-Dunántúl (HU23)
Pest (HU12) Észak-Magyarország
Közép-Dunántúl (HU21) (HU31)
Nyugat-Dunántúl (HU22) Észak-Alföld (HU32)
Dél-Alföld (HU33)
Ireland -- 3 1,783,894 Northern and Western (IE04) Eastern and Midland (IE06)
Southern (IE05)
Italy -- 21 2,808,154 Piemonte (ITC1) Sicilia (ITG1)
Valle d’Aosta/Vallée d’Aoste Sardegna (ITG2)
(ITC2) Provincia Autonoma di
Liguria (ITC3) Bolzano/Bozen (ITH1)
Lombardia (ITC4) Provincia Autonoma di
Abruzzo (ITF1) Trento (ITH2)
Molise (ITF2) Veneto (ITH3)
Campania (ITF3) Friuli-Venezia Giulia (ITH4)
Puglia (ITF4) Emilia-Romagna (ITH5)
Basilicata (ITF5) Toscana (ITI1)
Calabria (ITF6) Umbria (ITI2)
Lazio (ITI4) Marche (ITI3)
16
Number of Average
regions at population Regions (NUTS code)
Country
NUTS level size (2024)
1 2
Východné Slovensko
(SK04)
Slovenia -- 2 1,061,975 Vzhodna Slovenija (SI03) Zahodna Slovenija (SI04)
Spain 2 17 2,558,931 Galicia (ES11) Extremadura (ES43)
Principado de Asturias Catalunya/Cataluña (ES51)
(ES12) Comunitat Valenciana
Cantabria (ES13) (ES52)
País Vasco (ES21) Illes Balears (ES53)
Comunidad Foral de Navarra Andalucía (ES61)
(ES22) Región de Murcia (ES62)
La Rioja (ES23) Ciudad de Ceuta (ES63)
Aragón (ES24) Ciudad de Melilla (ES64)
Comunidad de Madrid (ES3) Canarias (ES7)
Castilla y León (ES41)
Castilla-La Mancha (ES42)
Sweden -- 8 1,318,963 Stockholm (SE11) Västsverige (SE23)
Östra Mellansverige (SE12) Norra Mellansverige (SE31)
Småland med öarna (SE21) Mellersta Norrland (SE32)
Sydsverige (SE22) Övre Norrland (SE33)
Norway -- 6 925,036 Innlandet (NO02) Oslo og Viken (NO08)
Trøndelag/Trööndelage Agder og Sør-Østlandet
(NO06) (NO09)
Nord-Norge (NO07) Vestlandet (NO0A)
Switzerland -- 7 1,280,323 Région lémanique (CH01) Zürich (CH04)
Espace Mittelland (CH02) Ostschweiz (CH05)
Nordwestschweiz (CH03) Zentralschweiz (CH06)
Ticino (CH07)
Serbia -- 4 1,651,292 City of Belgrade (RS11) Region Šumadije i Zapadne
Autonomous Province of Srbije (RS21)
Vojvodina (RS12) Region Južne i Istočne
Srbije (RS22)
United 12 -- 5,522,798 North East (England) (UKC) London (UKI)
Kingdom (2018)* North West (England) (UKD) South East (England) (UKJ)
Yorkshire and The Humber South West (England)
(UKE) (UKK)
East Midlands (England) Wales (UKL)
(UKF) Scotland (UKM)
West Midlands (England) Northern Ireland (UKN)
(UKG)
East (England) (UKH)
Note: 2018 is the latest year for which population data for all UK regions are available on Eurostat [demo_r_d2jan].
17
• Data for 11 RIS indicators are taken from official statistics services, but separately for
the numerator and denominator. In these cases, the indicator is calculated by the RIS
project team. Data availability for the numerator and denominator can vary. This is the
case for the following indicators: R&D expenditure in the public sector, Non-R&D
innovation expenditures, Innovation expenditures per person employed, Employed ICT
specialists, SMEs introducing product innovations, SMEs introducing business process
innovations, Innovative SMEs collaborating with others, PCT patent applications, Sales
of new-to-market and new-to-firm innovations, Employment in innovative enterprises,
and Exports of medium and high technology products.
• Data for five RIS indicators are provided by Science Metrix (Elsevier) and Fraunhofer
ISI as part of a contract with the European Commission. For four of them a denominator
is added (International scientific co-publications, Public-private co-publications,
Trademark applications, Design applications). Thus, these indicators are also
calculated by the RIS team.
Table 3 provides the data availability for each RIS indicator for every year in the period 2014-
2024. For indicators where additional calculations were made, availability is provided separately
for the numerator and denominator. Data availability is provided before any data treatment
(break removal, imputation, etc.). Table 4 provides information about the regions for which data
are not available.
18
Table 3: Regional data availability by indicator
19
Data availability (percentage of available regions out of 241)
Indicator
2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024
2.2.2 Non-R&D innovation expenditures9
Numerator: Sum of total
innovation expenditure for
No data No data No data No data 53.9 No data No data
SMEs, excluding intramural and
extramural R&D expenditures -- -- -- --
9
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with Eurostat and the NSOs providing regional data includes a rule that
the contractor must delete the confidential regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator and denominator is
not available.
10
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with Eurostat and the NSOs providing regional data includes a rule that
the contractor must delete the confidential regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator and denominator is
not available.
20
Data availability (percentage of available regions out of 241)
Indicator
2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024
3.1.1 SMEs introducing product innovations11
Numerator: Number of SMEs
who introduced at least one No data No data No data No data 58.5 No data No data
product innovation -- -- -- --
Denominator: Total number of
No data No data No data No data 58.5 No data No data
SMEs
3.1.2 SMEs introducing business process innovations12
Numerator: Number of SMEs
who introduced at least one No data No data No data No data 58.5 No data No data
business process innovation -- -- -- --
Denominator: Total number of
No data No data No data No data 58.5 No data No data
SMEs
3.2.1 Innovative SMEs collaborating with others13
Numerator: Number of SMEs
with innovation co-operation No data No data No data No data 58.1 No data No data
activities -- -- -- --
Denominator: Total number of
No data No data No data No data 58.5 No data No data
SMEs
3.2.2 Public-private co-publications
11
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with Eurostat and the NSOs providing regional data includes a rule that
the contractor must delete the confidential regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator and denominator is
not available.
12
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with Eurostat and the NSOs providing regional data includes a rule that
the contractor must delete the confidential regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator and denominator is
not available.
13
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with Eurostat and the NSOs providing regional data includes a rule that
the contractor must delete the confidential regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator and denominator is
not available.
21
Data availability (percentage of available regions out of 241)
Indicator
2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024
Numerator: Number of public-
private co-authored research 100 100 100 100 100 100 100 100 100 100 100
publications
Denominator: Total population 95.4 95.4 95.4 97.1 97.1 97.1 97.1 97.1 97.1 99.2 95
3.3.1 PCT patent applications
Numerator: Number of patent
applications filed under the Data Data
100 100 100 100 100 100 100 100 100
Patent Co-operation Treaty, by incomplete incomplete
year of filing
Denominator: GDP in PPP 97.9 97.9 97.9 97.9 97.9 97.9 97.9 100 97.5 89.6 No data
3.3.2 Trademark applications
Numerator: Number of
trademark applications applied 100 100 100 100 100 100 100 100 100 100 100
for at EUIPO
Denominator: GDP in PPP 97.9 97.9 97.9 97.9 97.9 97.9 97.9 100 97.5 89.6 No data
3.3.3 Design applications
Numerator: Number of designs
100 100 100 100 100 100 100 100 100 100 100
applied for at EUIPO
Denominator: GDP in PPP 97.9 97.9 97.9 97.9 97.9 97.9 97.9 100 97.5 89.6 No data
4.1.1 Sales of new-to-market and new-to-firm innovations14
14
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with Eurostat and the NSOs providing regional data includes a rule that
the contractor must delete the confidential regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator and denominator is
not available.
22
Data availability (percentage of available regions out of 241)
Indicator
2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024
Numerator: Sum of total
turnover of new or significantly No data No data No data No data 60.2 No data No data
improved products for SMEs -- -- -- --
Denominator: Total turnover for
No data No data No data No data 49.4 No data No data
SMEs
4.1.2 Employment in innovative enterprises15
Numerator: Number of
employed persons in innovative No data No data No data No data 58.5 No data No data
SMEs -- -- -- --
Denominator: Total employment
No data No data No data No data 58.5 No data No data
in SMEs
4.2.1 Exports of medium and high technology products
FIGARO 2017 regional data No data No data No data 95.4 No data No data No data No data No data No data No data
Export data at country level 94.6 100 100 100 100 100 95 95 95 95 95
4.3.2 Air emissions by fine
93.4 93.4 93.4 93.4 93.4 93.4 93.4 93.4 93.4 No data No data
particulates
4.3.3 Labour productivity 95 95 95 95 95 95 95 95 95 95 92.1
15
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with Eurostat and the NSOs providing regional data includes a rule that
the contractor must delete the confidential regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator and denominator is
not available.
23
Table 4: Regions for which data are not available
1.2.2 Scientific publications among the top 10% most 5 years: 2 ES regions
cited 9 years: 1 FI regions
1 year: 13 FR, 3 HR, 3 NO, 2 SI regions
2 years: 1 FR, 12 UK regions
4 years: 7 CH, 2 HU, 3 IE, 2 LT, 7 PL
1.3.1 Broadband penetration
regions
5 years: 4 RS regions
8 years: 1 FI region
2.1.1 R&D expenditure in the public sector
1 year: 3 BG, 1 ES, 5 FI, 2 LT, 3 NO, 1
PL, 5 PT regions
2 years: 13 EL, 2 PL regions
3 years: 1 BG, 5 DK, 2 HU, 10 UK
regions
R&D expenditure in: government sector
4 years: 2 PL, 4 RS, 8 SE regions
5 years: 1 AT, 3 PL, 2 UK regions
6 years: 2 AT, 3 HR, 3 IE, 4 PL regions
7 years: 14 FR, 3 NO, 1 PL regions
24
Indicator Data not available for
8 years: 7 CH, 2 ES, 12 NL, 4 PL
regions
1 year: 2 ES, 5 FI, 3 IT, 2 LT, 3 NO, 3
PL, 5 PT regions
2 years: 13 EL, 2 ES, 5 PL regions
3 years: 5 DK, 3 ES, 2 HU, 1 PL, 2 SI,
8 UK regions
4 years: 4 PL, 4 RS, 8 SE regions
R&D expenditure in: higher education sector
5 years: 1 AT, 1 BG, 2 UK regions
6 years: 2 AT, 1 BG, 1 ES, 3 HR, 3 IE,
1 PL, 2 UK regions
7 years: 14 FR, 3 NO regions
8 years: 1 BG, 7 CH, 3 ES, 12 NL
regions
1 year: 5 FI, 2 LT, 3 NO, 2 PL, 5 PT
regions
2 years: 13 EL, 7 PL regions
3 years: 5 DK, 2 HU, 2 PL, 12 UK
regions
2.2.1 R&D expenditure in the business sector
4 years: 3 AT, 38 DE, 4 RS, 6 SE
regions
6 years: 7 CH, 3 HR, 3 IE, 2 SE regions
7 years: 2 ES, 14 FR, 3 NO regions
8 years: 12 NL regions
2.2.2 Non-R&D innovation expenditures16
Numerator: Sum of total innovation expenditure for 1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
SMEs, excluding intramural and extramural R&D PT, 38 DE, 4 SK, 5 DK, 6 NO, 7 CH, 9
expenditures PL regions
1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
Denominator: Total turnover for SMEs PT, 21 IT, 3 PL, 38 DE, 5 DK, 6 NO, 7
CH regions
2.2.3 Innovation expenditures per person employed17
1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
Numerator: Innovation expenditure by SMEs PT, 38 DE, 4 SK, 5 DK, 6 NO, 7 CH, 9
PL regions
16
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with
Eurostat and the NSOs providing regional data includes a rule that the contractor must delete the confidential
regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator
and denominator is not available.
17
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with
Eurostat and the NSOs providing regional data includes a rule that the contractor must delete the confidential
regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator
and denominator is not available.
25
Indicator Data not available for
1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
Denominator: Total employment in innovative SMEs PL, 2 PT, 38 DE, 5 DK, 6 NO, 7 CH
regions
1 year: 12 NL, 12 UK, 13 EL, 14 FR, 17
2.3.1 Cloud computing in enterprises PL, 21 IT, 3 IE, 38 DE, 4 RS, 5 FI, 7
CH, 8 CZ, 8 SE, 9 PT regions
2.3.2 Employed ICT specialists
1 year: 1 EL, 13 DE regions
2 years: 1 BG, 1 DE, 1 HU, 3 HR, 3 NO
regions
3 years: 3 DE regions
4 years: 1 BG, 1 DE, 1 PL, 2 EL regions
5 years: 1 DE, 1 EL, 1 RO, 12 UK, 3 PT
regions
Region share in NACE J
6 years: 1 PL, 1 PT, 1 RO regions
7 years: 1 FR, 1 IT regions
8 years: 1 EL, 1 PL, 1 PT, 2 NO regions
9 years: 1 EL, 2 NL regions
10 years: 1 DE, 1 PL, 1 PT region
11 years: 1 FI, 1 IT, 2 ES, 2 PL, 2 PT,
4 EL regions
Country share NACE J 5 years: 12 UK regions
Share of ICT specialists (country) 5 years: 12 UK regions
3.1.1 SMEs introducing product innovations18
1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
Numerator: Number of SMEs who introduced at least
PL, 2 PT, 38 DE, 5 DK, 6 NO, 7 CH
one product innovation
regions
1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
Denominator: Total number of SMEs PL, 2 PT, 38 DE, 5 DK, 6 NO, 7 CH
regions
3.1.2 SMEs introducing business process innovations19
1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
Numerator: Number of SMEs who introduced at least
PL, 2 PT, 38 DE, 5 DK, 6 NO, 7 CH
one business process innovation
regions
18
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with
Eurostat and the NSOs providing regional data includes a rule that the contractor must delete the confidential
regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator
and denominator is not available.
19
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with
Eurostat and the NSOs providing regional data includes a rule that the contractor must delete the confidential
regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator
and denominator is not available.
26
Indicator Data not available for
1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
Denominator: Total number of SMEs PL, 2 PT, 38 DE, 5 DK, 6 NO, 7 CH
regions
3.2.1 Innovative SMEs collaborating with others20
1 year: 1 HR, 12 NL, 12 UK, 14 FR, 2
Numerator: Number of SMEs with innovation co-
ES, 2 PL, 2 PT, 38 DE, 5 DK, 6 NO, 7
operation activities
CH regions
1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
Denominator: Total number of SMEs PL, 2 PT, 38 DE, 5 DK, 6 NO, 7 CH
regions
3.2.2 Public-private co-publications
Numerator: Number of public-private co-authored --
research publications
1 year: 12 UK regions
3 years: 4 RS regions
Denominator: Total population
9 years: 5 PT regions
10 years: 2 NL regions
3.3.1 PCT patent applications
Numerator: Number of patent applications filed under --
the Patent Co-operation Treaty, by year of filing
1 year: 12 UK, 7 CH regions
Denominator: GDP in PPP 2 years: 6 NO regions
7 years: 5 PT regions
3.3.2 Trademark applications
Numerator: Number of trademark applications applied --
for at EUIPO
1 year: 12 UK, 7 CH regions
Denominator: GDP in PPP 2 years: 6 NO regions
7 years: 5 PT regions
3.3.3 Design applications
Numerator: Number of designs applied for at EUIPO --
1 year: 12 UK, 7 CH regions
Denominator: GDP in PPP 2 years: 6 NO regions
7 years: 5 PT regions
20
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with
Eurostat and the NSOs providing regional data includes a rule that the contractor must delete the confidential
regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator
and denominator is not available.
27
Indicator Data not available for
4.1.1 Sales of new-to-market and new-to-firm innovations21
Numerator: Sum of total turnover of new or significantly 1 year: 12 NL, 12 UK, 14 FR, 2 PT, 38
improved products for SMEs DE, 5 DK, 6 NO, 7 CH regions
1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
Denominator: Total turnover for SMEs PT, 21 IT, 3 PL, 38 DE, 5 DK, 6 NO, 7
CH regions
4.1.2 Employment in innovative enterprises22
1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
Numerator: Number of employed persons in innovative
PL, 2 PT, 38 DE, 5 DK, 6 NO, 7 CH
SMEs
regions
1 year: 12 NL, 12 UK, 14 FR, 2 ES, 2
Denominator: Total employment in SMEs PL, 2 PT, 38 DE, 5 DK, 6 NO, 7 CH
regions
4.2.1 Exports of medium and high technology products
FIGARO 2017 regional data 1 year: 4 RS, 7 CH regions
1 year: 6 NO, 7 CH regions
Export data at country level
5 years: 12 UK regions
9 years: 1 ES, 1 FR, 12 UK, 2 PT
4.3.2 Air emissions by fine particulates
regions
1 year: 7 CH regions
4.3.3 Labour productivity
11 years: 12 UK regions
21
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with
Eurostat and the NSOs providing regional data includes a rule that the contractor must delete the confidential
regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator
and denominator is not available.
22
Data prior to CIS 2022 was obtained from National Statistics Office. The special request agreement with
Eurostat and the NSOs providing regional data includes a rule that the contractor must delete the confidential
regional data once the RIS report is published. Thus, data for previous CIS additions separately for numerator
and denominator is not available.
23
See: [Link]
24
See: [Link]
28
it implements international guidelines and best practices in composite indicator construction 25.
It allows highly detailed and flexible construction and analysis of composite indicators, including
imputation, normalisation, outlier treatment and sensitivity analysis.
This approach provides a highly replicable and easy to follow data pipeline which feeds into the
COINr package and automatically provides the main outputs of the RIS. Since the data
collection, processing and outputs are largely based on code (using the R software), all code is
packaged together and hosted on GitHub, which also facilitates the auditing process.
Figure 1: RIS automation process
25
Nardo M, Saisana M, Saltelli A, Tarantola S, Hoffmann A, Giovannini E. Handbook on Constructing Composite
Indicators: Methodology and User Guide. Paris (France): OECD publishing; 2008. JRC47008.
[Link]
26
[Link]
29
For five indicators, data from an alternative to the main source was used to fill in the data gaps
in certain countries. This was the case for the following indicators:
• Denominator for indicators International scientific co-publications and Public-private co-
publications. The latest available UK population data on Eurostat is for 2019. Thus,
from 2020 onward, the denominator for these two indicators was calculated using an
alternative source. National level data for mid-year population estimates were taken
from the Office for National Statistics of the UK27. This data was used to calculate
annual population growth rates, which were then applied to the 2019 Eurostat data to
estimate national and regional populations for the subsequent years.
• PCT patent applications, Trademark applications, Design applications. These
indicators used GDP in PPP data. This data is not available in Eurostat for the UK and
for Switzerland and Norway for 2022-2023. This data was taken from OECD (Gross
domestic product – Regions). As the OECD provides data in US dollars, it was
necessary to convert these values into euros. This conversion was done using an
average exchange rate, calculated by comparing the corresponding data in Eurostat
and OECD for EU countries.
In addition, data for 7 CIS indicators are publicly available for 2022 in Eurostat. However,
regional data for previous CIS editions was not publicly available. Regional data prior to CIS
2022 was obtained from the National Statistics Office (NSO) as part of the preparation of the
previous RIS editions under the special request agreement with Eurostat and the NSOs.
However, this special agreement includes a rule that the contractor must delete the confidential
regional data once the RIS report is published. Thus, raw data for previous CIS editions
separately for numerator and denominator are not available and only the final indicator values
are.
27
[Link]
s/ukpop/pop
28
After 2024 update, the UK is no longer part of the NUTS system. Thus, this report uses the NUTS 2021 version
for the UK, which corresponds to the International Territorial Levels (ITLs) currently used by the UK Office for
National Statistics. More information on the NUTS2024 revision can be found here:
[Link] [Link]
30
• Air emissions by fine particulates: the Netherlands, Portugal
• For seven CIS indicators (Non-R&D innovation expenditures, Innovation expenditures
per person employed, SMEs introducing product innovations, SMEs introducing
business process innovations, Innovative SMEs collaborating with others, Sales of
new-to-market and new-to-firm innovations, and Employment in innovative
enterprises): Portugal (only 2014-2020)
Table 5: Correspondence used to impute data for regions impacted by revisions in the NUTS classification
Impacted NUTS2024
Correspondence Rationale
regions
HR02 Panonska Hrvatska HR02 = HR04 One region was split into three new regions, thus the
values of this one region are used for the newly
HR05 Grad Zagreb HR05 = HR04 created regions.
HR06 Sjeverna Hrvatska HR06 = HR04
NO08 Oslo og Viken NO08 = New region made of multiple previous regions, thus
(NO01+NO03)/2 the average of the old regions to form new region is
used.
NO09 Agder og Sør- NO09 =
Østlandet (NO03+NO04)/2
NO0A Vestlandet NO0A =
(NO04+NO05)/2
NL35 Utrecht NL35 = Boundary changed forming a new region (NL35) of
(NL31+NL33)/2 NL31 and part of NL33. The average of the old
regions to form new region is used.
NL36 Zuid-Holland NL36 = NL33 Boundary changed forming NL36 of large part of
NL33. Thus, value of the old region used to form a
new region.
PT19 Centro (PT) PT19 = PT16 Boundary changed forming PT19 of large part of
PT16. Thus, value of the old region used to form a
new region.
PT1A Grande Lisboa PT1A = PT17 Boundary changed forming PT1C of large part of
PT18. Thus, value of the old region used to form a
new region.
PT1B Península de PT1B = PT17 Boundary changed forming PT1D by taking parts of
Setúbal two regions (PT16 and PT18). The average of the old
regions used to form new region.
PT1C Alentejo PT1C = PT18 One region was split into two new regions, thus the
value of this one region is used for the newly created
PT1D Oeste e Vale do PT1D = regions.
Tejo (PT16+PT18)/2
29
For Germany and France, the latest available regional data from CIS2020 were used.
31
computing in enterprises where data was not available at the regional level for Czechia,
Germany, Ireland, Greece, France, Italy, Netherlands, Poland, Portugal, Finland, Sweden and
thus data availability did not pass the 75% threshold. Data for the most recent years available
(2023) was used for this indicator.
Table 6. The most recent year of indicators used in RIS
30
While FIGARO provides regional data only for 2017, the indicator is updated to 2024 using regional shares
derived from 2017 and applied to the most recent country-level data from the EIS. See Annex A for a detailed
description of indicator calculation.
32
3.4. Step 4: Treating data breaks
Breaks in the time series in at least one country’s regions are reported for nine indicators (see
Table 7 below). To ensure data comparability across years, all data prior to a break in the time
series are removed. For example, if a break occurs for a region in 2023, all data for that region
before 2023 are deleted. As a result, the time series for that region will contain only data from
2023 onwards. Table 7 briefly summarises the recorded breaks by indicator and year.
Table 7. Breaks in time series by indicator
Indicator Breaks
2021: All regions
1.1.2 Population with tertiary education 2023: SI regions
2024: BG regions
2021: All regions
2022: SK regions
1.1.3 Population involved in lifelong learning
2023: SI regions
2024: BE, BG, DE, EL, IE regions
2014: RO regions
2016: SE regions
2017: CH regions
1.3.1 Broadband penetration
2019: SE regions
2020: CZ regions
2021: DE, IE regions
2.1.1 R&D expenditure in the public sector
R&D expenditure in: government sector 2016: DE regions
R&D expenditure in: higher education sector 2018: HU regions
2015: CH regions
2.2.1 R&D expenditure in the business sector 2016: IT regions
2018: HU regions
2.3.2 Employed ICT specialists
2021: All regions
Region share in NACE J 2023: DK regions
2024: BG regions
2021: All countries
Country share NACE J 2023: DK
2024: BG
2021: All countries
Share of ICT specialists (country)
2023: DK
3.3.1 PCT patent applications
33
Indicator Breaks
Numerator: Number of patent applications filed under --
the Patent Co-operation Treaty, by year of filing
2019: DE regions
Denominator: GDP in PPP 2020: BE, PL regions
2021: IT, PT regions
3.3.2 Trademark applications
Numerator: Number of trademark applications --
applied for at EUIPO
2019: DE regions
Denominator: GDP in PPP 2020: BE, PL regions
2021: IT, PT regions
3.3.3 Design applications
Numerator: Number of designs applied for at EUIPO --
2019: DE regions
Denominator: GDP in PPP 2020: BE, PL regions
2021: IT, PT regions
There was also a break in the time series of CIS indicators in 2022 for Italy and Sweden, caused
by a change in the statistical unit from the legal unit to the enterprise. The change is a result of
Commission Implementing Regulation (EU) 2022/1092 of 30 June 2022, aiming to harmonise
data collection methods. This change is considered an improvement, as it leads to more
accurate data. While Italy and Sweden explicitly reported this break, similar changes were
introduced in other countries as well, though not all of them flagged it as a break in the time
series. Moreover, some countries had already implemented this shift in earlier CIS editions.
Taking all of this into account, and following consultations with Eurostat, it was decided to
disregard this break in the time series in the analysis.
34
mismatched geographic levels, for example, imputing a denominator from a national level while
the numerator is based on regional data would compromise the validity of the resulting indicator.
Specifically, imputation using the first three imputation steps was done for three indicators: R&D
expenditure in the public sector, Employed ICT specialists, and PCT patent applications. It was
not done for the remaining eight indicators, where additional calculations were required for the
following reasons:
• Seven CIS indicators (2.2.2 Non-R&D innovation expenditures, 2.2.3 Innovation
expenditures per person employed, 3.1.1 SMEs introducing product innovations, 3.1.2
SMEs introducing business process innovations, 3.2.1 Innovative SMEs collaborating
with others, 4.1.1 Sales of new-to-market and new-to-firm innovations, 4.1.2
Employment in innovative enterprises): data at the numerator and denominator level
was not available before 2022, thus to ensure consistency, imputation was done only
at the indicator level.
• Exports of medium and high technology products: there was no missing data, thus
imputation was not needed.
35
Indicator Outliers (Positive / Negative)
Positive: CH04 2018-2022; DE93 2023; DK05 2019; ES63 2023-
2025; NL12 2020; NL22 2020; NL23 2023-2025; NL32 2018-2022;
1.2.2 Scientific NL34 2023-2025; NL35 2019; UKH 2018-2023
publications among the Negative: BG31 2018-2025; BG32 2018-2019; BG33 2018-2019;
top 10% most cited BG34 2019-2025; CZ04 2019-2022; EL64 2019; ES63 2018-2022;
HR02 2019-2020; HR06 2019-2021; PL72 2023; PL92 2018-2020;
RO22 2020-2021; RO41 2019-2020; SK03 2019
Positive: --
Negative: BG31 2018-2022; BG32 2018-2020; BG33 2018-2019;
BG34 2018-2021; BG41 2018-2020; BG42 2018-2020; EL41 2019;
EL42 2019; EL43 2019; EL51 2018-2021; EL52 2018-2021; EL53
1.3.1 Broadband 2018-2021; EL54 2018-2021; EL61 2018-2021; EL62 2018-2021;
penetration EL63 2018-2021; EL64 2018-2021; EL65 2018-2021; ES43 2018;
FRM 2019-2021; FRY 2018-2021; HU31 2018; ITF3 2018; ITF5 2018;
ITF6 2018; ITG1 2018; PT11 2018-2019; PT15 2018; PT19 2018-
2019; PT1C 2018-2020; PT1D 2018-2020; RO11 2018; RO12 2018;
RO21 2018-2020; RO22 2018-2019; RO31 2018-2020; RO41 2018-
2019; RO42 2018
Positive: CZ01 2018-2019; DE12 2018-2025; DE3 2018-2025; DE5
2018-2025; DE91 2018-2025; DEA2 2018-2025; DEB2 2018-2020;
2.1.1 R&D expenditure in DED2 2018-2025; DED5 2018-2025; DK01 2023-2025; DK05 2023-
the public sector 2025; EL43 2024-2025; EL54 2024; FRJ 2018-2025; NO06 2018-
2025; SE12 2018-2024; SE33 2018-2025
Negative: --
Positive: AT2 2018-2025; BE3 2024-2025; CH03 2018-2025; DE11
2018-2025; DE12 2021-2025; DE14 2018-2025; DE21 2018-2025;
2.2.1 R&D expenditure in DE91 2018-2025; DEB3 2023-2025; DK01 2018-2025; SE23 2021-
the business sector 2025
Negative: --
Positive: FRY 2021-2025; RS11 2018-2020; RS12 2018-2022; RS21
2.2.2 Non-R&D 2018-2022; RS22 2021-2022; UKL 2018-2025
innovation expenditures
Negative: --
Positive: BE1 2021-2025; BE2 2025; BE3 2021-2025; FR1 2023-
2.2.3 Innovation 2025; FRH 2023-2025; FRY 2018-2025; HR06 2025; IE05 2025; IE06
expenditures per person 2025; RS21 2018-2022; RS22 2018-2022
employed
Negative: --
Positive: --
2.3.1 Cloud computing in
enterprises Negative: BG31 2018-2025; ES64 2018-2025; RO22 2018-2025;
RO31 2018-2025; RO41 2018-2025
Positive: BG41 2025; CH04 2018-2025; CZ01 2018-2025; DE3
2018-2025; FI1B 2018-2025; FR1 2024-2025; HR05 2024-2025;
2.3.2 Employed ICT HU11 2018-2025; LT01 2024-2025; NL23 2023; NL32 2018-2025;
specialists NL35 2018-2025; PL91 2024-2025; PT1A 2018-2025; RO32 2018-
2024; SE11 2018-2025; SK01 2018-2025; UKI 2018-2025
Negative: --
36
Indicator Outliers (Positive / Negative)
Positive: DEB2 2021-2022; EL41 2025; EL43 2023-2025; EL52
2023-2024; EL54 2023-2024; EL62 2025; EL63 2023-2024; EL64
2023-2024; EL65 2023-2025; FI2 2021-2022; NO06 2021-2022;
3.1.1 SMEs introducing NO08 2021-2025; RS11 2021-2022
product innovations
Negative: ES63 2018-2025; RO11 2018-2020; RO12 2018-2020;
RO21 2018-2020; RO22 2023-2025; RO31 2018-2025; RO32 2018-
2020; RO41 2018-2025; RO42 2018-2025
Positive: BE2 2023-2025; DEB1 2023-2025; EL30 2023-2024; EL41
2025; EL43 2023-2025; EL52 2023-2024; EL54 2023-2024; EL61
3.1.2 SMEs introducing 2023-2024; EL62 2025; EL63 2023-2024; EL65 2023-2024
business process
innovations Negative: ES63 2021-2025; PL62 2018-2020; RO11 2023-2025;
RO12 2018-2025; RO21 2021-2025; RO22 2021-2025; RO31 2018-
2025; RO32 2018-2025; RO41 2018-2025; RO42 2018-2025
Positive: BE1 2023-2024; BE2 2021-2025; EL41 2021-2022; EL43
2018-2020; EL63 2021-2022; FI19 2021-2024; FI1B 2021-2024;
FI1C 2021-2022; FI1D 2023-2024; FI2 2025; NO02 2021-2025;
NO06 2018-2025; NO07 2021-2025; NO08 2023-2025; NO09 2023-
3.2.1 Innovative SMEs 2025; NO0A 2021-2025; SE11 2025; SE12 2025; SE22 2025; SE23
collaborating with others 2025; SE31 2025; SE32 2025; UKC 2018-2020; UKD 2018-2020;
UKE 2018-2020; UKF 2018-2020; UKG 2018-2022; UKH 2018-2020;
UKJ 2018-2022; UKK 2018-2020; UKL 2018-2020; UKM 2018-2020
Negative: --
Positive: CH01 2018-2025; CH03 2018-2025; CH04 2018-2025;
3.2.2 Public-private co- DK01 2018-2025; NL11 2021-2025; NL35 2021-2025; NO06 2018-
publications 2025
Negative: --
Positive: CH01 2023-2024; CH03 2018-2025; DE11 2018-2025;
DE12 2023-2024; DE13 2022-2023; DE14 2019-2024; DE21 2018-
2025; DE23 2018-2022; DE25 2018-2024; DEB3 2018-2024; DK05
3.3.1 PCT patent 2023-2025; FI19 2020-2021; FI1B 2018-2025; NL41 2018-2025;
applications NL42 2018-2019; SE11 2018-2025; SE12 2018-2024; SE22 2018-
2025; SE23 2020-2023
Negative: --
Positive: AT1 2022-2024; AT3 2022-2023; CH03 2021-2023; CH06
2018-2025; CH07 2018-2024; DE3 2022-2024; DE6 2023; DK01
3.3.2 Trademark 2019-2021; ES23 2018-2020; ES52 2018-2023; FI1B 2018-2024; FI2
applications 2018-2024; LT01 2022-2025; SE11 2018-2025; SE22 2022-2023
Negative: --
Positive: AT3 2018-2023; BG33 2018-2025; CH05 2018-2025; CH06
2018-2022; CZ03 2019-2020; DE11 2019-2020; DE21 2019; DE24
2018-2020; DE25 2020-2022; DE27 2018; DEA4 2018-2022; DEA5
2018-2021; DK04 2018-2024; ES52 2018-2019; FI2 2022-2024; ITH3
3.3.3 Design applications 2018-2023; ITH4 2018-2020; ITH5 2025; ITI2 2018-2024; ITI3 2018-
2025; NL41 2021-2024; PL21 2022-2023; PL41 2024-2025; PL72
2022; SE21 2018-2021
Negative: --
37
Indicator Outliers (Positive / Negative)
Positive: CH05 2018-2025; EL43 2018-2025; EL53 2018-2020;
EL54 2023-2024; EL62 2021-2022; EL64 2023-2024; ES13 2018-
4.1.1 Sales of new-to- 2020; ES41 2025; HR02 2025; IE04 2025; IE05 2023-2024; IE06
market and new-to-firm 2023-2024; PT1A 2025; PT2 2021-2022; UKC 2018-2020; UKD
innovations 2018-2020; UKF 2018-2020; UKG 2018-2020; UKJ 2018-2020; UKK
2018-2020; UKL 2018-2020; UKM 2018-2020
Negative: --
Positive: --
4.1.2 Employment in Negative: ES63 2018-2025; ES64 2018-2025; RO11 2018-2025;
innovative enterprises RO12 2018-2025; RO21 2018-2025; RO22 2018-2025; RO31 2018-
2025; RO32 2018-2025; RO41 2018-2025; RO42 2018-2025
Positive: --
4.2.1 Exports of medium Negative: EL41 2018-2025; EL42 2018-2025; EL43 2018-2025;
and high technology EL51 2018-2025; EL52 2018-2023; EL53 2018-2025; EL54 2018-
products 2025; EL61 2018; EL62 2018-2025; EL63 2018-2025; NO02 2018-
2025; NO06 2018-2025; NO07 2018-2025; NO08 2018-2025; NO09
2018-2025; NO0A 2018-2025; PT2 2018-2023
Positive: BG31 2018-2019; BG32 2018; BG34 2018; BG41 2018-
2021; BG42 2018-2020; CZ08 2018-2021; EL30 2020; EL41 2020;
EL51 2018-2020; EL52 2018-2021; EL53 2018-2020; EL61 2020;
EL64 2020; HR02 2019; HR05 2019-2021; HU11 2018; ITC1 2020;
4.3.2 Air emissions by fine ITC4 2018-2020; ITH3 2018-2020; PL21 2018-2021; PL22 2018-
particulates 2024; PL52 2018-2021; PL71 2018-2021; PL91 2018-2021; RO32
2018; RS11 2018-2024; RS12 2019-2021; RS21 2018-2023; RS22
2018-2023
Negative: --
Positive: CH01 2018-2025; CH03 2018-2025; CH04 2018-2025;
CH06 2022-2025; CH07 2018-2025; DK01 2019-2025; IE05 2018-
4.3.3 Labour productivity 2025; IE06 2018-2025; NO08 2018-2021
Negative: --
38
Table 9: Skewness of the indicators before and after a possible data transformation
Skewness after
Indicator Skewness
transformation
1.1.2 Population with tertiary education 0.189 --
1.1.3 Population involved in lifelong learning 0.753 --
1.2.1 International scientific co-publications 0.986 --
1.2.2 Scientific publications among the top 10% most cited -0.132 --
1.3.1 Broadband penetration -0.528 --
2.1.1 R&D expenditure in the public sector 0.691 --
2.2.1 R&D expenditure in the business sector 1.009 0.086
2.2.2 Non-R&D innovation expenditures 2.017 0.637
2.2.3 Innovation expenditures per person employed 1.404 0.097
2.3.1 Cloud computing in enterprises -0.172 --
2.3.2 Employed ICT specialists 0.914 --
3.1.1 SMEs introducing product innovations -0.222 --
3.1.2 SMEs introducing business process innovations -0.255 --
3.2.1 Innovative SMEs collaborating with others 0.507 --
3.2.2 Public-private co-publications 1.010 0.324
3.3.1 PCT patent applications 1.096 0.439
3.3.2 Trademark applications 0.672 --
3.3.3 Design applications 1.165 0.316
4.1.1 Sales of new-to-market and new-to-firm innovations 0.616 --
4.1.2 Employment in innovative enterprises -0.604 --
4.2.1 Exports of medium and high technology products -0.552 --
4.3.2 Air emissions by fine particulates 0.446 --
4.3.3 Labour productivity 0.250 --
39
3.10. Step 10: Calculating composite innovation indexes
For each year, a composite RII is calculated as the unweighted average of the re-scaled scores
for all indicators, where all indicators receive the same weight (1/23 if data are available for all
23 indicators).
However, the RIS uses data for fewer indicators than EIS, 23 compared to 32 in the EIS.
Moreover, the definitions of several indicators differ between the two, and regional data for some
indicators are less up to date than the national level data used in the EIS. Consequently, the
country level values of the RII and the Summary Innovation Index (SII) vary. Such differences
between the EIS and RIS would be difficult to explain. To align the country level results between
SII and RII, EIS-RIS alignment scores are applied to the RII. In this way, RII scores are adjusted
to match SII scores as follows:
1. Calculate the EIS-RIS alignment score by dividing EIS Summary Innovation Index at
country level by RIS Regional Innovation Index at country level: EIS_index_CTR /
RIS_index_CTR. EIS-RIS alignment scores are provided in (Table 10).
2. Adjust regional RII scores by multiplying them with the corresponding country's EIS-
RIS alignment score. EIS-RIS alignment scores affect only the overall RII values. The
values of individual indicators remain unchanged.
Table 10: EIS-RIS alignment scores
40
2018 2019 2020 2021 2022 2023 2024 2025
Slovenia 0.974 0.963 0.964 0.918 0.948 0.945 0.943 0.949
Spain 1.081 1.083 1.109 1.076 1.089 1.071 1.055 1.071
Sweden 0.980 0.978 0.975 0.970 0.986 0.979 0.982 0.980
Norway 0.950 0.951 0.938 0.940 0.989 0.982 0.986 0.987
Switzerland 1.026 1.020 1.023 1.020 1.016 0.988 0.985 0.983
Serbia 0.729 0.730 0.761 0.689 0.677 0.829 0.827 0.823
United Kingdom 1.020 1.029 1.052 1.172 1.194 1.175 1.201 1.219
Only adjusted values of RII are used and presented across all RIS deliverables.
Higher than one EIS-RIS alignment score increases the RII of the region, while lower than one
EIS-RIS alignment score decreases the RII of the region. Thus, due to correction factors, the
RII of regions slightly changed. A visual comparison of the results for the four main performance
groups is shown in Figure 2 and Figure 3, with the RIS 2025 results on the left and the results
not using correction scores on the right. It shows that the performance groups of the following
regions changed after applying the correction factor:
• Moved up performance group after applying the correction factor: DE14, DEA2, FR1,
FRH, FRY, FRL, IE06, NL11, NL12, NL22, NL36, NL41, NL42, ES22, ES42, ES43,
ES52, ES53, ES7, UKC, UKD, UKE, UKH, UKI, UKJ, UKK, UKL, UKN.
• Moved down performance group after applying the correction factor: FI19, EL41, EL51,
EL61, HU11, ITC1, ITC2, ITC4, ITH1, ITH3, ITI1, ITI4, LT01, LT02, PL82, SK01, SE32,
SE33, RS11.
41
Figure 2: RIS results after using EIS-RIS alignment scores Figure 3: RIS without using EIS-RIS alignment scores
Notes: Administrative boundaries: © EuroGeographics © OpenStreetMapCartography. The boundaries and names shown and the designations used on this map do not imply official
endorsement or acceptance by the European Union.
This map uses the NUTS 2024 classification for all countries except the United Kingdom (UK). As the UK is no longer part of the NUTS system, the map applies the NUTS 2021 version for
the UK, which corresponds to the International Territorial Levels (ITLs) currently used by the UK Office for National Statistics.
42
3.11. Step 11: Calculating relative to EU performance scores
Performance scores relative to the EU are calculated as the RII of the respective region divided
by the RII of the EU, multiplied by 100. The same approach is used to calculate for the individual
indicators re-scaled scores relative to the EU.
Relative performance scores are calculated for the full eight-year period compared to the
performance of the EU in 2018 and for the latest year also to that of the EU in 2025. For the
definition of the performance groups, only the performance scores relative to the EU in 2025
have been used.
Based on their RII scores relative to the EU in 2025, regions are categorised into four different
groups, namely Innovation Leaders, Strong Innovators, Moderate Innovators, and Emerging
Innovators. More specifically:
• Innovation Leaders where performance is above 125% of the EU average in 2025.
• Strong Innovators where performance is between 100% and 125% of the EU average
in 2025.
• Moderate Innovators where performance falls within the range from 70% to 100% of
the EU average in 2025, inclusive.
• Emerging Innovators where performance level is below 70% of the EU average in
2025.
To better show the diversity of regions, the four regional performance groups are broken down
into 12 sub-groups. Three sub-groups are defined within each performance group by dividing
the performance range in each group in three equal parts: the top one-third of regions (+), the
middle one-third of regions, and the bottom one-third of regions (-). The thresholds for these
groups are calculated by dividing the range in each performance group, i.e. the minimum
possible value and the maximum possible value, into three equal parts. The maximum possible
value in the Innovation Leader group is the value of the highest performing region31, while the
lowest possible value in the Emerging Innovator group is the value of the lowest performing
region32. The thresholds for the performance sub-groups in RIS 2025 are presented in Table
11.
Table 11: Defining performance sub-groups
31
155.40578
32
22.67127
33
The range for this group is 30.40578, calculated as 155.40578 − 125. Therefore, the groups are constructed
using step sizes equal to one third of this range, which is 10.13526.
43
Group Top sub-group (+) Middle sub-group Bottom sub-group (-)
Emerging Emerging Innovators + Emerging Innovators Emerging Innovators –
Innovators34 Between 54.2% and Between 38.4% and Below 38.4% of EU
70% of EU average 54.2% of EU average average
4. Structural indicators
The RIS uses a set of contextual (structural) indicators to help users understand the structural
differences between regions, which can explain variations in performance across the innovation
indicators used in the main measurement framework. These structural indicators are provided
in the regional profiles and online tool. The following sections present these indicators, explain
their relevance for understanding regional differences, and provide detailed information about
each structural indicator.
Years used in
Indicator Source
calculations
Employment share in Agriculture & Mining (A-B) 2022-2024 Eurostat
Employment share in Manufacturing (C) 2022-2024 Eurostat
Employment share in Utilities & Construction (D-F) 2022-2024 Eurostat
Employment share in Services (G–N) 2022-2024 Eurostat
Employment share in Public administration (O-U) 2022-2024 Eurostat
Average number of employed persons per 2021-2022 Eurostat
enterprise
GDP per capita (PPS) 2023 Eurostat
GDP per capita growth (PPS) 2019-2023 Eurostat
Population density 2023 Eurostat
Urbanisation 2024 Eurostat
Population size (000s) 2024 Eurostat
The employment share across different sectors reflects the structural characteristics of a
region’s economy, providing insight into its sectoral composition and development trajectory.
For example, a higher share in manufacturing (C) may positively influence regional performance
on innovation indicators such as R&D expenditure in the business sector, PCT patent
34
The range for this group is 47.32873, calculated as 70 − 22.67127. Therefore, the groups are constructed using
step sizes equal to one third of this range, which is 15.77624333333333.
44
applications, and the prevalence of innovative enterprises. Conversely, regions with a high
concentration of public sector employment (O-U) often reflect structural tendencies such as a
strong presence of government institutions or a reliance on public services. This can be
associated with lower levels of private sector innovation activity, which in turn may impact
outcomes on some indicators used in the RIS.
Average number of employed persons per enterprise provides insight into the structural
composition of the business landscape, indicating whether a region is dominated by micro-
enterprises, SMEs, or larger firms. Regions with larger average firm sizes may benefit from
greater internal capacity for R&D and innovation activities, while those with smaller enterprises
may demonstrate high entrepreneurial activity but face resource limitations that can impact
innovation outcomes.
Nominal Gross Domestic Product per capita is a measure for interpreting real income
differences between regions. Higher income can increase the demand for new innovative goods
and services.
GDP per capita growth (PPS) measures economic growth. In economies that grow faster,
increasing demand may provide more favourable conditions for enterprises to sell their goods
and services.
Population density is measured by inhabitants per km2. Densely populated areas are often
more innovative due to easier knowledge diffusion, concentration of government and
educational services, better training opportunities, and higher shares of highly educated
workers.
Degree of urbanisation captures the spatial distribution of the population across different
settlement types within a region. This indicator could help explain regional disparities in
innovation performance. Urban and intermediate areas typically offer more favourable enabling
conditions for innovation, such as better access to infrastructure, skilled labour, research
institutions, and innovation networks. In contrast, rural regions may face structural limitations in
these areas.
Population size is measured by the population in the region on 1 January of 2024. Larger
population size can stimulate regional markets, creating greater demand for goods and services.
This may enhance the business environment and support the scale-up of innovative activities,
particularly in growing urban regions.
45
Data source Eurostat [htec_emp_reg2]
Data availability NUTS 2: 2008-2024
46
Data source Eurostat [nama_10r_2gdp]
Data availability NUTS 2: 2000-2023
47
Annex A: A Manual for extracting and compiling RIS
data
This Annex describes how raw data have been collected for each indicator.
For data from Eurostat, the variable names are added between [ ]. These can be used in the
search box on Eurostat’s website ([Link] to access the
data.
Data from the OECD are available at: [Link]
48
Population data for all regions are extracted from Eurostat:
• Dataset: Population on 1 January by age, sex and NUTS 2 region [demo_r_d2jan]
o AGE: Total
o SEX: Total
o UNIT: Number
• Data are available for 1990-2024
Population data from 2020 onwards for the United Kingdom are extracted from the Office for
National Statistics:
• Dataset: United Kingdom population mid-year estimate [UKPOP]
• This data was used to calculate population growth rate. The growth rate was used to
impute data at the national level. For the regional level, share of the latest available
year region population in the national population were used to calculate region
population for data gaps.
Calculation of indicator
The indicator is calculated by dividing the number of international scientific co-publications by
the population size in millions.
49
• Dataset: GERD by sector of performance and NUTS 2 regions [rd_e_gerdreg]
o SECTPERF: Government sector; Higher education sector
o UNIT: Percentage of gross domestic product (GDP)
• The indicator is calculated as the sum of the share of R&D expenditure by the
government as a percentage of GDP and of the share of R&D expenditure by the higher
education sector as a percentage of GDP.
• Data are available for 2000-2023
50
confidential basis and are only to be used for constructing the RIS reports. None of the data
used for the RIS 2023 can therefore be shared.
51
2.3.2 ICT specialists (as a percentage of total employment)
Regional and country share of Employment in information and communication (NACE J
Data for both regional and country share are extracted from Eurostat:
• Dataset: Employment by sex, age, economic activity and NUTS 2 regions (NACE Rev.
2) (1 000) [lfst_r_lfe2en2]
o AGE: From 25 to 64 years
o SEX: Total
o NACE_R2: Total - all NACE activities; Information and communication
o UNIT: Thousand persons
• Data are available for 2008-2024.
Both regional and country shares are calculated by diviging persons employed in Information
and communication (J) by persons employed in total (Total - all NACE activities).
National share of ICT specialists in total employment
Data are extracted from Eurostat:
• Dataset: Employed ICT specialists - total [isoc_sks_itspt]:
o UNIT: Percentage of total employment
• Data are available for 2004-2024.
Calculation of indicator
Employed ICT specialists at regional level is calculated by first determining the share of
employment in the information and communication sector (NACE J) at both regional and
national levels. The regional share is then divided by the national share to obtain a relative
score. This relative score is multiplied by the national share of ICT specialists in total
employment, resulting in an estimated share of employed ICT specialists at the regional level.
• Employed ICT specialists = Regional share of Employment in information and
communication (NACE J) / Country share of Employment in information and
communication (NACE J) * Country share of employed ICT specialists
52
• Denominator: Enterprises, employed persons and turnover by innovation status and
NUTS region (CIS2022) [inn_cis13_bas_r]
o ENTERPR: Total
o INDIC_INN: Enterprises
o SIZECLAS: From 10 to 249 employees
o NACE_R2: Economic activities covered by CIS regulation
o UNIT: Number
• The indicator is calculated by dividing the data for the numerator by the data for the
denominator and multiplying by 100.
• The EU27 aggregate is calculated using only data for those Member States for which
both numerator and denominator data are available.
Regional CIS data for 2014, 2016, 2018, and 2020 are not directly available from Eurostat and
have been collected from the National Statistical Offices (NSOs) in several data requests: a
request for regional CIS 2014 data for the RIS 2017, a request for regional CIS 2016 data for
the RIS 2019, a request for regional CIS 2018 data for the RIS 2021, and a request for regional
CIS 2020 data for the RIS 2023. Regional CIS data are made available by NSOs on a
confidential basis and are only to be used for constructing the RIS reports. None of the data
used for the RIS 2023 can therefore be shared.
53
• The EU27 aggregate is calculated using only data for those Member States for which
both numerator and denominator data are available.
Regional CIS data for 2014, 2016, 2018, and 2020 are not directly available from Eurostat and
have been collected from the National Statistical Offices (NSOs) in several data requests: a
request for regional CIS 2014 data for the RIS 2017, a request for regional CIS 2016 data for
the RIS 2019, a request for regional CIS 2018 data for the RIS 2021, and a request for regional
CIS 2020 data for the RIS 2023. Regional CIS data are made available by NSOs on a
confidential basis and are only to be used for constructing the RIS reports. None of the data
used for the RIS 2023 can therefore be shared.
54
3.2.2 Public-private co-publications per million population
Numerator
Data on number of public-private co-publications for all regions are calculated and made
available by Science-Metrix for the years 2000-2024. Data have been calculated using full
counting and have been extracted from Scopus. As there is no EU27 value provided in the
regional dataset for the numerator, it has been calculated by summing the EU27 MS values.
Denominator
Population data for all regions are extracted from Eurostat:
• Dataset: Population on 1 January by age, sex and NUTS 2 region [demo_r_d2jan]
o AGE: Total
o SEX: Total
o UNIT: Number
• Data are available for 1990-2024
Population data from 2020 onwards for the United Kingdom are extracted from the Office for
National Statistics:
• Dataset: United Kingdom population mid-year estimate [UKPOP]
• This data was used to calculate population growth rate. The growth rate was used to
impute data at the national level. For the regional level, share of the latest available
year region population in the national population were used to calculate region
population for data gaps.
Calculation of indicator
The indicator is calculated by dividing the number of international scientific co-publications by
the population size in millions.
35
More information and how to get access to this database is available at:
[Link]
55
• Then regional patent share for each record should be calculated by multiplying
‘reg_share’ (multiple allocation to a region) by ‘inv_share’ (inventor’s share). This
approach accounts for both the geographical distribution and contribution of inventors,
avoiding double-counting when patents span multiple regions.
• The count of patents per region is obtained by summing the regional patent share
across all records grouped by ‘Reg_code’ (NUTS3/TL3 region code). This provides the
total weighted patent count per region.
• As there is no EU27 value provided in the regional dataset for the numerator, it has
been calculated by summing the EU27 MS values.
• Data are available for 1977-2022
Denominator
Data on Gross Domestic Product (GDP) are extracted from Eurostat:
• Dataset: Gross domestic product (GDP) at current market prices by NUTS 2 regions
[nama_10r_2gd]
o UNIT: Million purchasing power standards (PPS, EU27 from 2020)
• Data are available for 2000-2023
For Switzerland and the United Kingdom GDP missing data are imputed using data from the
OECD. Data should be accessed from OECD Data Explorer.
• Indicator: Gross domestic product – Regions (DSD_REG_ECO@DF_GDP)
• Frequency of observation: Annual
• Combined measure: Gross domestic product
• Combined unit of measure: US dollars, PPP converted, Millions, Current prices
USD values are converted into EUR using a single average exchange rate. This rate is
calculated by first deriving country-specific rates: dividing the Eurostat EUR value by the OECD
USD value for each country where both are available. Then averaging these derived rates
across all such countries to get a single average exchange rate. This rate is then used to convert
values from USD to EUR in Switzerland and the United Kingdom.
Calculation of indicator
The indicator is calculated by dividing the number of PCT patent applications by GDP in PPPs
and multiplying by 1000. The indicator is calculated for each region as a 2-year rolling average.
Prior to calculation of the rolling average, missing values are imputed (replacing with the last
available value first, then the next available value).
56
• Dataset: Gross domestic product (GDP) at current market prices by NUTS 2 regions
[nama_10r_2gd]
o UNIT: Million purchasing power standards (PPS, EU27 from 2020)
• Data are available for 2000-2023
For Switzerland and the United Kingdom GDP missing data are imputed using data from the
OECD. Data should be accessed from OECD Data Explorer.
• Indicator: Gross domestic product – Regions (DSD_REG_ECO@DF_GDP)
• Frequency of observation: Annual
• Combined measure: Gross domestic product
• Combined unit of measure: US dollars, PPP converted, Millions, Current prices
Data in USD are converted into EUR based on the conversion rate calculated using Eurostat
and OECD data in other countries.
Calculation of indicator
The indicator is calculated by dividing the number of trademark applications by GDP in PPPs
and multiplying by 1000. The indicator is calculated for each region as a 2-year rolling average.
Prior to calculation of the rolling average, missing values are imputed (replacing with the last
available value first, then the next available value).
57
The indicator is calculated by dividing the number of design applications by GDP in PPPs and
multiplying by 1000. The indicator is calculated for each region as a 2-year rolling average. Prior
to calculation of the rolling average, missing values are imputed (replacing with the last available
value first, then the next available value).
58
o ENTERPR: Innovation active enterprises
o INDIC_INN: Employees
o SIZECLAS: From 10 to 249 employees
o NACE_R2: Economic activities covered by CIS regulation
o UNIT: Number
• Denominator: Enterprises, employed persons and turnover by innovation status and
NUTS region (CIS2022) [inn_cis13_bas_r]
o ENTERPR: Total
o INDIC_INN: Employees
o SIZECLAS: From 10 to 249 employees
o NACE_R2: Economic activities covered by CIS regulation
o UNIT: Number
• The indicator is calculated by dividing the data for the numerator by the data for the
denominator and multiplying by 100.
• The EU27 aggregate is calculated using only data for those Member States for which
both numerator and denominator data are available.
Regional CIS data for 2014, 2016, 2018, and 2020 are not directly available from Eurostat and
have been collected from the National Statistical Offices (NSOs) in several data requests: a
request for regional CIS 2014 data for the RIS 2017, a request for regional CIS 2016 data for
the RIS 2019, a request for regional CIS 2018 data for the RIS 2021, and a request for regional
CIS 2020 data for the RIS 2023. Regional CIS data are made available by NSOs on a
confidential basis and are only to be used for constructing the RIS reports. None of the data
used for the RIS 2023 can therefore be shared.
Dataset: Lopez Alvarez, Jorge; Galiano Bastarrica, Luis Antonio; Rueda-Cantuche, José
36
59
considered as medium and high technology sector by Eurostat37: B Mining and
quarrying, C10 Manufacture of food products, C11 Manufacture of beverages, C12
Manufacture of tobacco products, C13 Manufacture of textiles, C14 Manufacture of
wearing apparel, C15 Manufacture of leather and related products, C16 Manufacture
of wood and of products of wood and cork, except furniture; manufacture of articles of
straw and plaiting materials, C17 Manufacture of paper and paper products, C18
Printing and reproduction of recorded media, C19 Manufacture of coke and refined
petroleum products, C22 Manufacture of rubber and plastic products, C23 Manufacture
of other non-metallic mineral products, C24 Manufacture of basic metals, C25
Manufacture of fabricated metal products, except machinery and equipment, C31
Manufacture of furniture, C32 Other manufacturing, C33 Repair and installation of
machinery and equipment, D Electricity, gas, steam and air conditioning supply, E
Water supply; sewerage, waste management and remediation activities.
3. Calculate ratio between exports at region and country level for each region separately
for:
o Total export
o Export in Medium and high technology sector (MHT)
𝐸𝑥𝑝𝑜𝑟𝑡𝑠 𝑖𝑛 𝐸𝑈𝑅𝑟𝑒𝑔𝑖𝑜𝑛𝑎𝑙
𝑅𝑎𝑡𝑖𝑜 =
𝐸𝑥𝑝𝑜𝑟𝑡𝑠 𝑖𝑛 𝐸𝑈𝑅𝑐𝑜𝑢𝑛𝑡𝑟𝑦
4. Use the ratios calculated in the Step 3 to approximate exports at regional level based
on country level data from EIS at a given year:
o Total export at the regional level = total export at the country level * ratiototal
o Medium and high technology sector export at the regional level = Medium and
high technology sector export at the country level * ratioMHT
5. Calculate regional value for Exports of medium and high technology products using
regional level export data calculated at the Step 4 above:
Medium and high technology sector export 𝑟𝑒𝑔𝑖𝑜𝑛𝑎𝑙
𝐼𝑛𝑑𝑖𝑐𝑎𝑡𝑜𝑟 =
Total export 𝑟𝑒𝑔𝑖𝑜𝑛𝑎𝑙
37
[Link]
tech_classification_of_manufacturing_industries
38
[Link]
9512f0622ebc?activeAccordion=
60
• Data Aggregation id: All
• Category: All
• Health Indicator: All
• Sex: Total
After the data is downloaded, the values for relevant regions of the column ‘Air Pollution
Population Weighted Average [ug/m3]’ should be taken. This column already has a final value
for the indicator. No additional calculations are needed.
61
Annex B: Report of a statistical audit of RIS done by
JRC – COIN team
Authors
Smallenbroek, Oscar, European Commission, Joint Research Centre, Ispra, Italy
The JRC guidelines are governed by the principle of least intervention, aiming to make the fullest
possible use of the available data while remaining flexible enough to accommodate a wide range
of scenarios. The JRC recommends an approach for outlier identification based on skewness
and kurtosis values, i.e., an absolute skewness higher than 2.0 and kurtosis higher than 3.5.
The current RIS criteria for flagging variables for outlier treatment differ from those put forward
by the JRC. Specifically, the current RIS framework flags variables with a skewness value
greater than or equal to one, applying a strict criterion that may result in smoothing the
distribution and reducing the information available. This criterion also ignores the possibility of
highly negatively skewed distributions, although such distributions are not present in the current
RIS dataset. Furthermore, not considering kurtosis under the current RIS outlier identification
can potentially ignores highly leptokurtic distributions. These distributions contain many outlying
observations that skewness alone may fail to detect.
The COIN team investigated whether any indicators would still be flagged as outliers using the
JRC criteria after applying the RIS outlier treatment process. Of the five variables treated with
a square root transformation, only one - 2.2.2 Non-R&D innovation expenditures- would require
further treatment if the JRC criterion were used. Nevertheless, the JRC recommends adopting
a combined threshold of 2.0 for absolute skewness and 3.5 for kurtosis as treatment criteria, as
these criteria are more comprehensive and will serve any future iterations of the RIS framework,
in which new variables may present new challenges.
62
Correlation analysis of indicators
This section reviews the statistical coherence of the RIS indicators by examining the correlations
between indicators and the correlations between indicators and the index. The RIS comprises
23 indicators, which are aggregated using the arithmetic mean to create the index. According
to the COIN guidelines, all indicators that are aggregated should have a correlation of at least
0.30. A sufficient correlation between indicators facilitates the flow of information from indicators
to aggregates by ensuring they point in the same direction and provide non-conflicting
information.
Of the 253 indicator pairs, 151 (60%) correlations meet the guideline of at least 0.30, which
is a good result given the large number of correlations. Moreover, there are no correlations
below zero, which would signal conflicting information being aggregated. On the other hand,
102 (40%) correlations do not meet the guidelines. Almost half of these (48) are near zero,
meaning below 0.10. Correlations between these indicators may not allow information to be
transmitted efficiently to be reflected at the top level. To investigate the information transfer, we
turn to the correlation between indicators and the index.
The good correlation structure between indicators is reflected in the correlations
between indicators and the RIS as seen in Figure 4, of which 83% meet the guidelines of at
least 0.30. In fact, almost all indicator-index correlations exceed 0.50, demonstrating that the
information from the indicators is well reflected in the index. There are four indicator correlations
with the index that do not meet the guideline of 0.30. Two of them (NonRDInnExp and DesApps)
are very close to the guideline and do not pose any issues. The other two (SalesNewInn and
ExpMedHiTech) are slightly lower, around 0.20, indicating that the information in these
indicators is less well reflected in the overall index scores, but are still close to the acceptable
threshold.
63
Figure 4: Correlations between indicators and RIS index scores
Overall, the statistical coherence of the RIS indicator framework appears excellent, with a
large number of positive indicator pair correlations and predominantly strong correlations
between indicators and the index.
64
uncertainty analysis takes a random set of weights and a random combination of the modelling
choices in Table 13 to calculate the index. By repeating this procedure thousands of times,
confidence intervals are obtained, indicating how much these choices can impact the rankings
and thereby providing an estimate of uncertainty in the RIS.
The uncertainty analysis shows the extent to which the rankings produced by the current
methodology could change if other valid alternatives are chosen. The COIN team considers a
15% change in ranking as acceptable uncertainty, while a 10% change in ranking is expected.
Figure 2 shows the results of the uncertainty analysis. The median ranking is the blue point, and
the bars represent 95% confidence intervals across iterations. The regions are sorted on the x-
axis using their nominal RIS ranking.
In the RIS, 82% of regions have an acceptable level of uncertainty associated with their ranking,
with their rankings changing by up to 36 ranks depending on the modelling choices made. This
group includes 55% of all regions that meet the 10% criterion, with their rankings changing by
less than 25 ranks for any combination of modelling choices. Furthermore, 13% of regions have
an extremely small confidence interval of only 5% of the total range, corresponding to a change
of only 12 ranks.
Figure 5: Uncertainty analysis of the RIS rankings across 8000 iterations
However, there are also some regions that are more sensitive to alternative modelling choices.
18% of regions change by more than 36 ranks or more than 15% of the total range. Most of
these, change by more than 45 ranks or 20% of the total range. These regions are concentrated
in specific countries, namely the United Kingdom (seven regions) and Norway (four regions),
while Italy, Netherlands, Germany, Finland, Poland, Serbia, Greece, and Spain have only one
or two regions whose rank is uncertain. These regions are labelled in Figure 5. According to the
Sobel sensitivity index, the uncertainty in ranking is almost entirely (92%) due to the choice of
imputation and its interaction with other choices.
65
Overall, the extensive uncertainty analysis shows that the RIS is quite robust to
alternative modelling choices. The modelling choices specified as alternatives by the COIN
team included specifications that changed the underlying distributions, imputation, and
aggregation – ranging from arithmetic to nearly geometric. The results of the uncertainty
analysis are therefore promising, as the rankings of 82% of regions in the RIS are robust to
many combinations of plausible but substantively different modelling choices.
Table 13: Model choice of the RIS framework and alternatives
Treatment 1. Winsorise all observations +/- 2 1. If absolute skewness > 2 and kurtosis >
S.D. from the mean, 3.5: Winsorise (max = 5 obs.),
2. If skewness > 1, use square root 2. If still absolute skewness > 2 and
transformation kurtosis > 3.5, use log transformation
Conclusion
In conclusion, the JRC-COIN audit of the RIS has provided a comprehensive assessment of the
index's statistical soundness and robustness. The findings of the audit indicate that the RIS
framework is well-structured and that the modelling assumptions underlying the index
are generally well-founded. While some areas for improvement have been identified, such as
the treatment of outliers and the potential impact of the imputation method, the audit suggests
that the RIS is a reliable and transparent tool for policymakers and stakeholders. Overall,
the audit confirms that the RIS is a valuable resource for assessing regional innovation, and
that its results can be used with confidence to inform policy priorities and initiatives.
66
GETTING IN TOUCH WITH THE EU
In person
All over the European Union there are hundreds of Europe Direct centres. You can find the address of the centre
nearest you online ([Link]/contact-eu/meet-us_en).
EU publications
You can view or order EU publications at [Link]/en/publications. Multiple copies of free publications
can be obtained by contacting Europe Direct or your local documentation centre ( european-
[Link]/contact-eu/meet-us_en).
EU open data
The portal [Link] provides access to open datasets from the EU institutions, bodies and agencies. These can
be downloaded and reused for free, for both commercial and non-commercial purposes. The portal also provides
access to a wealth of datasets from European countries.
67
Within the context of the Regional Innovation Scoreboard (RIS), the
RIS Methodology Report provides more detail on the methodology
used for the RIS and the construction of the Regional Innovation
Index (RII). The Methodology Report also provides detailed
methodological information on the indicators used for both the RII
and the Structural indicators that aim to provide a better
understanding of the impact of structural differences on innovation
performance scores.
The international scientific co-publications indicator is computed by dividing the number of scientific publications with at least one international co-author by the total population . This indicator reveals that global research collaboration is increasingly becoming essential, showcasing the cross-border exchange of ideas and multilateral involvement in scientific advancements .
Regional data availability on innovative SMEs significantly enhances research studies by providing granular insights into economic development patterns, enabling tailored policy-making, and supporting targeted investments in innovation ecosystems. The precise information allows researchers to correlate innovation activities directly with regional economic outputs and workforce skills, thus informing evidence-based strategies for growth . Regions without comprehensive data limit the scope of analysis and hinder the formulation of universally applicable conclusions .
The employment of ICT specialists as a percentage of total employment is calculated by dividing the regional share of employment in the information and communication sector by the country share and then multiplying by the national percentage of ICT specialists to obtain a regional estimate . This calculation implies that regions with higher percentages have stronger technological capabilities and greater emphasis on digital skills and infrastructure, reflecting advanced stages of digital transformation .
Innovation expenditure in SMEs is significant as it reflects their commitment to research and development activities, potentially leading to increased competitiveness and business growth. This data is calculated using spending on innovation activities (including R&D) as the numerator and the total number of employees in SMEs as the denominator, multiplied by 1000 to form a ratio . The calculations are based on data obtained from the Eurostat's Community Innovation Survey for specific regions .
Cloud computing services adoption rates are measured using data extracted from Eurostat, specifically looking at enterprises with at least 10 employees across various economic activities, excluding agriculture, forestry, fishing, mining, and quarrying. The dataset used is 'Cloud computing services by NACE Rev. 2 activity and NUTS 2 region' . Factors that may influence these rates include regional economic development, the availability of technology infrastructure, and the sectoral composition of the economy in different areas .
Incomplete SME innovation indicator data undermines policy-making by preventing accurate assessments of innovation performance and economic competitiveness. It obstructs the identification of growth opportunities, allocation of resources, and the design of interventions tailored to specific needs . Consequently, regions with insufficient data might struggle to enact policies that are appropriately targeted to stimulate innovation and enhance competitiveness .
The adoption of cloud computing across SMEs is pivotal for digital transformation, enhancing operational efficiency, and fostering innovative business models. Data from surveys indicate widespread usage in regions with developed digital infrastructure, emphasizing the role of technology in modern business environments . The significance lies in facilitating scalability, improving data management, and providing competitive advantages to SMEs actively investing in cloud solutions .
Challenges in assessing SME innovation arise from incomplete data coverage and confidentiality agreements that limit data sharing post-publication of reports . Many regions lack consistent datasets over time, with some only providing partial snapshots of SME activities. This lack of uniform data hinders comprehensive analysis of trends and regional performance comparisons in innovation activities .
Regional variations in sales of new-to-market innovations can significantly affect national innovation ecosystems by creating disparities in economic growth and innovation capacities among regions. Regions with higher sales figures contribute more robustly to national innovation outputs, thereby attracting investments and skilled labor, while regions lagging behind may experience reduced economic dynamism and innovation potential . These discrepancies necessitate targeted policy intervention to balance innovation development across the nation .
Employment levels in innovative SMEs are tracked by measuring the number of employed persons in these enterprises and comparing it to total SME employment. The numerator is the number of employed persons in innovative SMEs, while the denominator reflects the total employment in SMEs . Recent trends indicate growing or stable employment levels in regions with high innovation activities but specific numbers are not uniformly available across regions .