Systems mapping for international benchmarking of UK science and - - PowerPoint PPT Presentation

Systems mapping for international benchmarking of UK science and innovation

.

Ian M Mitchell FORS March 2015

Agenda

• Systems thinking in BIS

– Catalyst for policy

• Science and Innovation

Question

• Systems approach
• What we did
• Outputs
• Discussion

2

Outline

• O.R. structures problems
• Systems Thinking catalyses policy definition
• Systems Thinking with Causal Loop Diagrams

builds frameworks for complicated areas by creating maps from stakeholder views.

• Maps summarise areas in terms acceptable to

policy leads and stakeholders.

• Success depends on a Socio-technical process

rather than an analytical exercise.

• Early is better: in the ROAMEF cycle, but also to

structure studies

3

 Roundtable of ROAMEF

Z

Rationale Objectives Appraisal Monitoring Evaluation Feedback

5

Spectrum of rigour and complexity for models of a system, components and interactions

Low High

Components and Boundaries

• Things
• Information
• Groups

Influences

• Flows
• Quantity
• Time
• Positive
• Negative

Patterns

• Feedback loops
• Reinforcing
• Balancing
• Pinch-points
• Levers

Systemigrams Complex layered views Quantitative models Software: eg Vensim Informal to formal methods Lists - Sketches - Mind maps Causal Loop Diagramming Post it - paper - pencil – pen Software: eg Vensim

A B E C D F

• +

+ + + + + A B E C F D

• f use

System Models

A regularly interacting or interdependent group of items forming a unified whole

Workshop Brief

Activity 1 Introduction

Background and Brief overview of the method

Activity 2

Agree broad areas Consider and agree broad areas of influence that should be covered by the map,

Activity 3 Generate Variables

Generate key variables that reflect the interest of the client

Activity 4 Identify Causes, Effects, Feedbacks and Data

Map how each variable affects the variable of interest and other variables in the diagram. Identify additional variables and how they impact on the system Consider the data available on these

Activity 5 Wash Up

Review workshop output

SAI Question

• What does international comparative evidence tell

us about the priority actions for the UK’s Science and Innovation System and its contribution to the economy, if we are to maintain a global leadership position in this domain?

Components

8

Seed Sequence

• From Science and Innovation to a more vibrant

economy in 10 years time:

– Developing people, firms and ideas from initial discovery or invention to application in commercially merchantable goods and services

Ideas Discoveries Ideas Goods Goods Services

Example - Bullpup

Ideas Discoveries Ideas

?

Goods Goods Services 1842 – Brown Bess 1864– Prof Potter 1989-SA-80 Ensign

Workshop Approach

• The map grew through three workshops with

participants from policy areas in Higher Education, Further Education and Research

• Large group – small group then individual by

phone

11

Workshop 1

Workshop 2

• Research area
• Two variables from Workshop 1 as seeds and

connectors

13

Single view

• Buying In

• f Policy

• Number of

• Management

• +

• f how

• f Investors

• Services

Benefits to Society

• +

• utside UK of

• +

• +

• +
• +

• +

• f Research

• +

• Valley of death

• ther

IDEAS MONEY PEOPLE FIRMS COMMERCE

CULTURE

Mk 6A Summary

Needs Sparks Innovation ideas Innovation Outputs Innovation Successes Goods and Services Sold Rewards Confidence

• f Investors

Innovation Resources + + + + + + + Connections + <Caution>

• "Valley of

Death" Commerce

Innovation Pipeline

Knowledge assets Talent Feedback

<Friction>

• Structures and

Incentives

++ + + + +

Money

+ +

Mk 6A – Cycles

Needs Challenges Sparks Innovation ideas Innovation Outputs Innovation Successes Goods Sold Services Sold Rewards Coverage Profile Confidence

• f Investors

Innovation Resources + + + + + + + + + + + + Connections + <Number of Inspirational innovators (Edisons)> + <Population of innovators> + <P7 : Absorptive Capacity> + <Viable Business Plans> + <Extent of diffusion of Knowledge> + <Demand> + + <Caution>

• <Leakage outside UK of

exploitation (eg Skylon)>

• <Knowledge of how

technology works> +

"Valley of Death" Commerce

Innovation Pipeline

Knowledge Assets Talent Feedback

<National Security Needs> + <Health Needs> + <Friction>

• Structures and

Incentives

<Finance for innovation> + O2: Sales of new to market and new to firm innovations

Talent

Number of Moves to Other Occupations Distractions eg Publications for academic assessments CPD Participants Trained Skilled Individuals Population of innovators Mobility of People eg career structures Number of Curious People Number of Scientists and engineers Number of Curious academics Number of UK students Number of Overseas students Number of apprentices Number of Inspirational innovators (Edisons) Number of persistant people + + + + + +

• Number of

Students in Quality Education + + Number of Bottom of Pyramid Innovators + + + + Access to Researchers

• f Choice

+ Partnerships + Overseas alumni + <Funding for Undegraduates> P1: Educational Attainment P2: % of total first-stage graduates with science and engineering degrees P3: Researchers headcount per thousand employed P4: New doctorate graduates as a % of population in reference age cohort P5: Netflow

• f

internaltional Students P8: Numeracy and Literacy level E3: Skills intensity of manufacturing/ services O1: Labour Productivity

Structures & Incentives

S3: State of Clusters of SMEs and Universities Number of facilities to "mix" eg MIT Standards Metrology Anglophones- numbers of english speakers IP Based companies Viable Business Plans P7 : Absorptive Capacity + + + + + Innovative Companies Academic Spin offs (academic research) Hubs eg Shoreditch + E5: Start up rates per 100k population= Number of Start Ups + + + Technicums + Graduate Firms + + Conferences + <New Technologies designed> + HE Establishments FE Establishments Science Cities S2: Firms Collaborating

• n innovation

= Business User University Interactions + + Infrastructure for Innovation

• Technology

+ + Numbers of Interested Business People + Management Skills in Application + + P6: management and leadership skills O6: SMES introducing product or process innovations O7: SMEs introducing marketing or

• rganisation

al innovations

Knowledge Assets

Excellent Research Conducted Degree of excellence of research K3: Quality and quantity of Research Technology facilities Discoveries Made Stock of Knowledge Intellectual Property Licenses - Other Licences - software + + Extent of diffusion of Knowledge Research Publications + + + + New Technologies designed + + + Absorptive capacity for Research elsewhere + Quality of Research Environment + + <Access to Researchers

• f Choice>

+ <University Autonomy> + Knowledge

• f how

technology works + <Innovation Successes> + <Innovation Failures> + <Relative availability of Research funds> + K1: Share

• f the

world's most cited publications K2: Co-authorship and co-invention as a % of scientific publications and PCT patent applications K4: Patents per million population S1: Attractiveness to scientists and researchers O4: Firms having introduced a new to market innovattion

Money

Finance for innovation Clean Money Acceptable Payback period + + Investor Confidence + Funding for PhD Funding for MSc Funding for Undegraduates Government Revenues + + + Research council Institution Research Funds + OGD Research Funds Relative availability of Research funds Incentives Tax Credits

• +

Industrial Investment + ERDF International investment + + + Size of UK Market Size of European Market UK trade Trade network + + Demand + + <Overseas alumni> + Local economies + <Science Cities> + State of economy + + + M1: R&D funding from abroad as % of GERD M2: Extent to which FDI brings new technology into the country M3: BERD intensity M4:Percentage

• f GERD

financed by Goverrnment M5: Venture Capital as %

• f GDP

M6: Ability to finance through local equity markets M8: Non R& D innovation expenditure as % of total expenditure E2: Intensity

• f

Competition E4: Quality of demand conditions O3: Knowledge intensive services exports O5: Technology balance of payments

Government

Government Incentives eg Longitude Cyber Sy Uncertainty

• f Policy
• Regulatory

Barriers - Risk averse Prohibition National Security Needs Fitness of Intellectual Property Protection Health Needs Complacency

• f firms

Independence from politics

• "Rug-pulling"

policy changes

• n funding

+ Administrative Burden + Political stability

• S5:

Government Procurement of technology S4: Intellectual property rights protection E1: Overall Assessment

• f the ease of

doing business

Challenges

Leakage outside UK

• f exploitation (eg

Skylon) Degree of Cultural aversion to risk Innovation Failures Severity and Impact of failures Acceptance of failure as a badge of honor

• +

+ Caution + <Uncertainty of Policy> + Fear of loss

• f reward

+ <Fitness of Intellectual Property Protection>

• Friction

<Administrative Burden> +

• Buying In

• f Policy

• Number of

• Management

• +

• f how

• f Investors

• Services

• +

• utside UK of

• +

• +

• +
• +

• +

• f Research

• +

• Valley of death

• ther

KNOWLEDGE ASSETS MONEY TALENT STRUCTURES & INCENTIVES INNOVATION OUTPUTS

BROADER ENVIRONMENT

STRUCTURES & INCENTIVES

KEY

MONEY KNOWLEDGE ASSETS TALENT INNOVATION OUTPUTS BROADER ENVIRONMENT STRUCTURES & INCENTIVES

KEY

MONEY KNOWLEDGE ASSETS TALENT INNOVATION OUTPUTS BROADER ENVIRONMENT

The map

Outputs

System mapping

• ffers

a useful technique to represent the views of a large number of people, to determine boundaries, components and relative dependencies within a system. The OR Unit in BIS used Causal Loop Diagramming as described by Peter Senge in the Fifth Discipline. The Facilitators built influence diagrams representing the views

• f

the participants, creating the components and relationships with Post-its and points arising from discussion

• n
• whiteboards. The Systems map that

resulted, drawn in Vensim, illustrates the complexity of the science and innovation system and many feedback loops within it. The map grew through three workshops with participants from policy areas in Higher Education, Further Education and Research, and was further informed by discussion with members of the Intellectual Property Office and the National Measurement

• Office. The map informed discussions

between analytical communities of OR and the Economists compiling data. Actors within the system include the government, public services, higher and further education, business and industry, financial markets, customers and citizens, learned societies and charities. A Six-Part Framework reflecting key elements of the system allowed benchmarking of the UK against key comparator countries. This work found broad consensus and empirical evidence about the key features of effective science and innovation systems.

Foreword from BIS Permanent Secretary Martin Donnelly and Director General, Knowledge and Innovation Sir John O’Reilly Britain’s prosperity in a rapidly changing global economy depends critically on the quality and quantity of our science, innovation and skills. To achieve sustainable growth we need to examine carefully the evidence of how others are approaching these challenges, to see what we can learn. This report takes a longer-term, strategic view and provides a valuable contribution to

• ur

evidence base. As such it will help us to build on the UK’s world class science base and innovation infrastructure to secure our future prosperity.

https://www.gov.uk/government/publications/science-and-innovation-system-international- benchmarking

Social - Advantages

• Buy in

– The process aggregates participants’ views

• Common understanding

– Context and connections for the participants become visible

• Immediate Engagement

– Speed in use – Essential to obtain engagement