(Open Innovation Lecture-11e)
Performance Indicators for Open Innovation Activities

This page is written based on the original article.

This article shows various performance indicators to improve open innovation activities.

Finding Appropriate Performance Indicators

When implementing specific activities continuously, it is desirable to set indicators and measure performance. Confirming the trend of them enables to improve the activities. It is sometimes too expensive to exploit effective indicators. When irrelevant indicators from a goal or objective are used, performance of the activities becomes worse. Therefore, appropriate indicators must be identified.

According to the survey by Chesbrough, many companies are not satisfied with existing measures for open innovation (Current Status of Open Innovation). There are only three measures where they show a slight positive tendency (share of external innovation contributions for R&D projects, cost/benefit evaluation of innovation partners, and number of innovation partners).

In the case of outside-in activities, financial contributions derived from introduced technologies will be effective indicators. However, it takes a long time to obtain them after commercialization, so some kinds of indicators are needed to improve the activities up to that time.

Framework for Open Innovation Performance Measurement

Based on the survey results targeting large companies in 2012, Erkens developed innovation metrics for an open innovation performance measurement system.

The summary is as follows:
  • There is absolutely no clear guidance on how companies should approach innovation metrics in order to measure the success of their open innovation initiatives 
  • If companies have better innovation metrics, they could raise their return on innovation at no or small additional costs
  • Most of companies still use very generic innovation metrics that are primarily based on R&D or product development such as the number of patents filed in the past year or the number of ideas submitted by employees
  • By combining three key properties, a simple framework was developed to give a suite of KPIs:
    • Open innovation method
      • Each method needs specific indicators because their objective or targets are different
    • Type of measurement
      • The following types of measures should be tracked to evaluate a holistic performance 
        • Input KPI:
          The input elements within a project, such as human or financial resources
        • Process KPI:
          The process efficiency to transform inputs into outputs, such as time variances or budget variances
        • Output KPI:
          The results of the development activities within an innovation process, such as number of ideas or number of patents
        • Outcome KPI:
          The value of an innovation, such as economic returns
    • Type of utilization
      • Metrics can be utilized on three different levels
        • Instrumental use:
          Used directly for decision-making
        • Conceptual use:
          Used not directly to lead to a concrete action, but to provide general enlightenment and understanding
        • Symbolic use:
          Used after decisions to legitimize and justify them
  • The most relevant KPIs were identified from the perspective of innovation managers and performance measurement consultants
  • Innovation managers prefer conceptual or symbolic use because they tend to assume that open innovation projects are subject to significant uncertainty, and thus concrete targets and measures do not seem to be definable or detectable
  • Instrumental use seems to be more prominent at the very beginning and at the end of the performance measurement process, while conceptual and symbolic use dominate output measures
  • Since qualitative indicators such as the radicalism and novelty of ideas are hard to attract, simple financial indicators are preferred
  • Three scorecards were created by selecting the highest priority measures in the survey
  • A successful application of indicators depends on the degree of innovation, a company's ability and corporate culture
cf. Erkens M, Wosch S. Piller F, Luettgens D (2014) Measuring open innovation – A toolkit for successful innovation teams, Peformance, 6 (2), 12-23

It is interesting for the properties of open innovation KPIs to include type of utilization. It suggests that different indicators should be used to improve the activities of open innovation team and to educate or gain the understanding of internal stakeholders.

The open innovation scorecards represent the highest priority indicators selected by the survey respondents and can be used as a prototype when setting new indicators.

Performance Indicators for Open Innovation Portal Site

Carpenter provides performance indicators which can be used when collecting ideas in open innovation portal sites.

The summary is as follows:
  • The indicators are segmented by the different phases of innovation:
    • Sourcing:
      Trend in unique logins, trend in multiple logins, ratio of ideators to unique logins, average number comments per idea, average number of replies per comment, average number of votes per idea, unique organization units/departments/locations contributing
    • Decisioning:
      Ratio of ideas selected for further review, ratio of top 5 voted/commented ideas selected for further review, percentage of initially reviewed ideas sent back for iteration & information, time to complete decisions, ratio of reviewed ideas that advance to Acting phase
    • Acting:
      Average number of experiments per idea, time to make final decision on selected ideas, ratio of ideas selected for full launch, projected and realized value of ideas that have been moved to full launch
  • It is recommended to use an innovation management software platform when exploiting these indicators
cf. http://customerthink.com/16-metrics-for-tracking-collaborative-innovation-performance/

Although this article discusses only open innovation portal site, specific examples are helpful.

Several open innovation intermediaries provide the services which support to run open innovation portal site. When considering the use of them, available indicators as above might be a criteria to choose.

There are various kinds of portal sites in different fields, and effective indicators are presumed to be set in each of them. It means that tips and know-how might be learnt from not only open innovation intermediaries but also general IT vendors.

Designing Performance Indicators Suitable for Your Company

The current status and some examples of performance indicators have been shown already.  After all, you have no choice but to set various kinds of indicators and identify appropriate ones through trial and error. The following two should be considered separately:
  1. Performance indicators for overall activities
  2. Performance indicators for each method
The indicator 1 and 2 are used to raise the quality of the activities and to improve the implementation of each method, respectively.

Examples of the indicator 1 are the amount of resources devoted to innovation activities, recognition of innovation activities inside or outside the organization, satisfaction of collaboration partners, or financial value derived from innovation activities. By comparing the cases when open innovation activities are implemented or not, it is possible to determine whether to continue them.

The process to identify the indicator 2 is as follows:
  • Set tentative indicators
    • Borrow them from other fields
      It is useful to search the cases which uses the same method or have the same structure in other fields
    • Find them by yourself
      It is convenient to consider the method step-by-step
  • Use them for a while
  • Renew them regularly

Concluding Remarks

From the view point of open innovation team, it is better to have performance indicators. They can be used to improve open innovation activities and to persuade top management to appease the opponents.

Different indicators are needed for different applications. Therefore, each business unit in the same company must find appropriate one because their product development processes are often different.

There is no clear answer for what is the best indicators. In addition to that, since innovation activities need creativity, the wrong use of them might lose flexibility and decrease the performance of activities. Considering the above, they must be used with the greatest care.

Tom

If you have any opinion or question, please do not hesitate to contact the following address (thomas.openinnovation@gmail.com).
Unauthorized copying and replication prohibited.

0 件のコメント :

コメントを投稿