Evaluation Profile

一、Evaluation goals

(一)Corporate knowledge management evaluation can objectively measure the current knowledge management level of corporations

(二)Self-evaluations and on-site evaluations are used to measure four major aspects (cultural transformation, procedural operation, information technology, and knowledge management effects), and five levels of knowledge management maturity. Through this fair and objective evaluation mechanism, corporations can easily understand the current application status and clarify key points around knowledge management in order to promote the effects of diffusion

二、Knowledge management maturity evaluation structures and mechanisms

(一)Management aspect: The survey can be divided into three management aspects (procedural operation, cultural transformation, and information technology). New survey items are divided into four management aspects (procedural operation, cultural transformation, information technology, and knowledge management effects)

　 　 　 　 　 　 　 　

Cultural transformation	Operational procedures	Information technology	Knowledge management
This aspect explores the knowledge management of the corporation itself and its awareness, attitude, consensus, and belief. The goal is cultural exhibition, through which we explore the interior of organizations, and improvement operations through relationship interactions, including sharing, personal/organizational learning, organizational innovation, training, and development/	This aspect explores organizations through diverse events (for example, policies, methods, regulations, and systems), promotes the current methods of knowledge management, and through introducing the application management of tools and organization of knowledge, comprehensive procedural operations can be planned in order to help in the execution of strategies.	This aspect explores the assistance application of information technology in knowledge management. Basic software and hardware facilities are used. We include corporate knowledge in the information and knowledge databases, and fully use management tools and application technology, and comprehensive office automation. Finally, network communication is used in order to reach the goals of information obtainment, storage, exchange, and analyses.	This aspect explores organizations through knowledge culture, procedures, and technology implementation. Through the integration of overall organizational environments and daily transactions, organizational knowledge can be improved and positive feedback can be received from all circles

(二)Management events: Survey items can be defined as 68 knowledge mangement events. New surveys are divided into 4 industry and corporation types as follows:

　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　

	Large service industrie	Medium and small service indurstries	Large manufacturing	Medium and small manufacturing
Cultural items	3	3	3	3
Technological items	6	5	6	5
Procedural items	19	19	20	20
Effect items	11	11	11	11

(三)Key areas: The survey items can be divided into 16 key fields. The new version of survey items have 9 key areas (Key Areas; KAs)

1.One KA is a set of related knowledge management events. When they are executed together, they can satisfy the same goal

2.The effect of one KA can indirectly influence a set of related knowledge management events. Each KA is formed of 3-8 knowledge management events. Large manufacturing industries are used as an example below:

　 　 　 　 　 　 　 　 　 　 　

	Knowledge management strategies	Knowledge management promotion	Knowledge sharing	Information and knowledge obtainment	Knowledge storage	Knowledge intelligent use	Knowledge creation and innovation	Knowledge protection	Knowledge learning
Total items	5	6	6	8	2	3	4	1	5

　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　

9 key areas	Contents
Knowledge management strategies	Organizations can fully connect methods with knowledge resources and strategic needs
Knowledge management promotion	Upgrade and promote the units, regulations, and mechanisms executed by knowledge management
Knowledge sharing	Interactions between people (for example, discussions, debates, and collective problem solutions). Through these events, one unit (for example: teams, departments) will be influenced by recessive and dominant knowledge
Information and knowledge obtainment	Through actual or virtual channels, organizations obtain diverse internal and external information and knowledge
Knowledge storage	Storing the observed results, cause, effects, and other matters during work execution and decision making events
Knowledge and intelligence use	Using statistics or artificial intelligence concepts or tools, collection, or analytical information, and apply analytical results in operating management policies, problem solving, and improvement of products or procedures
creation and innovation	Creation is a procedure of continuously striving for excellence, overthrowing old thinking into a new field, obtaining new networks, with new thinking and knowledge toward the world. Innovation refers to “a consensus of new thinking, new procedures, new products or services”. Alternatively it refers to related units adopting new thinking, practices, or matters
Knowledge protection	Protects recessive and dominant knowledge, to avoid key principles being changed, abused, and discarded
Knowledge learning	Learning is using better knowledge and understanding to make further improvements The results of training upgrades students’ learning abilities (for example, obtainment of knowledge and techniques), and provides the foundations for maintaining knowledge and techniques

(四)Maturity level of knowledge management (Contents of five major levels)

　 　 　 　 　 　 　 　 　 　 　 　 　

Level 1-5	Maturity level of knowledge management
Level 1 Period of Knowledge Confustion	At this level, organizational knowledge is scattered in all the departments or between organizational members. Organizations do not have official knowledge management procedural operations. At this level, organizational members can have rich knowledge, but do not know how to obtain organizational benefits through structural methods used at work
Level 2 Period of Knowledge Awareness	At this level, organizations can see the importance of knowledge management in organizational practice, and have higher motives of personal knowledge definition, sharing, obtainment, and storage. However, organizations have not conducted overall planning of knowledge management events. Only units or those sitting at the core of departments promote knowledge management projects
Level 3 Period of Knowledge Management	At this level, organizations formally promote knowledge management. This helps organizations to more widely transform and apply knowledge management, and thereby they can gradually obtain the organizational benefits of knowledge management
Level 4 Period of Advanced Knowledge Management	At this level, knowledge management is oriented toward the planning and management methods of strategic guidance. Managers grasp the key points of knowledge management, and realize the organizational benefits of knowledge management
Level 5 Period of Knowledge Integration	At this level, organizations have the capabilities to integrate internal products/services/operational procedures/management principles, and all aspects of recessive knowledge/dominant knowledge, current knowledge, and corporate related innovative knowledge

(五)Definitions of maturity level of knowledge management and the three major aspects

　 　 　 　 　 　 　 　 　 　 　 　 　 　

KM maturity level/ Three major aspects	Cultural transformation	Operational procedures	Information technology
Level 1 Period of Knowledge Confustion	Organizational members know the concepts of knowledge management	Organizational members use their methods to define, share, obtain, and store knowledge	Organizations have computerized environments, and organizational members have basic information technology abilities
Level 2 Period of Knowledge Awareness	Organizational members know the importance of promoting knowledge management	Organizational members have higher frequencies of defining, sharing, obtaining, and storing knowledge	Organizations have technological environments that nurture knowledge management
Level 3 Period of Knowledge Management	Organizations of cultures of knowledge management	Organizations use official management of regulations and systems to define, share, obtain, and store knowledge	Organizations have technological environments in order to support recessive and dominant knowledge management
Level 4 Period of Advanced Knowledge Management	Organizations have reinforced a culture of knowledge management in order to stabilize the execution of knowledge management	Organizations can use qualitative and quantitative methods to evaluate the achievements of knowledge management	Organizations have integrated technological environments to support long term knowledge management
Level 5 Period of Knowledge Integration	Organizations continue to promote knowledge cultures with internal and external partners in order to conduct sustainable knowledge management	Organizations can integrate diverse knowledge internally and externally and establish network environments	Organizations have technological environments to support internal and external organizationalknowledge integration

(六)Weightings for cultural, technological, procedural, and overall level items under the new guidelines (for example, large manufacturing industry)

　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　

		Culture	Technology	Procedure	Total
Knowledgeable culture
Items 1~3		0.3			0.3
Knowledge management SOP or regulations system
Items 1~20				0.25	0.25
Knowledge management technological system
Items 1~6			0.25		0.25
Knowledge management achievements
Company employees understand how to promote and execute knowledge management		0.2		0.2	0.2
Company’s knowledge management events are integrated into the employees’ daily operational procedures		0.2	0.2	0.2	0.2
Company can obtain overall knowledge management to improve customer service, products, or benefits of partnership, and receive high feedback from multiple stakeholder groups					0.2
Company’s professional knowledge level is very high, other companies cannot emulate in such a short period of time					0.2
Company knows important core SOPs possess which types of knowledge				0.2	0.2
Company has many knowledge sharing events		0.2			0.2
Company employees know from where to obtain required information or knowledge			0.2	0.2	0.2
Company unions use internal organizational related knowledge to complete tasks		0.2		0.2	0.2
Company unions use internal organizational related knowledge to complete tasks		0.2		0.2	0.2
Company’s knowledge documents are helpful for employees to complete tasks or knowledge techniques				0.2	0.2
Company has innovative thinking or methods regarding all kinds of products, services, or work procedures		0.2			0.2

　 　 　 　 　

	Culture	Technology	Procedures	Total
Total items	9	8	27	40

(七)Survey questionnaires

The original survey questionnaires can be divided into three types:

　 　 　 　 　 　 　 　 　 　

Item No.	Item contents	Item evaluation chart
Item 1.1	Organizations have corporate prospects and missions	1.1.1. No corporate prospects and missions, and no executions □ (If you check this column, please skip items 1,2)
		1.1.2. Whether there are corporate prospects and missions □No If yes (Please fill in the completeness of corporate prospects and missions) □Very incomplete, □incomplete, □neutral, □complete, □very complete
		1.1.3. Whether there are corporate prospects and missions □Not executed yet Yes, if executed (Please fill in the execution status), □very bad, □bad, □neutral, □good, □very good
Type 1.4	Organizational prospects, missions, and knowledge management strategies are connected	1.4.1 No organizational prospects and missions, or not connections □ (If you check this column, please skip items 1,2)
		1.4.2. There is connection, please fill in the completeness, □very incomplete, □incomplete, □neutral, □complete, □very complete
Type 2.3	Organizational members have the basic concepts of how to promote and execute knowledge management	2.3.1. Organizational managers and employees do not grasp basic concepts of how to promote and execute knowledge management □ (If you check this column, please skip items 2,4)
		2.3.2. Organizational managers □0%□0~20% □20~40% □40~60% □60~80% □80% grasp basic concepts of how to promote and execute knowledge management
		2.3.3. Organizational employees □0%□0~20% □20~40% □40~60% □60~80% □80% grasp basic concepts of how to promote and execute knowledge management

The new surveys directly adopt the Likert Scale

　 　 　 　 　 　 　 　 　 　 　 　 　 　 　

	Strongly disagree	Agree	Neutral	Agree	Disagree
Knowledgeable culture
There is a knowledge sharing culture between employees with correct concepts and attitudes (for example, mutual trust, respect of intellectual property rights)	□	□	□	□	□
There is a knowledge creation and innovation atmosphere and culture between employees	□	□	□	□	□
There is a knowledge or technique learning atmosphere and culture	□	□	□	□	□

(七)Range of scores for new cultural, technological, procedural, overall, and all maturity levels (for example, large manufacturing industries)

　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　

	Level one	Level two	Level three	Level four	Level five
Culture	0~6	7~13	14~20	21~27	28~35
Technology	0~6	7~13	14~20	21~27	28~32
Procedures	0~23	24~46	47~70	71~84	85~115
Total	0~35	36~72	73~110	111~138	139~171

(八)Characteristics of the new version

1.Survey aspects:

(1)Divided into 4 types of surveys according to manufacturing or service industry; and large, medium, or small corporation

(2)Each survey item is more simplified than the previous versions. There were originally 68 knowledge management events. The new version of survey is carried out according to relevant industry, and the survey items have been reduced and tailored for content.

(3)The contents of surveys have added the “Knowledge management effects” aspect and items

2.Information display methods

(1)Originally there were 16 key areas, and these have now been reduced to 9 key areas

(2)“Knowledge management effects” are calculated through the prism of “Culture,” “Procedures,” and “Technology;” and scores are divided into the levels of “Culture,” “Procedures,” “Technology,” and “Overall”