바로가기메뉴

본문 바로가기 주메뉴 바로가기

logo

Essential Competencies for Digital Workforce of Provincial Office in Thailand Using Delphi Technique

JOURNAL OF INFORMATION SCIENCE THEORY AND PRACTICE / JOURNAL OF INFORMATION SCIENCE THEORY AND PRACTICE, (P)2287-9099; (E)2287-4577
2023, v.11 no.4, pp.51-81
https://doi.org/10.1633/JISTaP.2023.11.4.4
Rujira Rikharom (Department of Information Science, Faculty of Humanities and Social Sciences, Khon Kaen University, Khon Kaen, Thailand)
Wirapong Chansanam (Department of Information Science, Faculty of Humanities and Social Sciences, Khon Kaen University, Khon Kaen, Thailand)

Abstract

This study aimed to study its required performance requirements and proposes a competency framework necessary for the digital workforce of the Provincial Offices in Thailand. The specific primary informants were determined as 17 people. The collecting process was performed using the Delphi technique and the electronic Delphi technique in two phases, totaling four rounds. In the first time, a structured interview was used to conduct online interviews for 15 people. Content validation was performed to determine issues of the competency framework essential for the digital workforce with 7-level scaled questionnaires, and then online reviews were collected between 10-15 people (2nd to 4th times). A consensus was found and confirmed four times with descriptive statistics, namely frequency, mean, standard deviation, mode, median, and the absolute value of the difference between mode and median, interquartile range, and application of the conceptual framework. The research findings revealed that the essential competency requirements for the digital workforce were covered in digital literacy (six aspects), digital skills (four aspects), and digital characteristics (four aspects). Consensus was confirmed for 84 issues. Therefore, it was concluded that 61 points for building an essential competency framework for the digital workforce made them effective in using digital technology as a labor-saving instrument, as well as for expanding the breadth of development of digital expertise to include members of the organization’s digital practitioner network. This development will benefit government agencies and the private sector, both national and international, in the future.

keywords
Delphi technique, essential digital competency, digital workforce, government organization, provincial office in Thailand

1. INTRODUCTION

The innovation system is a critical factor in the overall competitiveness of regional and national economies (Samara et al., 2023). Therefore, digital technology has become an issue of public policy according to policy information publication and geographic restriction (Setthasuravich & Kato, 2022), which is a basic factor leading to digital government in the future. For example, the Canadian government proposed to develop a framework and integrated format according to characteristics and agencies that were expected to create the communication, sharing, publication, and information access caused by using digital equipment and various resources for transportation and record keeping (Kupfer, 2022; Taher, 2015). The Singapore government outlined a plan to transform its economy, government, and society through a digital economy framework called the ‘Digital Government Blueprint,’ which set goals for success to achieve digital transformation of public services by 2023. For Thailand, the goal was to increase the potential of the digital workforce and to increase awareness and digital skills by driving programs that promote the creation of talent and professionals in digital technology and innovation, to enhance digital skills for the general public toward a dynamic digital economy based on a scholarly society, workforce, and digital innovation (Digital Economy Promotion Agency, 2018).

Therefore, the adoption of digital technologies and the replacement of non-digital processes with digital ones have led to organization-wide transformation and the emergence of new business models (Radziwon et al., 2022; Verhoef et al., 2021) or modifying existing ones, focusing on the technological aspect, such as optimizing operational processes within the organization (Dąbrowska et al., 2019; Vial, 2021). As a result, there has been an ever-increasing demand for digital competencies worldwide (New Zealand Digital Skills Forum, 2017). Siddoo et al. (2019) showed that the talent of a digital workforce in the digital age strongly influences the nature of digital technology jobs and the demand for a digital workforce. But there still remains a gap in the top five competency requirements: lifelong learning, personal attitude, teamwork, credibility, and digital fundamentals. Additionally, a review of 70 empirical papers between 2010 and 2022 identified essential characteristics of labor change: (1) the digital capabilities of a person, (2) digital culture, (3) digital workspace, (4) empowerment, participation, and motivation, (5) presenting and expressing a shared vision, and (6) transformational leadership and governance (Alrasheedi et al., 2022). To achieve workforce transformation, essential skills were also promoted, such as communication, openness, positive attitude, critical thinking, empathy, and potential training through face-to-face role play (Konstantinidis et al., 2022). The conclusion was that a diverse workforce of gender, age, color, and digital capabilities requires flexibility and balance between life, family, work, education, and digital society (Wong et al., 2020). Therefore, the model organization should respond to its work in the integrated environment of the workforce, which is necessary to receive skills and new potential from personnel, to balance the arrangement of different workplaces with the process of integrating the digital workplace in the digital age, especially those digital workforces in organizations that need to develop their digital capabilities. This was consistent with provincial and national strategic plans. According to the insights of Weritz (2022), it was found that responsible digital thinking, digital literacy, change skills, personal development skills, communication skills, community management skills, data analysis skills, and web development skills are critical in the digital workplace. This considers employees as the top priority for digital transformation, and highlights employee-level innovation in the workplace (Ahmed et al., 2022).

Under the provincial office in Thailand, there is a group called the Strategy and Information Technology Development Division, which employs computer technicians who are considered essential digital human resources. They are responsible for carrying out digital tasks related to the mission and responsibilities of information technology in order to drive organizational development in accordance with the country’s digital technology plans and policies (Office of the Council of State, 1991). Therefore, it is important to establish a digital infrastructure foundation to benefit from digital technology in maintaining digital security, supporting public culture with technology, and preparing a suitable working environment for collaborative technology use, including the safe use of data related to digital technology. They possess wisdom and responsibility for continuous learning (Smart Nation Singapore, 2018). The scope of digital capabilities includes data, communication, content creation, security, and problem-solving abilities (Ragnedda & Kreitem, 2018). This aims to create an efficient digital workforce that can integrate and utilize technology (Basilotta-Gómez-Pablos et al., 2022) to generate new jobs that develop alongside technological advancements (Pesch, 2021), leading to two research objectives: firstly, to define the necessary competencies and propose an essential competencies framework for digital personnel in the regional offices of Thailand and, secondly, for planning digital workforce development that aligns with management platforms and supports digital changes according to the digital economic and social development plan of Thailand from 2018-2037, enabling digital integration and keeping pace with continuous global digital transformations.

2. RELATED LITERATURE

2.1. Digital Workforce Concept

The concept of a digital workforce in this research was a human-centered approach that was part of skilled human capital and provides them with sustainable, suitable employment opportunities. As organizations transform into the digital workplace, it becomes a real challenge to manage the digital talent of employees (Cooke et al., 2022). The definition of the digital workforce is employee transition from traditional/semi-traditional production to fully automated systems (Cooke et al., 2022), which encounters outdated skills in some workforces. This meant that some of the roles and skills need to be recovered. It was estimated that 30% of the workforce is forced to do different jobs, low-skilled and high-skilled, and inevitably needs to change careers and occupations and their skill levels. The result has been the creation of millions of new jobs requiring new skills (World Economic Forum, 2020) based on the flexibility of qualifications and defined digital competency targets (Chaerunisa et al., 2022). Therefore, it is necessary to develop all-new abilities. The same applies to the digital workforce working in computer academic positions; according to the workforce structure and division of labor within the provincial government under the Ministry of Interior, Thailand, it is necessary to have roles, features, and capabilities in digital operations.

2.2. Knowledge and Skill of Digital Workforce of the Provincial Offices in Thailand

In this research, conceptual approaches related to digital workforce competency involve using and supporting basic information technology skills and using computers to retrieve, evaluate, store, produce, present, and exchange information (European Union, 2006). The role of digital literacy in the workplace was to transition towards a management style oriented around digital technology (Dery et al., 2017; Hanelt et al., 2021a), as well as pointing out that it is necessary to recognize and support an organization’s digital innovation efforts (Hanelt et al., 2021b; Kohli & Melville, 2019; Wrede et al., 2020). Moreover, digital competencies are required for general management or leadership in the digital age (Furr et al., 2012; Volberda et al., 2021). These fulfill the requirements appropriately and are flexible enough to adapt to different digital situations. Moreover, protection against rapidly obsolete structures is required (Bartolomé et al., 2022); for example, skills to transform digital literacy could be classified into five aspects: (1) data and information literacy, (2) communication and collaboration, (3) digital content creation, (4) security, and (5) problem-solving. This describes capabilities in general terms and is technologically neutral. A deep understanding of the technology capable of analyzing data and creating scenarios, simulations, and insights is also needed (Wu, 2022). Thereby, the knowledge dimension is the acquisition and retention of specific information, specific contexts, or rules for exchange. The skill dimension is communication or showing different behaviors of people. This results in successful discussions (Sue, 1998; Sue et al., 1992).

2.3. Characteristics and Functional Roles of Digital Workforce of the Provincial Offices in Thailand

General knowledge, mental ability, behavior and attitude, emotional management, personal relationships, and goals (Cunningham et al., 2022) are prerequisites for a digital workforce looking to manage learning and digital technologies. Therefore, stimulating the integration of that behavior is necessary. Furthermore, the hierarchical structure in the team division, in particular, is a contextual factor resulting from the influential role of senior management (Firk et al., 2022). Furthermore, interdependence, enhanced by networks, facilitates collaboration and innovation, manages complex social issues, augments governance, and collectively steers the development and implementation of policies (Gray & Purdy, 2018; Larsson, 2020). This transformation encompasses shifting towards more open, egalitarian interpersonal relationships while diminishing hierarchical structures. It primarily entails improvements in several key areas, namely: (1) work-life balance, (2) flexibility, (3) versatility, (4) alignment of values, and (5) the enhancement of work meaningfulness (Hofmann et al., 2019), all of these focusing on inspection, acceptance, utilization, and the significant advancement of digital technology (Beliaeva et al., 2020; Nambisan et al., 2018; Olsson & Bernhard, 2021; Srinivasan & Venkatraman, 2018). Therefore, achieving a balanced and accurate digital career path discovery should be prioritized, starting with strategic digital business model support, digitalizing the process of strategic digital platform support, and building a digital ecosystem (Bartolomé et al., 2022), as well as stimulating the inclusion of behaviors under specific traits of digital innovation with the behavioral integration of digital knowledge (Buyl et al., 2011; Georgakakis et al., 2017) and emphasis on skill level enhancing coordination roles (Firk et al., 2021; Kunisch et al., 2022; Singh et al., 2020). These objectives were linked to the need for success theory. This reflects a sense of accomplishment by striving to achieve one’s career goals (McClelland, 1961). Positive intercultural relationships, and values embedded in the environment, preferences, and awareness of importance, are the deepest part of the culture in that environment (Bukowski & Rudnicki, 2019; Gao et al., 2020; Okada et al., 2021). Individuals with aspirations for high achievement proactively engage in significant endeavors motivated by a deep-seated desire for success. They consistently pursue success, driven not only by goal orientation but also by a lasting aspiration for the psychological satisfaction that results from achieving desired outcomes (Furnham, 2021).

Therefore, the above information could be considered as concepts and principles of digital competency, which had many issues. The researcher asked the research questions, “What are the competency requirements required for the digital workforce of the Provincial Offices in Thailand?”, and “What should be the ideal competency framework for an effective digital workforce in these offices?” The summaries were synthesized to form a conceptual framework for the study, shown in Fig. 1.

 

새창으로 보기
Fig. 1

Conceptual framework for studying the competencies needed for digital workforce in Thailand.

jistap-11-4-51-f1.jpg

3. METHODOLOGY

The Delphi technique is a method of collecting and organizing the results of expert group opinions and decision-making regarding consensus answers. This involves gathering answers in a series of interviews and using systematic consensus checks on specific issues through the design of questionnaires to collect feedback and summarize opinions as a consensus in each successive round (Balasubramanian & Agarwal, 2012). Following the feedback-response process for decision-making (Novakowski & Wellar, 2008), this is a method for validating potential conclusions based on the highest possible level of expertise (Glass et al., 2022), covering diversity in the researcher’s focus group, regardless of the conversation, including reflections on individuality, identity, and sensitive contexts (Milani & Borba, 2022). The approach was receptive to creativity, innovation, and discovery, fostering a sense of responsibility (Jarzabkowski et al., 2021), and more practical application of new ideas, processes, and design procedures (Lê & Schmid, 2022). Personalization and linguistic diversity (Daft & Lengel, 1986), together with the integrated Delphi technique between the Delphi technique and Delphi electronics technique (von der Gracht, 2012), achieved flexibility and suitability in the current context. This allowed the researcher to uncover new insights from exploring specific social contexts by utilizing channel interviews to simultaneously send and receive verbal and non-verbal messages. Furthermore, the process could personalize and prevent multilingualism. A distinguishing feature of Delphi research was that a group of experts was free to provide answers but could not know the answers or details of the experts who were primary informants. This study was approved by the Human Research Ethics Committee, Khon Kaen University, number HE643217, certified on 24 November 2021.

The population studied in this research consists of individuals who work and are involved with the digital workforce in Thailand. Since the actual population size is unknown, a targeted selection method was used to select primary data sources. This includes individuals working or responsible for digital technology under provincial offices, experts working or responsible for digital technology in public and private sectors, those involved in the digital workforce, and experts from educational institutions who contribute to teaching and research in producing digital technology personnel. They represent the research study as representatives for the research objectives. The discrepancy was between 0.02-0.50 (Macmillan, 1971), totaling 17 people, divided into groups of organizational personnel (12 people, including six executives and six digital workforces), and a group of digital technology experts (5 people, including two digital workforce development experts and three digital workforce production experts). However, if the leading informant group needed help providing information, each region’s provinces would be selected instead according to the population. The three criteria for the exclusion of informants from the research were defined as follows: (1) they do not meet the qualifications specified in each group, (2) they fail to provide consent and complete cooperation in providing information by the completion of the data collection process, and (3) consent to participate and cooperate by providing information was incomplete; participants reserved the right to withdraw prior to the completion of the data collection process.

Conducting research using the Delphi technique was an efficient and fast data collection process, starting with brainstorming. This was followed by assessment and screening to ensure a unanimous consensus (Nayahangan et al., 2019), generated as an electronic survey with anonymous and confidential responses. This provided independent feedback and limited the risk of bias affecting the outcome (Karstensen et al., 2018; Nayahangan et al., 2018; 2019). An approach to concept and framework development (Rowe & Wright, 2011), especially in research on professional learning with an iterative process, avoids groups’ dynamic bias (Harteis, 2022). Data collection and knowledge had to be built on informed opinions, subjective expert judgments, and experiential interpretations (Winkler & Moser, 2016). Obtaining group opinions from individual primary informants (Landeta & Barrutia, 2011) allowed input from large and geographically dispersed cohorts. There were always multiple rounds to include around the generation of ideas. The first round needed to be more structured. This gave each primary informant an independent scope to identify and elaborate on issues they deemed necessary (Hartland-Rowe & Wright, 1975). In this research, work was divided into two phases according to the 2-step Delphi technique (Judd, 1971) as follows:

Step 1: The determination of the topics studied, leading to structural and operational policy formulation.

The first phase focused on the study of competency requirements for the digital workforce of the Provincial Offices in Thailand (1st time). The steps involved in Phases 1 and 2 are included in Fig. 2.

 

새창으로 보기
Fig. 2

Implementation of research data collection using Delphi techniques and Delphi electronic techniques.

jistap-11-4-51-f2.jpg

The research instrument was a structured interview with in-depth information about the questionnaire (Crabtree et al., 1993), generated from a synthetic review of secondary data. This was a set of two open-ended questions. It consisted of an interview form for corporate personnel and digital technology experts. The quality of the tools was examined by five experts knowledgeable in digital technology, competency, and social science research statistics, with rates of +1 (consistent), 0 (unsure), and -1 (inconsistent). The Index of Item Objective Congruence method was used to analyze the results. It was found that the consistency of the question items was between 0.80-1.00, indicating that both interview forms had content validity (Rovinelli & Hambleton, 1976).

The initial data collection was conducted by developing an interview form using Google Forms, a method employed to gather empirical data pertinent to qualitative and quantitative research (David et al., 2023). This approach enabled experts to freely provide information and respond to inquiries (von der Gracht, 2012). The form was disseminated via online channels, including Line, Facebook, and Email, to facilitate accessibility and participation. When the primary informant had to participate in the interview in person or via online platforms such as Line, Facebook, or Zoom, they chose individual interviews. Maintaining the anonymity of responses is a key aspect of the Delphi technique. Iterative surveys used diverse groups and solving differences to achieve the goal of maximum consensus (Gupta & Clarke, 1996; Guzys et al., 2015), with a total of 15 people, representing 88.23%, consisting of 10 corporate personnel (66.67%) and a group of five digital technology experts (33.33%). This was consistent with the observations of Creswell and Creswell (2017) that guidelines determine the appropriate sample size in qualitative studies. Depending on the research design and saturation, there could be 1-30 participants.

Data analysis uses the method of analyzing the content region, connection, and relationships (Steiner et al., 2007) by using short or long statements with latent content analysis on the fundamental aspects of the phenomenon under consideration (Boyatzis, 1998; Vears & Gillam, 2022) that were relevant to the question. The research was used to outline the competency required for the digital workforce of the Provincial Offices in Thailand through a closed-ended questionnaire. A 7-level assessment scale (Chan & Idris, 2017; Vagias, 2006) allowed for assessing different levels of importance, agreement, or even quality (Claveria, 2018) and appropriateness before being used to collect data in Phase 2.

Step 2: Collection, analysis, and reporting of study results (2nd, 3rd, and 4th, unanimous confirmation of concordance).

The second phase of the project proposed the necessary competency framework for the digital workforce of provincial offices in Thailand. Data collection was created as a closed-ended questionnaire in an online form using Google Forms delivered via online channels (same as Phase 1, Time 1) with the primary informants as follows: for Time 2, a total of 15 people (there was a synthesis of each issue); for Time 3, a total of 10 people (reviewing issues and adding feedback); and for the 4th time, 10 participants were able to confirm their consensus to determine the importance of each case and reach agreement in the end (Gupta & Clarke, 1996; Guzys et al., 2015).

Descriptive statistical methods were employed to analyze the data, facilitating an understanding of key metrics such as the maximum and minimum values and the overall data distribution (Sudarto et al., 2020). Initially, this involved calculating the frequency, mean (M), and standard deviation (SD). Subsequently, measures of distribution, including the quartile range, were examined. The interpretation of the calculated median was conducted by Best (1970)’s criterion. According to this criterion, a median value of 3.50 or higher was deemed necessary to indicate consistency in the data. Subsequently, the standard for interpreting the interquartile range was defined by the methodology proposed by Glass and Hopkins (1996). This involved calculating the difference between the first and third quartiles. A resultant value not exceeding 1.50 was indicative of consistency in the opinions of the expert group regarding each question in the report. Finally, the criteria for interpreting the mode results were established based on Flanders (1988)’ guideline, which stipulates that the absolute difference between the Mode and Median should not exceed 1. This criterion was adopted to ascertain the uniformity of opinions within the expert group.

For presenting the necessary competency framework for the digital workforce of provincial offices in Thailand with the application of the conceptual framework, the researcher visualized the understanding of concepts, sub-concepts, and relationships between concepts in a mind map (Kwon & Cifuentes, 2009). The relationship between concepts in the mind map consisted of open-ended ideas, connecting lines, phrases, and concept map structures linked. The researcher chose terms for ideas similar to the respondent’s knowledge to characterize overall coverage and associations between categories (Cañas et al., 2013; Ruiz-Primo, 2000; Ruiz-Primo et al., 2001; Watson et al., 2016). The researcher synthesized the results derived from consensus-building exercises to construct a competency framework essential for the digital workforce in Thailand’s Provincial Offices.

4. RESULTS

4.1. Competency Requirements Needed for the Digital Workforce of the Provincial Offices in Thailand

4.1.1. Summary of Competencies for Digital Labor in Thai Provincial Government Offices

This initial phase of data collection, utilizing the Delphi technique with a primary informant group, encompasses findings presented in Tables 1Table 2-3, detailing essential skills for digital tasks in provincial government settings in Thailand.

 

새창으로 보기
Table 1

Summary of competency requirements required for digital workforce digital knowledge dimension

Dimension Requirement
Digital literacy Knowledgeable, spacious, clean, modern, and timely digital innovation is designed and developed with the old technology to the new one with expertise for continuous use
1. Digital use Using computers, the Internet, management program presentation programs, computer security applications for daily career, and self-development
2. Digital understanding Thinking, searching, filtering, discriminating, analyzing, synthesizing, and using digital tools to create, modify, communicate, disseminate, share, monitor, and supervise digitally
3. Digital applied creativity Inventing, innovating, and processing together with digital technology concepts in the form of digital creation for managing and providing digital services
4. Digitally using problem-solving tools Use equipment, technology, knowledge, programs, processes, and formats to solve problems arising from digital operations and services
5. Digital transformation adapting Changing habits and behavior to improve, correct, develop, and reform operations, operations, and digital services
6. Digital organization management Selection and recruiting digital technology increases productivity and adds value to the work process and digital workforce management according to plans and projects

 

새창으로 보기
Table 2

Summary of essential competency requirements for digital workforce; digital skills

Dimension Requirement
Digital skill Specific skills were amalgamated with knowledge, predicated on the requisite digital technology, to foster a novel digital work ecosystem, thereby augmenting professional competency in alignment with the demands of digital labor
1. Digital technology Bringing modern scientific knowledge to apply digital work to achieve operational results and deliver digital services
2. Digital systematic calculation The results were systematically deduced through computational science, leveraging knowledge of digital technology. This involved the integration of complexity characteristics into a coherent sequence, guided by specific digital technical logic, for developing a system encompassing information and technology
3. Digital service innovation Finding ways to create new digital innovations and different digital work services, with principles, processes, steps and concepts, technical theories, and specific digital techniques to benefit the organization, colleagues, and service users
4. Digital programming Writing a list of commands, a set of instructions written in a computer language to work with information systems and digital programs according to established procedures

 

새창으로 보기
Table 3

Summary of essential competency requirements for digital workforce; digital characteristics

Dimension Requirement
Digital characteristics A digital work environment, as measured by roles and performance, is achieved accurately, reasonably, and transparently to all parties
1. Digital personal image Showing gestures and behaviors requiring communication about facilitation, service delivery, and digital performance to society
2. Digital function role The requisite status for conducting digital activities and operations must be underpinned by a conscientious awareness of responsibility and a commitment to ethical practice
3. Digital performance result Ability to perform tasks effectively following the organization’s digital objectives and goals
4. Digital ethical practice Acting and proceeding following guidelines for conduct based on moral principles rationally, distinguishing what is right and what should and should not be done, not selfishly encroaching on one another, and following the rules, conventions, laws, and regulations related to digital work

4.1.2. Delphi Study Findings on Essential Competencies for Digital Labor in Thailand

Identifying essential competencies for digital labor in Thailand was derived from the insights of a primary cohort of 15 data contributors, utilizing the Delphi technique in its second round and second iteration. The findings were as follows: 1) In digital literacy, scores ranged from high (5) to high (6). The highest score (6) was attributed to digital usage and adaptation to digital transformation, as indicated by 13 respondents. Following this, digital applied creativity was noted by 12 respondents. Nine respondents acknowledged using digital tools for problem-solving and digital organizational management, while eight respondents ranked digital understanding last. 2) For digital skill dimensions, the scores varied from moderate (4) to high (6). The highest score (6) in this category was for digital service innovation, as reported by 14 respondents. This was followed by digital technology and digital systematic calculation, noted by 12 and 6 respondents, respectively, with digital programming being the least mentioned by four respondents. 3) Regarding digital characteristics, the scores again ranged from high (5) to high (6). The top position, with a score of (6), was for the role of digital function, as identified by 12 respondents. There were three areas with equal scores: digital personal image, digital performance result, and digital ethical practice, each cited by ten respondents. These results are detailed in Table 4.

 

새창으로 보기
Table 4

Summary of the frequency of the competency requirements required for the digital workforce of the provincial offices in Thailand (n=15)

Dimension Number (issue) Frequency (n)
Not have (1) Little (2) Quite a bit (3) Moderate (4) Quite a lot (5) A lot (6) The most (7)
Digital literacy 56
1. Digital use 12 - - - - 2 13 -
2. Digital understanding 10 - - - - 7 8 -
3. Digital applied creativity 6 - - - - 2 12 1
4. Digitally using problem-solving tools 7 - - - - 5 9 1
5. Digital transformation adapting 9 - - - - 2 13 -
6. Digital organization management 12 - - - - 6 9 -
Digital skill 33
1. Digital technology 8 - - - - 3 12 -
2. Digital systematic calculation 9 - - - - 9 6 -
3. Digital service innovation 9 - - - - 1 14 -
4. Digital programming 7 - - - 3 8 4 -
Digital characteristics 50
1. Digital personal image 11 - - - - 5 10 -
2. Digital function role 10 - - - - 3 12 -
3. Digital performance result 15 - - - - 5 10 -
4. Digital ethical practice 14 - - - - 5 10 -
Total 139 - - - - - - -

4.1.3. Ranking and Analysis of Competency Dimensions for Digital Personnel in Thailand’s Provincial Offices

The computation of the mean and standard deviation for the competency requirements essential for digital personnel in Thailand’s provincial office sector was conducted based on the inputs from a primary group of 15 data contributors, employing the Delphi technique in its second round and iteration. The results indicated a high level of competency across all dimensions (M=5.62, SD=0.03). The dimensions were ranked in descending order of importance as follows: (1) The Digital Literacy dimension exhibited the highest mean (M=5.69, SD=0.09), with Digital Applied Creativity leading within this category (M=5.90, SD=0.40). (2) The Digital Characteristics dimension followed closely (M=5.68, SD=0.09), with the Digital Function Role being the most prominent aspect (M=5.79, SD=0.31). (3) Lastly, the Digital Skills dimension (M=5.49, SD=0.14) was identified, where Digital Service Innovation was ranked highest (M=5.73, SD=0.17). These findings are comprehensively detailed in Table 5.

 

새창으로 보기
Table 5

Mean and standard deviation of competency requirements required for digital workforce in Thailand (n=15)

Dimension Number (issue) M SD Meaning Rank
Digital literacy 56 5.69 0.09 A lot 1
1. Digital use 12 5.76 0.34 A lot 4
2. Digital understanding 10 5.43 0.30 A lot 6
3. Digital applied creativity 6 5.90 0.40 A lot 1
4. Digitally using problem-solving tools 7 5.80 0.51 A lot 2
5. Digital transformation adapting 9 5.78 0.27 A lot 3
6. Digital organization management 12 5.47 0.30 A lot 5
Digital skill 33 5.49 0.14 A lot 3
1. Digital technology 8 5.63 0.23 A lot 2
2. Digital systematic calculation 9 5.45 0.24 A lot 3
3. Digital service innovation 9 5.73 0.17 A lot 1
4. Digital programming 7 5.16 0.49 A lot 4
Digital characteristics 50 5.68 0.09 A lot 2
1. Digital personal image 11 5.64 0.42 A lot 3
2. Digital function role 10 5.79 0.31 A lot 1
3. Digital performance result 15 5.62 0.39 A lot 4
4. Digital ethical practice 14 5.68 0.52 A lot 2
Total/average total 139 5.62 0.03 A lot -
[i]

M, mean; SD, standard deviation.

4.2. Presenting the Necessary Competency Framework for the Digital Workforce of the Provincial Offices in Thailand

This discovery confirms a consensus on various issues within the framework of competencies necessary for digital personnel in the regional office sector of Thailand. The data were obtained from a questionnaire survey conducted with a main group of 10 data providers, using the Delphi technique, round 2, iteration 3, and were further confirmed as a consensus in round 4. It was found that there was a consensus level of consensus on all dimensions (3 dimensions), all aspects (14 aspects), and all issues (84 issues). The interquartile range (IQR) was not over 1.50, and the median (Mdn) was between 5.00-6.00, indicating the most consistent, and the absolute value of the difference between the mode and the median was between 0.00-0.50. When classifying as a digital knowledge dimension (6 aspects, 28 issues), it was found that the IQR was not more than 1.50, and the Mdn was between 5.50-6.00, indicating that it was the most consistent, and the absolute value of the difference between the mode and the median was between 0.00-0.50. The digital skills dimension (4 aspects, 20 issues) found that the IQR was not more than 1.50, and the Mdn was between 5.00-6.00, indicating that it was the most consistent, and the absolute value of the difference between the mode and the median was between -0.25-0.00. The digital feature dimension (4 dimensions, 36 issues) found that the IQR was not more than 1.50, and the Mdn was between 6.00-6.00, indicating that it was the most consistent, and the absolute value of the difference between the mode and the median was between 0.00-0.00, as shown in Table 6.

 

새창으로 보기
Table 6

Summary of the consensus of the essential competency framework required for the digital workforce of provincial offices in Thailand

Dimension Number
(issue)
Consensus
Mod. Mdn Mod.-Mdn Q3 Q1 IQR
Digital literacy 28 6.00 5.88 0.13 6.25 4.84 1.41
1. Digital use 5 6.00 5.50 0.50 6.25 5.00 1.25
2. Digital understanding 3 6.00 6.00 0.00 6.25 5.00 1.25
3. Digitally applied creativity 4 6.00 5.75 0.25 6.25 5.00 1.25
4. Digitally using problem-solving tools 3 6.00 5.50 0.50 6.25 4.75 1.50
5. Digital transformation adapting 5 6.00 6.00 0.00 6.13 4.88 1.25
6. Digital organization management 8 6.00 6.00 0.00 6.25 5.00 1.25
Digital skill 20 6.00 5.63 0.38 6.25 4.83 1.42
1. Digital technology 5 6.00 6.00 0.00 6.25 5.00 1.25
2. Digital systematic calculation 4 5.00 5.25 -0.25 6.00 4.81 1.19
3. Digital service innovation 5 5.00 5.00 0.00 6.25 4.88 1.38
4. Digital programming 6 6.00 6.00 0.00 6.25 5.00 1.25
Digital characteristics 36 6.00 6.00 0.00 6.25 4.81 1.44
1. Digital personal image 9 6.00 6.00 0.00 6.25 4.75 1.50
2. Digital function role 9 6.00 6.00 0.00 6.13 5.00 1.13
3. Digital performance result 9 6.00 6.00 0.00 6.25 5.00 1.25
4. Digital ethical practice 9 6.00 6.00 0.00 6.25 5.00 1.25
[i]

Mod., mode; Mdn, median; Q, quartile; IQR, interquartile range.

4.3. Results of the Proposed Framework for the Essential Digital Workforce for the Provincial Offices in Thailand

Results were derived from the analysis of the key points from the consensus confirmation of conformity (Table 6), consisting of the overall components, the total amount of 3 dimensions, 14 aspects, and 61 issues, as shown in Fig. 3.

 

새창으로 보기
Fig. 3

Essential competencies for the digital workforce for the Provincial Offices in Thailand.

jistap-11-4-51-f3.jpg

4.4. Additional Recommendations and Guidelines

4.4.1. Promoting Digital Work Management according to the Policy Plan

Suggestions of driving digital management according to the policies and operational plans of the Provincial Offices in Thailand in the future include: (1) increased or sufficient personnel support for digital workloads, (2) establishing a digital skills development framework for personnel, (3) promoting sufficient digital technical competency along with modern digital tools, and (4) raising awareness of adapting and paying attention to competency dimensions according to different contexts of personnel and organizations, as in the interview examples here:

...It is necessary to establish a framework for developing digital skills that will promote and support the use of digital technology in operations and the development of government work, and support the transformation of the public sector into a digital government…. (D001, interview, 18 March 2022)

...The 3D performance framework, regarding knowledge skills (abilities) and attributes, is still suitable for driving. The weights of the 14 sub-components may differ depending on the context of each organization... (C001, interview, 8 March 2022)

4.4.2. Guidelines for Promoting the Essential Competencies in the Future

As illustrated in Fig. 3, guidelines for driving the critical digital competencies of the workforce through the development of digital-specific technically assisted artificial intelligence for public sector organizations may include: (1) guidelines for establishing a framework for developing essential digital competencies that could promote and support the use of digital technology in work for all workforce levels equally, (2) guidelines for policy framework comprehensive digital implementation plans to support digital government transformation development platforms, (3) guidelines for driving the digital networking policy to develop the digital competencies needed to manage the digital workforce for the dynamic organization, and (4) guidelines for a systematic approach to developing essential competencies using the digital knowledge, skills, and feature dimensions for people development planning, technology, and digital management.

5. DISCUSSION

The results of the essential competency requirements for the digital workforce of the Provincial Offices in Thailand are as follows:

The findings provide a comprehensive overview of the competencies needed for digital literacy, emphasizing the necessity for clear, current, and timely knowledge. These competencies are crucial for responding innovatively to evolving technological demands and effectively understanding and managing complex digital data sets. This could be analyzed, adapted, and planned to be utilized dynamically and collaboratively in response to missions with expertise (Alaimo, 2022), which require finding the most appropriate model by taking advantage of skills and resources of organizations through data generated by data-driven digital technologies (Björkdahl, 2020) focused on auditing optimization. The Provincial Offices in Thailand have responded by approaching an organizational model that exploits coherence and interdependence (Cennamo et al., 2020). This is an opportunity to innovate change in structure, process, and management models that enable organizations to adapt quickly and continuously (Cennamo et al., 2020; Hanelt et al., 2020; Lanzolla et al., 2020). Schallmo and Lohse (2020), along with Verhoef et al. (2021), posit that the application of digital technologies in the analysis and collection of data encompasses the generation of actionable information for assessment, decision-making, and the development of innovative digital business models. This process aids organizations in creating value and enhancing performance, encapsulating the concept of “Organization+Technology+Information.” This concept is characterized by model innovation, value creation, and the emergence of new economic paradigms. Parallel to this, the professional development of librarians, as discussed by Ezeani et al. (2015), has facilitated their ability to design novel information resource formats for communities, thereby contributing to the advancement and stability of the librarianship career (Khan & Du, 2017; Sivankalai, 2021; Venturella & Breland, 2019). An example of this evolution is the creation of e-learning communities, where an operating system, leveraging online knowledge resources, functions as an e-learning server. This system allows users to engage with libraries via the Internet, as illustrated by Cooke (2012), thereby expanding the scope and accessibility of library services.

It is imperative to possess competencies in specific professional skills, which involve integrating knowledge acquired from digital transformation to transition into the new digital paradigm that is both in demand and congruent with digital work. The Intellectual Property Rights Allocation Regime and Geopolitical Strategy have emerged as critical conditions for utilizing technology and digital information (Brem & Nylund, 2021; Lee, 2018; Petricevic & Teece, 2019). Producing and portable accumulation of big data for worldwide policymakers requires better infrastructure, interfaces, and storage (Otto & Jarke, 2019), along with a robust infrastructure to enable governance to create more value and distribute more widely (Jones & Tonetti, 2020). While having more accessible access to many platforms as a member leads to more creativity, it might encourage opportunistic behavior (Karhu & Ritala, 2021). Consequently, pursuing creative digital organizational innovations is essential (Cennamo & Santaló, 2019). The study by Popoola and Adedokun (2023) revealed that collective intelligence skills markedly influence the utilization of electronic library resources. Furthermore, librarians’ attitudes towards technology underscore the importance of skills such as computational thinking in technology development, coding proficiency, and using technology as a tool tailored to local needs. Additionally, the necessity for technical language skills and the capability to bridge users with technology necessitates a comprehensive understanding of both domains (Cox, 2023).

As for the digital attributes dimension, there is a need for digital collaboration capabilities within the context of accuracy, fairness, and transparency in the digital ecosystem environment and within the digital workforce. The human involvement of behavioral needs, expectations, creativity in design, and the use of digital technology to solve problems and perform other tasks, might be at risk of being used as a customization tool according to the needs of the organization (Kellogg et al., 2020; Nørskov, 2022). Therefore, determining how to design digital technology that facilitates including a model of sustainable cultural use is an important management task. It has to be ensured that those technologies could enhance moral, social, and emotional skills to bring about valuable changes in practices and norms in the workplace (Ulhøi & Nørskov, 2021), while individual competencies depend on digitally promoting learning, engagement, and problem-solving (Belpaeme et al., 2018; Ford, 2015; Tennent et al., 2019; Traeger et al., 2020). Organizations must maintain equilibrium among structures, formats, and ecosystems shaped by design principles and processes stemming from digital technology. This balance is crucial to effectively harness the organization’s existing knowledge, capabilities, and potential (Lanzolla et al., 2020; Maijanen & Virta, 2017). Such an approach fosters an awareness of the varying priorities that exist at different levels: personal (emotional), organizational (strategic), and geographic (regulatory). This awareness acknowledges the distinctiveness and significance of each level in the broader organizational context (Aarikka-Stenroos et al., 2021; Nylund et al., 2021). At the same time, library and related fields are beginning to show interest and study the services, changes, and application of technology in the metaverse era (Njoku et al., 2023). The metaverse is a newly created space built on various technologies, such as virtual reality, cloud computing, blockchain, and 5G (Kesselman & Esquivel, 2022). To develop smart libraries and provide intelligent and convenient public services (Sanji et al., 2022), it is generally recognized that smart librarians are the driving force behind the development of libraries and are representatives of the main components of smart libraries (Duncan, 2021).

However, developing measurable benchmarks should be considered role norms seeking the link between participatory processes, trust, and firm performance (Roy, 2022). Dynamic analysis, guidelines, rules, and interactions are necessary as organizations increasingly rely on technology. Therefore, there is a need to balance productivity and human well-being (Nørskov & Nørskov, 2020). As one clear example, AI is an extension of personal abilities and a potential replacement for human cognition, including increasing the creativity of individuals and teams (Amabile, 2019; Wang & Siau, 2019). Therefore, it affects employees’ well-being and performance in digital work environments (Marsh et al., 2022). At the same time, the results confirm conformity as a unanimous consensus. This is an evaluation of data choices per the decision by a group of 10 primary informants who cooperated in identifying data according to reduced items. Consequently, the issues encapsulated within the essential competency framework for digital workforces were rendered more specific and lucidly delineated. This clarification aligns with the argument presented by Belton et al. (2021), who qualitatively examined data feedback issues. They raised concerns regarding whether pre-judgmental or selectively curated information poses an intellectual challenge, noting that the clarity of this challenge was previously ambiguous. The extent of this challenge depends on the interaction between many factors, including the amount of data (number and length of reasons and overall word count), complexity (variety of viewpoints, explanations, arguments, and types proposed), and the participants’ expertise. The researcher often had to read other primary informants’ responses and written rationale before reviewing them to make informed decisions with extreme accuracy (United Nations Educational, Scientific and Cultural Organization (UNESCO), 2019).

6. CONCLUSION

This research explored the essential competency framework for the digital workforce in Thailand’s Provincial Offices. Utilizing a Delphi study, a rigorous consensus confirmation process was employed to achieve consensus on key issues. This process facilitated the prioritization of appropriateness in digital literacy across six aspects, digital skills encompassing four aspects, and digital characteristics also spanning four aspects. Consensus was established for 84 issues, concluding that 61 points are critical for constructing an effective competency framework for the digital workforce, enhancing their efficiency in utilizing digital technology as a labor-saving tool. Consequently, the findings of this study can inform the development of more thoughtful and practical program strategies. Furthermore, the identified essential competency framework for the digital workforce in this research can be adapted for broader coverage and policy adjustments as needed. This adaptability extends to planning, decision-making, implementation, evaluation, and future research endeavors. However, the group of primary informants in this study was relatively small. Suppose there are future studies with larger sample sizes. In that case, the findings of the performance outcomes required for the digital workforce can be most prominently demonstrated in a volatile technology environment, quickly and continuously in the digital world, and to make research more in-depth and different. Furthermore, this will result in guidelines to promote, develop and train specific digital techniques. It is essential to focus on applying the necessary competency frameworks for digital manpower to improve the curriculum of relevant digital-related courses, including digital technology, computer science, information science, and library science. These are professional fields that require the continuous development of digital competencies to create valuable and sustainable potential.

The combination of a digital workforce and the Delphi technique can be highly beneficial to libraries and library professionals in several ways. The following is an overview of how these two elements can contribute to their effectiveness:

6.1. Digital Workforce in Libraries

Automation: Libraries can leverage digital technologies to automate repetitive and mundane tasks, such as cataloging, inventory management, and circulation processes. This allows library professionals to focus on more strategic and value-added activities.

Enhanced access: Digital platforms and online catalogs enable libraries to provide greater accessibility to their collections, resources, and services. Users can search, request, and access materials remotely, expanding the reach of the library beyond physical boundaries.

Personalization: Digital tools can enable libraries to personalize user experiences by offering recommendations based on users’ preferences and interests. This can enhance engagement and satisfaction among library patrons.

Data analysis: With a digital workforce, libraries can collect and analyze data on user behavior, resource utilization, and preferences. These insights can help librarians make informed decisions regarding collection development, resource allocation, and service improvements.

6.2. Delphi Technique for Decision Making

Expert consensus: The Delphi technique involves gathering input from a panel of experts through a structured and iterative process. Libraries can employ this technique to tap into the collective wisdom and knowledge of library professionals, researchers, and scholars for decision-making purposes.

Strategic planning: Libraries can use the Delphi technique to identify emerging trends, anticipate future challenges, and develop long-term strategic plans. The iterative nature of the technique allows for refining and validating ideas over multiple rounds, resulting in well-informed decisions.

Resource allocation: The Delphi technique can aid libraries in determining resource priorities and allocations. By engaging a diverse group of experts, libraries can assess the relative importance of different projects, initiatives, or services, leading to more efficient and effective use of available resources.

Policy development: Libraries often face complex issues and dilemmas requiring careful policy development. The Delphi technique facilitates structured discussions, helping library professionals reach consensus on policies and guidelines that align with user needs and organizational objectives.

Combining a digital workforce with the Delphi technique empowers libraries and library professionals to harness technology for automation, improved decision-making, enhanced user experiences, and optimized resource utilization. By leveraging these approaches, libraries can adapt to the evolving needs of their patrons and remain relevant in the digital age.

CONFLICTS OF INTEREST

No potential conflict of interest relevant to this article was reported.

REFERENCES

1 

Aarikka-Stenroos, L., Ritala, P., Thomas, L. D. W., Teerikangas, S., Onkila, T., Koistinen, K., & Mäkelä, M. (Eds.) (2021) Research handbook of sustainability agency Edward Elgar Publishing Circular economy ecosystems: A typology, definitions, and implications, pp. 260-276

2 

Ahmed, W., Hizam, S. M., & Sentosa, I. (2022) Digital dexterity: Employee as consumer approach towards organizational success Human Resource Development International, 25(5), 631-641 https://doi.org/10.1080/13678868.2020.1835107.

3 

Alaimo, C. (2022) From people to objects: The digital transformation of fields Organization Studies, 43(7), 1091-1114 https://doi.org/10.1177/01708406211030654.

4 

Alrasheedi, N. S., Sammon, D., & McCarthy, S. (2022) Understanding the characteristics of workforce transformation in a digital transformation context Journal of Decision Systems, 31(Suppl 1), 362-383 https://doi.org/10.1080/12460125.2022.2073636.

5 

Amabile, T. M. (2019) Creativity, artificial intelligence, and a world of surprises Academy of Management Discoveries, 6(3), 351-354 https://doi.org/10.5465/amd.2019.0075.

6 

Balasubramanian, R., & Agarwal, D. (2012) Delphi technique--A review International Journal of Public Health Dentistry, 3(2), 16-25 https://link.gale.com/apps/doc/A347003982/HRCA?u=anon~22121d60&sid=googleScholar&xid=f036ff67.

7 

Bartolomé, J., Garaizar, P., & Larrucea, X. (2022) A pragmatic approach for evaluating and accrediting digital competence of digital profiles: A case study of entrepreneurs and remote workers Technology, Knowledge and Learning, 27(3), 843-878 https://doi.org/10.1007/s10758-021-09516-3. Article Id (pmcid)

8 

Basilotta-Gómez-Pablos, V., Matarranz, M., Casado-Aranda, L. A., & Otto, A. (2022) Teachers' digital competencies in higher education: A systematic literature review International Journal of Educational Technology in Higher Education, 19, 8 https://doi.org/10.1186/s41239-021-00312-8.

9 

Beliaeva, T., Ferasso, M., Kraus, S., & Damke, E. J. (2020) Dynamics of digital entrepreneurship and the innovation ecosystem: A multilevel perspective International Journal of Entrepreneurial Behavior & Research, 26(2), 266-284 https://doi.org/10.1108/IJEBR-06-2019-0397.

10 

Belpaeme, T., Kennedy, J., Ramachandran, A., Scassellati, B., & Tanaka, F. (2018) Social robots for education: A review Science Robotics, 3(21), eaat5954 https://doi.org/10.1126/scirobotics.aat5954.

11 

Belton, I., Wright, G., Sissons, A., Bolger, F., Crawford, M. M., Hamlin, I., Lūka, C. T. B., & Vasilichi, A. (2021) Delphi with feedback of rationales: How large can a Delphi group be such that participants are not overloaded, de-motivated, or disengaged? Technological Forecasting and Social Change, 170, 120897 https://doi.org/10.1016/j.techfore.2021.120897.

12 

Best, J. W. (1970) Research in education (2nd ed) Prentice-Hall

13 

Björkdahl, J. (2020) Strategies for digitalization in manufacturing firms California Management Review, 62(4), 17-36 https://doi.org/10.1177/0008125620920349.

14 

Boyatzis, R. E. (1998) Transforming qualitative information: Thematic analysis and code development Sage

15 

Brem, A., & Nylund, P. A. (2021) Maneuvering the bumps in the New Silk Road: Open innovation, technological complexity, dominant design, and the international impact of Chinese innovation R&D Management, 51(3), 293-308 https://doi.org/10.1111/radm.12451.

16 

Bukowski, A., & Rudnicki, S. (2019) Not only individualism: The effects of long-term orientation and other cultural variables on national innovation success Cross-Cultural Research, 53(2), 119-162 https://doi.org/10.1177/1069397118785546.

17 

Buyl, T., Boone, C., Hendriks, W., & Matthyssens, P. (2011) Top management team functional diversity and firm performance: The moderating role of CEO characteristics Journal of Management Studies, 48(1), 151-177 https://doi.org/10.1111/j.1467-6486.2010.00932.x.

18 

Cañas, A. J., Bunch, L., Novak, J. D., & Reiska, P. (2013) Cmapanalysis: An extensible concept map analysis tool Journal for Educators, Teachers and Trainers, 4(1), 36-46 http://www.ugr.es/~jett/pdf/vol04(1)_03_jett_canas_bunch_novak_reiska.pdf.

19 

Cennamo, C., & Santaló, J. (2019) Generativity tension and value creation in platform ecosystems Organization Science, 30(3), 617-641 https://doi.org/10.1287/orsc.2018.1270.

20 

Cennamo, C., Dagnino, G. B., Di Minin, A., & Lanzolla, G. (2020) Managing digital transformation: Scope of transformation and modalities of value co-generation and delivery California Management Review, 62(4), 5-16 https://doi.org/10.1177/0008125620942136.

21 

Chaerunisa, F., Darmastuti, S., & Widiastutie, S. (2022) Foreign direct investment of Indonesian leading startup unicorn in Vietnam to enhance digital workforce skills International Journal of Multicultural and Multireligious Understanding, 9(7), 147-163 https://ijmmu.com/index.php/ijmmu/article/view/3784/3392.

22 

Chan, L. L., & Idris, N. (2017) Validity and reliability of the instrument using exploratory factor analysis and Cronbach'S alpha International Journal of Academic Research in Business and Social Sciences, 7(10), 400-410 https://doi.org/10.6007/IJARBSS/v7-i10/3387.

23 

Claveria, O. (2018) A new metric of consensus for Likert scales arXiv https://doi.org/10.48550/arXiv.1809.10493.

24 

Cooke, F. L., Dickmann, M., & Parry, E. (2022) Building sustainable societies through human-centred human resource management: Emerging issues and research opportunities International Journal of Human Resource Management, 33(1), 1-15 https://doi.org/10.1080/09585192.2021.2021732.

25 

Cooke, N. A. (2012) Professional development 2.0 for librarians: Developing an online personal learning network (PLN) Library Hi Tech News, 29(3), 1-9 https://doi.org/10.1108/07419051211241840.

26 

Cox, A. (2023) How artificial intelligence might change academic library work: Applying the competencies literature and the theory of the professions Journal of the Association for Information Science and Technology, 74(3), 367-380 https://doi.org/10.1002/asi.24635.

27 

Crabtree, B. F., Yanoshik, M. K., Miller, W. L., O'Connor, P. J., & Morgan, D. L. (Ed.) (1993) Successful focus groups: Advancing the state of the art Sage Selecting individual or group interviews, pp. 137-150

28 

Creswell, J. W., & Creswell, J. D. (2017) Research design: Qualitative, quantitative, and mixed methods approaches (5th ed) Sage

29 

Cunningham, W., Moroz, H. E., & Solatorio, A. V. (2022) The demand for digital and complementary skills in Southeast Asia World Bank Group

30 

Daft, R. L., & Lengel, R. H. (1986) Organizational information requirements, media richness and structural design Management Science, 32(5), 554-571 https://doi.org/10.1287/mnsc.32.5.554.

31 

David, S. A., Motala, S., Lawrence, A. S. A., & Albina, A. P. (2023) Exploring student's experiences on epistemic access for effective teaching and learning in higher education International Journal of Instruction, 16(1), 151-172 https://doi.org/10.29333/iji.2023.1619a.

32 

Dąbrowska, J., Lopez-Vega, H., & Ritala, P. (2019) Waking the sleeping beauty: Swarovski's open innovation journey R&D Management, 49(5), 775-788 https://doi.org/10.1111/radm.12374.

33 

Dery, K., Sebastian, I. M., & van der Meulen, N. (2017) The digital workplace is key to digital innovation MIS Quarterly Executive, 16(2), Article 4 https://aisel.aisnet.org/misqe/vol16/iss2/4.

34 

Digital Economy Promotion Agency (2018) [The digital economy promotion master plan (2018-2022)] Digital Economy Promotion Agency Thai

35 

Duncan, A. S. P. (2021) Opportunities for academic smart libraries in the Caribbean Library Hi Tech News, 38(5), 9-12 https://doi.org/10.1108/LHTN-06-2021-0035.

36 

European Union (2006) Recommendation of the European Parliament and of the Council of 18 December 2006 on transnational mobility within the community for education and training purposes: European Quality Charter for Mobility Official Journal of the European Union, L 394/5-L 394/9 https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32006H0961.

37 

Ezeani, C. N., Eke, H. N., & Ugwu, F. (2015) Professionalism in library and information science: An examination of current trends, needs, and opportunities in academic libraries in Southeast Nigeria Electronic Library, 33(1), 2-18 https://doi.org/10.1108/EL-10-2012-0134.

38 

Firk, S., Gehrke, Y., Hanelt, A., & Wolff, M. (2022) Top management team characteristics and digital innovation: Exploring digital knowledge and TMT interfaces Long Range Planning, 55(3), 102166 https://doi.org/10.1016/j.lrp.2021.102166.

39 

Firk, S., Hanelt, A., Oehmichen, J., & Wolff, M. (2021) Chief digital officers: An analysis of the presence of a centralized digital transformation role Journal of Management Studies, 58(7), 1800-1831 https://doi.org/10.1111/joms.12718.

40 

Flanders, F. (1988) (Doctoral dissertation) (Doctoral dissertation. Athens, GA, USA: University of Georgia.) Determining curriculum content for nursery/landscape course work in vocational agriculture for the 21st century: A futures study utilizing the Delphi technique

41 

Ford, M. (2015) Rise of the robots: Technology and the threat of a jobless future Basic Books

42 

Furnham, A. (2021) The bright and dark side of achievement motivation Current Psychology, 40(3), 1271-1279 https://doi.org/10.1007/s12144-018-0060-z.

43 

Furr, N. R., Cavarretta, F., & Garg, S. (2012) The role of domain knowledge and novel framing in making technology changes Strategic Entrepreneurship Journal, 6(3), 236-256 https://doi.org/10.1002/sej.1137.

44 

Gao, Q., Chen, P., Zhou, Z., & Jiang, J. (2020) The impact of school climate on trait creativity in primary school students: The mediating role of achievement motivation and proactive personality Asia Pacific Journal of Education, 40(3), 330-343 https://doi.org/10.1080/02188791.2019.1707644.

45 

Georgakakis, D., Greve, P., & Ruigrok, W. (2017) Top management team faultlines and firm performance: Examining the CEO-TMT interface Leadership Quarterly, 28(6), 741-758 https://doi.org/10.1016/j.leaqua.2017.03.004.

46 

Glass, G. V., & Hopkins, K. D. (1996) Statistical methods in education and psychology (3rd ed) Allyn and Bacon

47 

Glass, J., McMorran, R., Currie, M., McKee, A., Pinker, A., Reed, M., Meador, E., & Markantoni, M. (2022) Translating community resilience theory into practice: A deliberative Delphi approach Sociologia Ruralis, 62(4), 675-698 https://doi.org/10.1111/soru.12397.

48 

Gray, B., & Purdy, J. (2018) Collaborating for our future: Multistakeholder partnerships for solving complex problems Oxford University Press

49 

Gupta, U. G., & Clarke, R. E. (1996) Theory and applications of the Delphi technique: A bibliography (1975-1994) Technological Forecasting and Social Change, 53(2), 185-211 https://doi.org/10.1016/S0040-1625(96)00094-7.

50 

Guzys, D., Dickson-Swift, V., Kenny, A., & Threlkeld, G. (2015) Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique International Journal of Qualitative Studies on Health and Well-Being, 10, 26291 https://doi.org/10.3402/qhw.v10.26291. Article Id (pmcid)

51 

Hanelt, A., Bohnsack, R., Marz, D., & Antunes Marante, C. (2021a) A systematic review of the literature on digital transformation: Insights and implications for strategy and organizational change Journal of Management Studies, 58(5), 1159-1197 https://doi.org/10.1111/joms.12639.

52 

Hanelt, A., Firk, S., Hildebrandt, B., & Kolbe, L. M. (2021b) Digital M&A, digital innovation, and firm performance: An empirical investigation European Journal of Information Systems, 30(1), 3-26 https://doi.org/10.1080/0960085X.2020.1747365.

53 

Hanelt, A., Nischak, F., Markus, N., Hodapp, D., Schneider, S., Rowe, R., Amrani, R. El, Limayem, M., Newell, S., Pouloudi, N., Heck, van, & Quammah, A. El (Eds.) (2020, June 15-17) Proceedings of the 28th European Conference on Information Systems (ECIS) ECIS Building platform ecosystems for IoT - Exploring the impact on industrial-age firms, 1-17

54 

Harteis, C., Goller, M., Kyndt, E., Paloniemi, S., & Damşa, C. (Eds.) (2022) Methods for researching professional learning and development: Challenges, applications and empirical illustrations Springer Delphi-technique as a method for research on professional learning, pp. 351-371

55 

Hartland-Rowe, R., & Wright, P. B. (1975) SIL Proceedings, 1922-2010 (Vol. 19) Effects of sewage effluent on a swampland stream, 2, pp. 1575-1583, https://doi.org/10.1080/03680770.1974.11896222

56 

Hofmann, P., Keller, R., & Urbach, N. (2019) Inter-technology relationship networks: Arranging technologies through text mining Technological Forecasting and Social Change, 143, 202-213 https://doi.org/10.1016/j.techfore.2019.02.009.

57 

Jarzabkowski, P., Langley, A., & Nigam, A. (2021) Navigating the tensions of quality in qualitative research Strategic Organization, 19(1), 70-80 https://doi.org/10.1177/1476127020985094.

58 

Jones, C. I., & Tonetti, C. (2020) Nonrivalry and the economics of data American Economic Review, 110(9), 2819-58 https://doi.org/10.1257/aer.20191330.

59 

Judd, R. C. (1971) Delphi application for decision making Planning and Changing, 2(3), 156 .

60 

Karhu, K., & Ritala, P. (2021) Slicing the cake without baking it: Opportunistic platform entry strategies in digital markets Long Range Planning, 54(5), 101988 https://doi.org/10.1016/j.lrp.2020.101988.

61 

Karstensen, J. G., Ebigbo, A., Aabakken, L., Dinis-Ribeiro, M., Gralnek, I., Le Moine, O., Vilmann, P., Ijoma, U., Anigbo, G., Afihene, M., Duduyemi, B., Ponchon, T., & Hassan, C. (2018) Nonvariceal upper gastrointestinal hemorrhage: European Society of Gastrointestinal Endoscopy (ESGE) Cascade Guideline Endoscopy International Open, 6(10), E1256-E1263 https://doi.org/10.1055/a-0677-2084. Article Id (pmcid)

62 

Kellogg, K. C., Valentine, M. A., & Christin, A. (2020) Algorithms at work: The new contested terrain of control Academy of Management Annals, 14(1), 366-410 https://journals.aom.org/doi/abs/10.5465/annals.2018.0174.

63 

Kesselman, M. A., & Esquivel, W. (2022) Technology on the move. Consumer electronics show 2022: The evolving metaverse and much more Library Hi Tech News, 39(5), 1-4 https://doi.org/10.1108/LHTN-03-2022-0038.

64 

Khan, A., & Du, J. T. (2017) Professional development through social media applications: A study of female librarians in Pakistan Information and Learning Sciences, 118(7/8), 342-353 https://doi.org/10.1108/ILS-04-2017-0028.

65 

Kohli, R., & Melville, N. P. (2019) Digital innovation: A review and synthesis Information Systems Journal, 29(1), 200-223 https://doi.org/10.1111/isj.12193.

66 

Konstantinidis, S., Leonardini, L., Stura, C., Richter, P., Tessari, P., Winters, M., Balagna, O., Farrina, R., van Berlo, A., Schlieter, H., Mayora, O., Wharrad, H., Auer, M. E., Hortsch, H., Michler, O., & Köhler, T. (Eds.) (2022) Mobility for smart cities and regional development - Challenges for higher education Springer Digital soft skills of healthcare workforce - Identification, prioritization and digital training, pp. 1118-1129

67 

Kunisch, S., Menz, M., & Langan, R. (2022) Chief digital officers: An exploratory analysis of their emergence, nature, and determinants Long Range Planning, 55(2), 101999 https://doi.org/10.1016/j.lrp.2020.101999.

68 

Kupfer, M. (2022) How federal return-to-workplace plans differ by department: Major union wants some areas of consistency https://www.cbc.ca/news/canada/ottawa/ottawa-federal-public-service-return-to-work-1.6402653

69 

Kwon, S. Y., & Cifuentes, L. (2009) The comparative effect of individually-constructed vs. collaboratively-constructed computer-based concept maps Computers & Education, 52(2), 365-375 https://doi.org/10.1016/j.compedu.2008.09.012.

70 

Landeta, J., & Barrutia, J. (2011) People consultation to construct the future: A Delphi application International Journal of Forecasting, 27(1), 134-151 https://doi.org/10.1016/j.ijforecast.2010.04.001.

71 

Lanzolla, G., Lorenz, A., Miron-Spektor, E., Schilling, M., Solinas, G., & Tucci, C. L. (2020) Digital transformation: What is new if anything? Emerging patterns and management research Academy of Management Discoveries, 6(3), 341-350 https://doi.org/10.5465/amd.2020.0144.

72 

Larsson, O. L. (2020) The governmentality of network governance: Collaboration as a new facet of the liberal art of governing Constellations, 27(1), 111-126 https://doi.org/10.1111/1467-8675.12447.

73 

Lee, K. F. (2018) AI superpowers: China, Silicon Valley, and the new world order Houghton Mifflin Harcourt

74 

Lê, J. K., & Schmid, T. (2022) The practice of innovating research methods Organizational Research Methods, 25(2), 308-336 https://doi.org/10.1177/1094428120935498.

75 

Macmillan, T. T. (1971) The Delphi technique Paper presented at the Annual Meeting of the California Junior Colleges Associations Committee on Research and Development, Monterey, CA, USA

76 

Maijanen, P., & Virta, S. (2017) Managing exploration and exploitation in a media organisation - A capability-based approach to ambidexterity Journal of Media Business Studies, 14(2), 146-165 https://doi.org/10.1080/16522354.2017.1290025.

77 

Marsh, E., Vallejos, E. P., & Spence, A. (2022) The digital workplace and its dark side: An integrative review Computers in Human Behavior, 128, 107118 https://doi.org/10.1016/j.chb.2021.107118.

78 

McClelland, D. C. (1961) Achieving society Simon and Schuster Article Id (pmcid)

79 

Milani, T. M., Borba, R., & Flick, U. (Ed.) (2022) The SAGE handbook of qualitative research design (Vols. Vol. 1) Queer(ing) methodologies Queer(ing) methodologies, pp. 194-209

80 

Nambisan, S., Siegel, D., & Kenney, M. (2018) On open innovation, platforms, and entrepreneurship Strategic Entrepreneurship Journal, 12(3), 354-368 https://doi.org/10.1002/sej.1300.

81 

Nayahangan, L. J., Stefanidis, D., Kern, D. E., & Konge, L. (2018) How to identify and prioritize procedures suitable for simulation-based training: Experiences from general needs assessments using a modified Delphi method and a needs assessment formula Medical Teacher, 40(7), 676-683 https://doi.org/10.1080/0142159X.2018.1472756.

82 

Nayahangan, L. J., Van Herzeele, I., Konge, L., Koncar, I., Cieri, E., Mansilha, A., Debus, S., & Eiberg, J. P. (2019) Achieving consensus to define curricular content for simulation based education in vascular surgery: A Europe wide needs assessment initiative European Journal of Vascular and Endovascular, 58(2), 284-291 https://doi.org/10.1016/j.ejvs.2019.03.022.

83 

New Zealand Digital Skills Forum (2017) Digital skills: For a digital nation New Zealand Technology Industry

84 

Njoku, J. N., Nwakanma, C. I., Amaizu, G. C., & Kim, D. S. (2023) Prospects and challenges of Metaverse application in data-driven intelligent transportation systems IET Intelligent Transport Systems, 17(1), 1-21 https://doi.org/10.1049/itr2.12252.

85 

Novakowski, N., & Wellar, B. (2008) Using the Delphi technique in normative planning research: Methodological design considerations Environment and Planning A: Economy and Space, 40(6), 1485-1500 https://doi.org/10.1068/a39267.

86 

Nørskov, M. (2022) Robotification & ethical cleansing AI & Society, 37(2), 425-441 https://doi.org/10.1007/s00146-021-01203-2.

87 

Nørskov, M., & Nørskov, S. (2020) Social robots and recognition Philosophy & Technology, 33(1), 5-8 https://doi.org/10.1007/s13347-019-00353-y.

88 

Nylund, P. A., Brem, A., & Agarwal, N. (2021) Innovation ecosystems for meeting sustainable development goals: The evolving roles of multinational enterprises Journal of Cleaner Production, 281, 125329 https://doi.org/10.1016/j.jclepro.2020.125329.

89 

Office of the Council of State (1991) State Administration Act, B.E. 2534 Office of the Council of State

90 

Okada, A., Ohara, Y., Yamamoto, Y., Nomura, Y., Hosoya, N., Hanada, N., & Takei, N. (2021) Impact of working environment on job satisfaction: Findings from a survey of Japanese dental hygienists International Journal of Environmental Research and Public Health, 18(6), 3200 https://doi.org/10.3390/ijerph18063200. Article Id (pmcid)

91 

Olsson, A. K., & Bernhard, I. (2021) Keeping up the pace of digitalization in small businesses-Women entrepreneurs' knowledge and use of social media International Journal of Entrepreneurial Behavior & Research, 27(2), 378-396 https://doi.org/10.1108/IJEBR-10-2019-0615.

92 

Otto, B., & Jarke, M. (2019) Designing a multi-sided data platform: Findings from the International Data Spaces case Electronic Markets, 29(4), 561-580 https://doi.org/10.1007/s12525-019-00362-x.

93 

Pesch, U. (2021) Institutions of justice and intuitions of fairness: Contesting goods, rules and inequalities Critical Review of International Social and Political Philosophy https://doi.org/10.1080/13698230.2021.1913887.

94 

Petricevic, O., & Teece, D. J. (2019) The structural reshaping of globalization: Implications for strategic sectors, profiting from innovation, and the multinational enterprise Journal of International Business Studies, 50(9), 1487-1512 https://doi.org/10.1057/s41267-019-00269-x.

95 

Popoola, S. O., & Adedokun, O. O. (2023) Computer self-efficacy, computer anxiety, cognitive skills, and use of electronic library resources by social science undergraduates in a tertiary university in Nigeria Journal of Librarianship and Information Science, 55(1), 111-122 https://doi.org/10.1177/09610006211063938.

96 

Radziwon, A., Bogers, M. L. A. M., Chesbrough, H., & Minssen, T. (2022) Ecosystem effectuation: Creating new value through open innovation during a pandemic R&D Management, 52(2), 376-390 https://doi.org/10.1111/radm.12512.

97 

Ragnedda, M., & Kreitem, H. (2018) The three levels of digital divide in East EU countries World of Media: Journal of Russian Media and Journalism Studies, 4, 5-26 https://doi.org/10.30547/worldofmedia.4.2018.1.

98 

Rovinelli, R. J., & Hambleton, R. K. (1976) On the use of content specialists in the assessment of criterion-referenced test item validity Paper presented at the 60th Annual Meeting of the American Educational Research Association, San Francisco, CA, USA

99 

Rowe, G., & Wright, G. (2011) The Delphi technique: Past, present, and future prospects - Introduction to the special issue Technological Forecasting and Social Change, 78(9), 1487-1490 https://doi.org/10.1016/j.techfore.2011.09.002.

100 

Roy, J. (2022) COVID-19, digitization and hybrid workspaces: A critical inflection point for public sector governance and workforce development Canadian Public Administration, 65(3), 569-575 https://doi.org/10.1111/capa.12475. Article Id (pmcid)

101 

Ruiz-Primo, M. A. (2000) On the use of concept maps as an assessment tool in science: What we have learned so far REDIE Revista Electrónica de Investigación Educativa, 2(1), 29-53 http://www.redalyc.org/articulo.oa?id=15502103.

102 

Ruiz-Primo, M. A., Schultz, S. E., Li, M., & Shavelson, R. J. (2001) Comparison of the reliability and validity of scores from two concept-mapping techniques Journal of Research in Science Teaching, 38(2), 260-278 https://doi.org/10.1002/1098-2736(200102)38:2<260::AID-TEA1005>3.0.CO;2-F.

103 

Samara, E., Andronikidis, A., Komninos, N., Bakouros, Y., & Katsoras, E. (2023) The role of digital technologies for regional development: A system dynamics analysis Journal of the Knowledge Economy, 14(3), 2215-2237 https://doi.org/10.1007/s13132-022-00951-w.

104 

Sanji, M., Behzadi, H., & Gomroki, G. (2022) Chatbot: An intelligent tool for libraries Library Hi Tech News, 39(3), 17-20 https://doi.org/10.1108/LHTN-01-2021-0002.

105 

Schallmo, D. R. A., Lohse, J., Schallmo, D. R. A., & Lohse, J. (Eds.) (2020) Digitalstrategien erfolgreich entwickeln: Grundlagen, ansätze und vorgehensweise Springer Gabler Generische digitalstrategien, pp. 113-117

106 

Setthasuravich, P., & Kato, H. (2022) Does the digital divide matter for short-term transportation policy outcomes? A spatial econometric analysis of Thailand Telematics and Informatics, 72, 101858 https://doi.org/10.1016/j.tele.2022.101858.

107 

Siddoo, V., Sawattawee, J., Janchai, W., & Thinnukool, O. (2019) An exploratory study of digital workforce competency in Thailand Heliyon, 5(5), E01723 https://doi.org/10.1016/j.heliyon.2019.e01723. Article Id (pmcid)

108 

Singh, A., Klarner, P., & Hess, T. (2020) How do chief digital officers pursue digital transformation activities? The role of organization design parameters Long Range Planning, 53(3), 101890 https://doi.org/10.1016/j.lrp.2019.07.001.

109 

Sivankalai, S. (2021) Academic libraries support e-learning and lifelong learning: A case study Library Philosophy and Practice, 6154 https://digitalcommons.unl.edu/libphilprac/6154/.

110 

Smart Nation Singapore (2018) Digital government blueprint: A Singapore government that is digital to the core, and serves with heart Smart Nation Digital Government Office

111 

Srinivasan, A., & Venkatraman, N. (2018) Entrepreneurship in digital platforms: A network-centric view Strategic Entrepreneurship Journal, 12(1), 54-71 https://doi.org/10.1002/sej.1272.

112 

Steiner, C. M., Albert, D., Heller, J., & Buzzetto-More, N. A. (Ed.) (2007) Advanced principles of effective e-learning Informing Science Press Concept mapping as a means to build e-learning, pp. 59-111

113 

Sudarto, F., Mulyati, M., Harahap, E. P., & Nurul, F. A. (2020) Design of property sales information system PT. Quality Property Indonesia APTISI Transactions on Management, 4(2), 149-156 https://doi.org/10.33050/atm.v4i2.1272.

114 

Sue, D. W., Arredondo, P., & McDavis, R. J. (1992) Multicultural counseling competencies and standards: A call to the profession Journal of Counseling & Development, 70(4), 477-486 https://doi.org/10.1002/j.1556-6676.1992.tb01642.x.

115 

Sue, S. (1998) In search of cultural competence in psychotherapy and counseling American Psychologist, 53(4), 440-448 https://doi.org/10.1037/0003-066X.53.4.440.

116 

Taher, M. (2015) ICT (information and communications technology - Or technologies) definition https://www.linkedin.com/pulse/ict-information-communications-technology-definition-mohamed-taher

117 

Tennent, H., Shen, S., Jung, M., & Park, H. W. (Ed.) (2019, March 11-14) Proceedings of the 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) IEEE Micbot: A peripheral robotic object to shape conversational dynamics and team performance, 133-142,

118 

Traeger, M. L., Strohkorb Sebo, S., Jung, M., Scassellati, B., & Christakis, N. A. (2020) Vulnerable robots positively shape human conversational dynamics in a human-robot team Proceedings of the National Academy of Sciences, 117(12), 6370-6375 https://doi.org/10.1073/pnas.1910402117. Article Id (pmcid)

119 

Ulhøi, J. P., Nørskov, S., & Misra, K. B. (Ed.) (2021) Handbook of advanced performability engineering Springer Extending the conceptualization of performability with cultural sustainability: The case of social robotics, pp. 89-104

120 

United Nations Educational, Scientific and Cultural Organization (UNESCO) (2019) Recommendations on assessment tools for monitoring digital literacy within UNESCO's digital literacy global framework UNESCO

121 

Vagias, W. M. (2006) Likert-type scale response anchors Clemson International Institute for Tourism & Research Development, Department of Parks, Recreation and Tourism Management, Clemson University

122 

Vears, D. F., & Gillam, L. (2022) Inductive content analysis: A guide for beginning qualitative researchers Focus on Health Professional Education: A Multi-Professional Journal, 23(1), 111-127 https://doi.org/10.11157/fohpe.v23i1.544.

123 

Venturella, K., & Breland, M. V. (2019) Supporting the best: Professional development in academic libraries Journal of New Librarianship, 4(1), 283-292 https://doi.org/10.21173/newlibs/6/22.

124 

Verhoef, P. C., Broekhuizen, T., Bart, Y., Bhattacharya, A., Dong, J. Q., Fabian, N., & Haenlein, M. (2021) Digital transformation: A multidisciplinary reflection and research agenda Journal of Business Research, 122, 889-901 https://doi.org/10.1016/j.jbusres.2019.09.022.

125 

Vial, G., Hinterhuber, A., Vescovi, T., & Checchinato, R. (Eds.) (2021) Managing digital transformation: Understanding the strategic process Routledge Understanding digital transformation: A review and a research agenda, pp. 13-66

126 

Volberda, H. W., Khanagha, S., Baden-Fuller, C., Mihalache, O. R., & Birkinshaw, J. (2021) Strategizing in a digital world: Overcoming cognitive barriers, reconfiguring routines and introducing new organizational forms Long Range Planning, 54(5), 102110 https://doi.org/10.1016/j.lrp.2021.102110.

127 

von der Gracht, H. A. (2012) Consensus measurement in Delphi studies: Review and implications for future quality assurance Technological Forecasting and Social Change, 79(8), 1525-1536 https://doi.org/10.1016/j.techfore.2012. .

128 

Wang, W., & Siau, K. (2019) Artificial intelligence, machine learning, automation, robotics, future of work and future of humanity: A review and research agenda Journal of Database Management, 30(1), 61-79 http://doi.org/10.4018/JDM.2019010104.

129 

Watson, M. K., Pelkey, J., Noyes, C., & Rodgers, M. (2016) Assessing impacts of a learning-cycle-based module on students' conceptual sustainability knowledge using concept maps and surveys Journal of Cleaner Production, 133, 544-556 https://doi.org/10.1016/j.jclepro.2016.04.063.

130 

Weritz, P. (2022) Hey leaders, it's time to train the workforce: Critical skills in the digital workplace Administrative Sciences, 12(3), 94 https://doi.org/10.3390/admsci12030094.

131 

Winkler, J., & Moser, R. (2016) Biases in future-oriented Delphi studies: A cognitive perspective Technological Forecasting and Social Change, 105, 63-76 https://doi.org/10.1016/j.techfore.2016.01.021.

132 

Wong, S. D., Broader, J. C., & Shaheen, S. A. (2020) Can sharing economy platforms increase social equity for vulnerable populations in disaster response and relief? A case study of the 2017 and 2018 California wildfires Transportation Research Interdisciplinary Perspectives, 5, 100131 https://doi.org/10.1016/j.trip.2020.100131.

133 

World Economic Forum (2020) Resetting the future of work agenda: Disruption and renewal in a post-COVID world World Economic Forum

134 

Wrede, M., Velamuri, V. K., & Dauth, T. (2020) Top managers in the digital age: Exploring the role and practices of top managers in firms' digital transformation Managerial and Decision Economics, 41(8), 1549-1567 https://doi.org/10.1002/mde.3202.

135 

Wu, T. (2022) Digital project management: Rapid changes define new working environments Journal of Business Strategy, 43(5), 323-331 https://doi.org/10.1108/JBS-03-2021-0047.


Submission Date
2023-03-13
Revised Date
2023-05-20
Accepted Date
2023-06-28

JOURNAL OF INFORMATION SCIENCE THEORY AND PRACTICE