E-Learning Success Model: An Extention of DeLone & McLean IS' Success Model

ABSTRACT


INTRODUCTION
At this time, distance learning is constantly increased.According to the article at [1] the growth rate of e-learning in Indonesia occupies the 8 th position with the growth of 25% and 60% of the learning method by using e-learning, the learning time will be more effective and efficient.Tendency of the university to develop e-learning as one of the alternative learning is increasing.The infrastructure development, and the ease of internet access is no longer and obstacle to conduct teaching and learning process.Before university implement e-learning, the level of readiness of e-learning is required.According to [2], UPN "Veteran Jakarta has an average value of readiness using e-learning is 3.297 (not ready needs some works).The variables that have been declared that is ready are human resource and content variable.While the variables that are not ready are technology, organization, and financial.Some of the factors that must be prepared for the university is ready to implement e-learning such as technology (network, hardware and software), human resource (self and competence skill), organization (leadership and policy), and financial (fund allocation and financial policy).
The success of an e-learning system is determined by how far the e-learning system use and have impacts to the users.Various studies that have been conducted to evaluate the success of e-learning system, especially adapting from the information system success model that have been developed by DeLone and McLean [3], [4] as done by [5] and [6].These studies found that satisfaction and use of e-learning had an impact on student performance in learning.Unfortunately, the research on the success of e-learning systems is rarely done in Indonesian context.
This research was conducted to build an integrated model of e-learning success in Indonesia.The model that proposed in this study was built by adapting the success model of information systems from DeLone& McLean which proved in many studies is an appropriate model for assessing the success of information systems in various contexts.To conform the e-learning context, DeLone& McLean model is adapted using variables Technical System Quality (TES), Educational System Quality (ESQ), Service Quality (SQ), Content & Information Quality (CIQ), use, user perceived satisfaction (UPS) and individual impact.
To test the model, this research is done by taking data at UPN Veteran Jakarta which has implemented e-learning system in recent years.Through this research, it is hoped that the success model of elearning system will be more suitable to the Indonesian context.

DELONE & MCLEAN IS SUCCESS MODEL
In 1992, DeLone& McLean made the IS Success Model consisting of six factors that measuring the success of information systems that affect to each other.The model consists of six factors or variables that is system quality, information quality, satisfaction, use, individual impact, and organization impact.The measurement of the success variables of information systems can not be measured independently but must be as a whole.Variables that one will affect the other variables.Based on Figure 1, the quality of the system, and the quality of the information affect the user to use information systems and user satisfaction while using information systems.Variables of use and satisfaction of the use information systems will affect each other and will have an impact on the individual so as to improve the individual performance.Increased individual performance will have a good impact on the organization.
The quality of information systems is influenced by data accuracy, easy to use, convenience factor, user realization, system features and functionality, accurate, flexible, efficient, reliable, and sophisticated systems, system integration, has good response time and turnaround time.The quality of information can be measured by relevance, usefulness, informative, easy to understand, consistent, comprehensiveness, novelty of information, and not double meaning [3].  2. There is one additional variable that is quality of service that will affect users to use information systems and user satisfaction when using information systems.Quality of service can be measured through (assurance, empathy, and responsiveness).

283
The individual impact and organization impact merge into one called net benefits.Net benefits are the benefits felt by the individual and will have an impact on the organization after using the information system.Information system user satisfaction will affect the interest to use information system and the use of information system will give satisfaction to the user.Net benefits will affect the interest to use and user satisfaction with the information system.Net benefits can be measured through cost savings, expanded markets, incremental additional, sales, reduced search costs, and time savings.

CONSEPTUAL MODEL
The research model has four e-learning quality constructs that play an important role as a direct determinant between use and user perceived satisfaction like, Technical System Quality (TES), Educational System Quality (ESQ), Service Quality (SQ), and Content & Information Quality (CIQ) as can be seen in Figure 3. Technical System Quality (TES) measuring the quality of e-learning system techniques that related to system navigation, ease to finding information, structured, fast accessing, having security, flexibility, ease to integration with other systems, reliability which is high, has an interactive and structured design.Educational System Quality (ESQ) measuring the quality of educational system related to communication facilities, attendance, collaborative, and active learning, evaluation of learning, outcomes, communication facilities, storage and sharing documents, effective and efficient sharing of information.Serving Quality (SQ) measuring the quality of e-learning system services related to help desk support in the provision of assistance services and the speed of responding to complaints against problems that occur, available documents and other information in e-learning.Content & Information (CIQ) measuring the quality of information and content from e-learning information system regarding usability, ease of understanding, reliability, timeliness, accuracy and organized.
While Use (U) describes the use of e-learning system for information retrieval, publication information, storage and sharing documents, communicate with colleagues and to support the lectures.User Perceived Satisfaction (UPS) describes user satisfaction preceptions of e-learning system related to e-learning system to support the field of study, effective and efficient and overall satisfied using e-learning system.Individual Impact (IM) shows the impact of e-learning on its users, either helping users to facilitate, complete tasks faster, improve productivity, and be able to work more effectively and efficiently.

Relationship between e-Learning System Quality and Use
Research conducted by [6], found a positive relationship between information quality and use elearning system.The quality of information has significant impact on the use of e-learning for example the cource content.Good content criteria are easy to come by, useful, easy to understand, interesting, and reliable.If system has content and easy to navigate and well structured functionality, it will increase system usage.Through the translation, the authors suspect that there is a positive relationship between the quality of e-learning system with the use of e-learning system formulated in the following hypothesis: H1: The quality of technical system affects the use of e-learning systems.H2: The quality of education system affects the use of e-learning systems.H3: Service quality affects the use of e-learning system.H4: The quality of information and content affects the use of e-learning systems

Relationship between e-Learning System Quality and User Perceived Satisfaction
According to [5] the quality of system techniques and the quality of the education system as well as the quality of information and content and affect to user satisfaction.There is a positive relationship between the quality of the engineering system, the quality of information & content, and the quality of the education system with user satisfaction.Service quality is requirement of an e-learning system for efficient services, as measured by responsiveness, empathy, trust, and security [4] [7].Quality of service is essential for satisfaction and use [8][9] [10], and in the context of e-learning service quality positively impacts the use of e-learning and user satisfaction.The quality of the e-learning system includes the user's function, utility, navigation, and accessibility [6].Through the translation, the authors suspect there is a positive relationship between the quality of e-learning system with the perception of user satisfaction e-learning system formulated in the following hypothesis: H5: The quality of the technical system affects the perceptions of user satisfaction of e-learning information systems.H6: The quality of the education system affects the perceptions of user satisfaction of e-learning information systems.H7: Service quality affects the perception of user satisfaction of e-learning information system.H8: The quality of information and content affects the perception of user satisfaction of e-learning information systems.

Relationship between Use, User Perceived Satisfaction and Individual Impact
Many studies have used the Delone & Mclean IS Success model in 1992 and expressed greater user satisfaction, the greater to individual impact [2] [7] [11].The study of e-learning success reports that user satisfaction has a significant impact on values and positive impact on individual performance [12] [13].User satisfaction is one measure of the successful use of an e-learning system to help their tasks, for example, retrieve and publish information and communicate with other [14].The usefulness perception of the system used encourages the level of user satisfaction with the system.Through the translation, the authors suspect there is a positive relationship between the perception of user satisfaction with the use of e-learning system.And individual impacts are positively influenced by the use and perception of user satisfaction formulated in the following hypotheses: H9: Perceptions of user satisfaction of e-learning information system affect the use of e-learning system.H10: The intensity of the use of e-learning information systems will have an impact on individual users.H11: Perceptions of user satisfaction e-learning information system will impact on individual users.

RESEARCH METHOD
Stages of research conducted on this research that is determination of research models and research hypotheses, the formation of questionnaires, testing the results of the questionnaire include validity test, realibility test model and hypotheses as can be seen in table 1

Instrument Variable Research
The instrument used in this study is questionnaires using the likert scale 1 to 5. Likert usage asks respondents to see a series of statements and express opinions.Details scale from scale 1 (strongly disagree), scale 2 (disagree), scale 3 (neutral), scale 4 (agree), and scale 5 (strongly agree).SQ1: help desk is responsible for providing service and help whenever needed.[6] SQ2: help desk gives attention or solution when have a problems with e-learning.[6] SQ3: help desk provides services related to the elearning system at specified time [17] SQ4: have knowledge to answer questions related to e-learning system.[6] SQ5: Available documents can be downloaded, related courses, and other information [5] Content and Information Quality Dimension: measurement of content & information quality of e-learning system related to usability, ease of under-standing, reliability, time-linesss, accuracy and organized information and content.
CIQ1: the content and information available in the elearning system is very useful.[5] CIQ2: the content and information available in the elearning system is easy to understand.CIQ3: the content and information available in the elearning system can be relied upon.CIQ4: the content and information available in the elearning system is timely CIQ5: the content and information available in the elearning system is accurate.CIQ6: the content and information available in the elearning system is organized CIQ1: the content and information available in the elearning system is very useful.

Technical System Quality
Measurement of technical system quality elearning related to system navigation, ease of finding information, structured and easy to use.Fast access to e-learning system, has security, flexibility, ease of integration with other systems, high reliability, interactive and structured design.
TSQ1 : e-learning system navigation is easy to use [5] TSQ2 : e-learning system allows me to easily find information [5] TSQ3: e-learning system is well structured.
[5] TSQ4: e-learning system is easy to use.
[5] TSQ5 : e-learning system has good interactivity [5] TSQ6 : e-learning system can be accessed quickly [5] TSQ7 : e-elarning system has good security [17] TSQ8 : e-learning system has reliability [17] TSQ9 : e-learning system has a structured design [17] TSQ10: e-learning system maintenance always maintained well.[5] TSQ11 : e-learning system has a high degree of flexibility [17] TSQ12: e-learning system has to ease of integration with other systems [5] Educational System Quality Educational system measurement is related to communication facilities, attendance, collaborative, and active learning.The elearning system has an evalution of learning outcomes.E-learning information system provides easy and convenient communication facilities, document storage and sharing, contacts and effective and efficient sharing of information with co-workers.
ESQ1: e-learning system has facility to communicate with other students and conduct class discussions such as chat, forums, and more.[17] ESQ2: e-learning system has attendance facilities to ensure student attendance in classroom.[17] ESQ3: e-learning system provides collaborative and active learning.[17] ESQ4: e-learning system has an evaluation of learning and evaluation of outcomes.[17] ESQ5: e-learning system allows easy and convenient communication with co-workers [17] ESQ6: e-learning system supports effective and efficient sharing of information with co-workers.[6] ESQ7: e-learning system allows convenient storage and sharing of documents with co-workers [17] ESQ8: e-learning system allows me to easily and quickly locate my contact information. [6]

Use
Use of e-learning system for information retrieval, publication of information, storage and sharing of documents, communicate with colleagues and to support lectures.USE1: the extent to which you use e-learning system to retrieve information.
[6] USE2: the extent to which you use e-learning system for information publication.USE3: the extent to which you use e-learning system to communicate with co-workers USE4: the extent to which you use e-learning system to store and share documents.USE5: the extent to which you use e-learning system for course.

User Perceived Satisfaction
Use perceived satisfaction of e-learning system related to e-learning system to support all field of study, effective and efficient and overall satisfied using e-learning system.
UPS1: e-learning system to support your studies.
[6] UPS2: how efficient e-learning system.UPS3: how effective e-learning system.UPS4: overall satisfied using e-learning information system.Individual Impact e-Learning system is very useful, helping users to simplify and complete tasks faster.Elearning system increase productivity and is able to work more effectively and efficiently.
II1: e-learning system allows me to complete tasks faster.[6] II2: e-learning system increases my productivity II3: e-learning system make it easy to complete tasks II4: e-learning system is useful or my work.
The variables in e-learning system quality are technical system quality, content & information quality, system quality, educational system quality, and service quality.The indicator on the service quality variable is an indicator used in the research [4]- [6], [17], the factors that support the success of the implementation of the Information system and e-learning system at the university.Variable user perceived satisfaction is significantly influenced by technical system quality, content & information quality, and educational system quality.Technical indicators of quality system, content & information quality, and educational system quality based on research conducted by [5] about e-learning success model in university.Indicators in use variables, user perceived satisfaction and individual impacts are adapted from research [6] adopted from research [4] on e-learning satisfaction and information systems success theory.

Data Collection
After creating the research instrument and, performing the legibility test.The next process is to collect data.The authors collected data from the respondents through the process of filling out a questionnaire of research conducted online.An online questionnaire is distributed through a questionnaire facility available in e-learning.The results obtained from this stage is the collection of data to be used for the analysis material in the next step.

RESULT AND ANALYSIS
After collecting the data, the authors perform processing and analysis on the data that has been collected.In the processing, the authors use statistics with multivariate techniques Structural Equation Modeling (SEM).In that technique, the author uses SmartPLS program to process the data.This data analysis phase aims to know the interrelationship between variables in the proposed model.At this stage, the authors also try to answer the question in this research.

Demographic of Respondents
The method used in this research is survey.Respondents who participated 157 e-learning users.The respondents' demographic overview is presented in Table 2

Result
Data processing in this research use Smart PLS 2.0 tools.The first step that needs to be done is to make the path diagram, adapted to the design of the model and the hypothesis that has been formulated previously.This research has 7 latent variables and 44 manifest variables.In addition, there are 11 hypotheses that connect one latent variable with other latent variables.The result of the path diagram created by the author on SmartPLS can be seen in Figure 4.The standardized loading factor for measuring constructs or variables that can not be directly measured actually serves as a good indicator in measuring the construct is 0.7.Based on table 4 Unqualified indicators, drop and re-calculate.However, some variables have a value of cronbach's alpha <0.7.so it needs to do data processing again.If outer loading and outer weight are insignificant, there is no empirical support to maintain that indicator must be eliminated from the model.To make a better approach in multidimensional procedures, the researcher should lower the lowest loading factor once at a time, and repeat this process until it meets the requirements to achieve more than 0.60 [15].Therefore, the researcher uses the loading factor value> 0.60 as the loading factor value to determine the indicator's validity in measuring the construct.all variables with cronbach's alpha and composite reliability are> 0.70.The test results state that the model can meet the reliability test.So some indicators need to be removed include U3, TSQ11 and TSQ12.
While the structural model evaluation is done through two stages that is to see the value of R-square (R2) from endogenous latent variable and to see t-statistic value by using bootstrap method.The structural model is evaluated by using R-square for the dependent construct and t-Test to determine the actual coefficients of the structural path parameters.The result of R-square research in Table 5 gives an Individual Impact (IM) value 0.550664, user perceived satisfaction (UPS) value 0.408999 and use value 0.531445 then R-Square value moderate effects on endogenous latent variables.
To determine whether or not acceptance of a hypothesis can be determined by looking at the significance level of the path coefficient, t-value is generated by running the Bootstrapping algorithm.According to [10], a latent variable has a significant influence on other latent variables if it has a t-value of 1.65 with a significance value of 10%, the value of t-value of 1.96 has a significance of 5%, and the value of t-value of 2.58 has a significance of 1%.The value of path coefficient that is in the range of values of -0.1 to 0.1 is considered insignificant.The results of hypothesis testing in this study can be seen in Table 5 which shows there are 6 accepted hypothesis and 5 others rejected.The following regression equations in this study are made in accordance with the above model: Through regression equation it can be seen that user perceived satisfaction is influenced by technical system quality and educational system quality.Use variable is influenced by content & information quality, and user perceived satisfaction.Use variable proved most influenced by user perceived satisfaction with a value of 0.49.Finally, e-learning will affect individual users affected by the use variable with a value of 0.33 and user perceived satisfaction with a value of 0.46.[6]to see the perceived impact of users.In this study, empirical use variable proved to have the highest influence of 52.3% and user perceived satisfaction of 33.4% impact on users.The study also found that perceived satisfaction is a major factor driving the use of e-learning systems.This study found that service quality and content & information quality did not prove to be a factor encouraging users to want to use e-learning and user perceived satisfaction.After analyzing data using SEM method, the final model of this research is as follows.

Discussion
6 out of 11 hypothesized relationships were verified.Use is explained by content and information quality.User perceived satisfaction has a significant influence with technical system quality and educational system quality.Based on the above data processing results, the model describes user perceived satisfaction of 39.8%, the use of e-learning system of 52.3%.Use gives an individual impact of 55%.The e-learning system is very useful because it helps users to simplify and complete tasks faster and increase effectiveness and efficiency and productivity.
Educational system quality and technical system quality are statistically significant affecting user perceived satisfaction so that H6, H5 is accepted.The effect of the quality of the education system on the perception of the user satisfaction is lower compared to the quality of systems engineering.This indicated the facilities provided e-learning such as forum, chat, class discussions, has a security, flexibility, ease of integration with other systems and high reliability in the e-learning system can result in user satisfaction.This research confirms MELSS Model, technical system quality and educational system quality influence indirect use through user perceived satisfaction.
Content & information quality and user perceived satisfaction statistically significant will affect users to use e-learning so that H4 and H9 are accepted.Based on the results of data processing, the perception of user satisfaction is higher than the quality of information and content.Perceptions of user satisfaction e-learning information systems greatly affect the use of e-learning system.The use of e-learning system supports the field of study, effective and efficient and overall satisfied using e-learning information system.
Use and user perceived satisfaction are statistically significant and H10, H11 are accepted.Based on the results of data processing, use and user perceived satisfaction gives a positive impact on individual performance and in line with other studies [6][7] [12][16].User perceived satisfaction gives more significant result than use because user perceived satisfaction, lead to achieve personal, educational goals of users and their knowledge will be higher.User perceived satisfaction of e-learning system indicates e-learning system supports field of study, more effective and efficient learning and overall satisfied user using e-learning system.When a user of e-learning system is more satisfied, the use of system will increase.
The results shows that service quality does not significantly affect user perceived satisfaction and use in accordance with the results of research conducted by other researchers [10][11][15] [12].The management must maintain service quality by means of, forming a helpdesk section, providing services and explanations online to assist in the use of e-learning.Result indicates that content and information quality has no significant impact user perceived satisfaction.The content & information quality should be retrievable, useful, understandable, interesting, and reliable.And educational system quality and technical system quality has no significant impact use.The management need to make continuous improvements to the education system quality factors such as collaborative and active learning, learning outcome evaluation that allows users to view their academic achievement as well as the facilities easy and convenient communication between users of e-learning.In addition, the management must always maintain the quality of the technical system by means of ease of finding information, ease of integration with other systems and high reliability.

Implication
The research on the success of e-learning systems is rarely done in Indonesia context.This research was conducted to build an integrated model of e-learning success in Indonesia.The model that proposed in this study was built by adapting the success model of information systems from DeLone& McLean which proved in many studies is an appropriate model for assessing the success of information systems in various contextThis research uses modeling D & M information system success model [3] that has been modified in research [5] and model of e-learning success adoption [6].Through these two models, this research tries to build a model used to see the success factors of e-learning in universities.This research is conducted to analyze factors that influence the success of e-learning implementation in University.The results obtained by this research can be used as a reference for further research that aims to see the success factor of e-learning in universities.This study only looks at the impact of individuals on the use of e-learning.
This research proves that user perceived satisfaction can be a motivator for the use of e-learning system.The use of e-learning systems has a positive impact on users.Users feel a lot of benefits when accessing e-learning.Therefore, user perceived satisfaction when accessing e-learning can be one of the things that the university needs to pay attention to.
Educational system quality and technical system quality perceived by users proved to encourage the perception of user satisfaction to use e-learning system.Management needs to make continuous improvements to educational system quality factors such as collaborative and active learning, evaluation of learning outcomes that enable users to see academic achievements and easy and convenient communication facilities between e-learning users.In addition, the management must always maintain the technical system quality with the ease of finding information, ease of integration with other systems and high reliability.To improve e-learning users management needs to pay attention to user factors perceived satisfaction and content & information quality factors.

CONCLUSION
This research successfully answer research question about success factor of e-learning implementation.Through regression equation it can be seen that user perceived satisfaction is influenced by technical system quality and educational system quality.use is influenced by technical system quality, educational system quality, and user perceived satisfaction.The main factors that drive users to use e- 291 learning systems have proven to be most influenced by user perceived satisfaction.Use is influenced by content & information quality, and user perceived satisfaction.User perceived satisfaction is influenced by technical system quality and educational system quality.e-Learning will impact on individual users affected by use with a value of 52.3% and user perceived satisfaction with a value of 39.8%.The study also found that perceived satisfaction is a major factor driving the use of e-learning systems.This study found that service quality and content & information quality did not prove to be a factor encouraging users to use e-learning and user perceived satisfaction.The results obtained by this research can be used as a reference for further research that aims to see the success factor of elearning in universities.
In this study service quality proved not to give significant influence on the use and user perceived satisfaction.Further research needs to build a deeper theory to include a variable into the model to be tested.Subsequent research needs to expand the scope of the study, such as the number of universities more, representing each region in Indonesia so that will produce more representative models of Indonesia so that learning online and distance can be more optimal.And research that can compare the success model of elearning implementation and evaluate the performance of e-learning both with blended learning education system and online learning.

Table 1 .
. Stages of Research

Table 2 .
Instrument Variable Research

Table 3 .
below Summary of Respondent Demographics e-Learning Success Model: An Extention of DeLone & McLean IS' Success Model (Henki Bayu Seta) 287

Table 4 .
Value Measurement Model

Table 5 .
R-Square Value

Table 6 .
Hypothesis Testing Result e-Learning Success Model: An Extention of DeLone & McLean IS' Success Model (Henki Bayu Seta) 289

Table 6 .
Hypothesis Testing Result