CC BY
1Scholarly Publisher RS Global Sp. z O.O.
ISNI: 0000 0004 8495 2390
Dolna 17, Warsaw, Poland 00-773 Tel: +48 226 0 227 03 Emai l: editori al_offi [email protected]
JOURNAL World Science
p-ISSN 2413-1032
e-ISSN 2414-6404
PUBLISHER RS Global Sp. z O.O., Poland
ARTICLE TITLE AUTHOR(S)
ARTICLE INFO DOI
RECEIVED
ACCEPTED
PUBLISHED
COMPARATIVE ANALYSIS OF COMPLEX INFORMATION SYSTEM TESTING METHODS Nona Otkhozoria, Lily Petriashvili, Ani Kudukhashvili, Nino Kakhurashvili
Nona Otkhozoria, Lily Petriashvili, Ani Kudukhashvili, Nino Kakhurashvili. (2023) Comparative Analysis of Complex Information System Testing Methods. World Science. 1(79). doi: 10.31435/rsglobal_ws/30122023/8076
https://doi.org/10.31435/rsglobal_ws/30122023/8076 21 October 2023 24 November 2023 28 November 2023
LICENSE
This work is licensed under a Creative Commons Attribution 4.0 International License.
© The author(s) 2023. This publication is an open access article.
COMPARATIVE ANALYSIS OF COMPLEX INFORMATION SYSTEM TESTING METHODS
Nona Otkhozoria
Georgian Technical University, Tbilisi, Georgia ORCID ID: 0000-0002-5837-5345
Lily Petriashvili
Georgian Technical University, Tbilisi, Georgia ORCID ID: 0000-0003-3593-4877
Ani Kudukhashvili
Georgian Technical University, Tbilisi, Georgia Nino Kakhurashvili
Georgian Technical University, Tbilisi, Georgia
DOI: https://doi.org/10.31435/rsglobal_ws/30122023/8076
ABSTRACT
This study delves into the realm of complex testing methods, which play a pivotal role in ensuring the functionality and integrity of information systems. It provides a comparative analysis of five primary testing methods: performance testing, automated testing, availability testing, usability testing, and security testing. The research underscores the challenges faced during the practical application of these methods and highlights the critical importance of experienced testers, effective communication, a stable testing environment, regular testing, and the utilization of appropriate tools to enhance security and automation. The fast-paced evolution of technology has resulted in increasingly complex information systems. As a result, the need for effective testing methods to maintain quality control has grown substantially. Complex testing may be necessitated by a multitude of factors, including intricate component dependencies, the integration of cutting-edge technologies, and stringent adherence to security and performance standards. In addition to these complexities, technology organizations encounter challenges such as limited resources, time constraints, and the rapid pace of technological change.
Citation: Nona Otkhozoria, Lily Petriashvili, Ani Kudukhashvili, Nino Kakhurashvili. (2023) Comparative Analysis of Complex Information System Testing Methods. World Science. 4(82). doi: 10.31435/rsglobal_ws/30122023/8076
Copyright: © 2023 Nona Otkhozoria, Lily Petriashvili, Ani Kudukhashvili, Nino Kakhurashvili.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
Introduction.
With the increasing complexity of modern information systems, ensuring their quality, reliability, and performance is of paramount importance. This study conducts a comparative analysis of complex testing methods to illuminate the challenges they present and provide insights into best practices for their application [1].
The study encompasses an in-depth analysis of five complex testing methods, each tailored to specific tasks and objectives. These methods include Performance Testing, Security Testing, Test Automation, Usability Testing, and Accessibility Testing. As organizations grapple with diverse
ARTICLE INFO
Received: 21 October 2022 Accepted: 24 November 2023 Published: 28 November 2023
KEYWORDS
Complex Testing Methods, Quality Control, Information Systems.
quality control challenges, the choice of testing methods becomes a critical decision to ensure that the unique demands of each situation are met [2-4].
Selecting and implementing testing methods for specific contexts can be a daunting undertaking for organizations. Inadequate testing can result in undetected defects, exposing systems to security, performance, and functional vulnerabilities. Conversely, overly rigorous quality control can strain an organization's resources, budget, and timeline, potentially causing delays in system implementation. Therefore, the selection of testing methods must thoughtfully consider the distinctive challenges of the products and systems being tested.
Optimizing quality control is instrumental in achieving the efficient operation of information systems. A comprehensive understanding of complex testing methods, along with the ability to discern the issues each method can address, is indispensable. By tailoring testing approaches to suit the unique challenges of the products and systems at hand, organizations can strike a balance between quality control and efficient system development.
Figure 1. Ishikawa Chart Testing Challenges.
Materials and Methods.
An Ishikawa diagram was employed to identify potential causes of a quality characteristic. This diagram is structured around six primary categories: resources, processes, environment, personnel, management, and requirements. Each category was further subdivided into more specific potential factors that could influence software quality [5-7].
The Ishikawa diagram played a crucial role in pinpointing the principal challenges. Subsequently, it became essential to investigate specific testing methods and types in the context of these challenges. Given the multitude of testing methods available, it was imperative to determine which methods are considered complex within the technological landscape. To achieve this, a small-scale quantitative study was conducted, and the Pareto principle was applied to select the methods. A total of 65 specialists in the field participated in the survey [8].
Table 1. Complexity of testing methods.
Testing methods Responses
Performance Testing 42
Security Testing 38
Usability Testing 30
System Testing 25
Acceptation Testing 18
Integration Testing 13
Unit Testing 12
Compatibility Testing 9
Figure 2. Complex testing methods, Pareto diagram.
Results.
Seventy-five professionals who received a questionnaire link through the social platform LinkedIn and email actively participated in the structured interviews. Geographically, the distribution of participants was diverse, ensuring a comprehensive perspective and enhancing the study's validity.
The participants represented various roles within organizations, including Quality Assurance (QA), management, development, operations, and other categories. This broad distribution provided a holistic view of the software testing landscape, encompassing the viewpoints of those directly involved in testing, process managers, and individuals influencing quality through different avenues.
Responses regarding the adequacy of experienced testers and the clarity of communication within teams shed light on essential aspects of team dynamics and resource allocation. These findings are pivotal for comprehending the current testing methods' effectiveness and identifying potential areas for enhancement.
Insights into test environment stability and tester proficiency offered a deeper understanding of both technical and human factors. These responses contributed to a more comprehensive picture of the infrastructure supporting the testing process and the skills and experience of the individuals executing it.
The frequency of various testing types, such as performance and usability testing, indicated how often these complex methods were employed. Differences in testing frequency could be attributed to various factors, including project nature, resource availability, or specific client requirements.
Evaluations of the current security testing methods' effectiveness and the implementation and impact of automated testing provided valuable insights. Understanding the perceived effectiveness of these methods highlighted areas of operational efficiency and areas requiring improvement.
Responses concerning testing duration and the prioritization of testing tasks offered valuable insights into the challenges faced by testers in real-world scenarios.
The challenges reported in real-time monitoring of implementation results offered a deeper understanding of potential issues that might arise during this critical phase. These insights can inform strategies to mitigate such issues in future projects.
It is noteworthy that clear trends are emerging in the field of testing, focusing on efficiency in security testing methods, the adoption of automated testing, the establishment of stable test environments, addressing limitations in testing (such as time and resources), and improving the documentation of test cases. These trends align with the Pareto principle, emphasizing the significance of these five key areas for improvement.
Figure 3. Analysis ofproblems identified as a result of the survey.
Also, three main challenges were identified: lack of visibility into system performance, difficulty in correlating data between systems, and slow response times to resolve issues.
Figure 4. Survey results-challenges.
In summary, the research findings offer a comprehensive understanding of the present state of software testing, particularly within the domain of complex testing methods. The challenges reported and the perceived effectiveness of these methods serve as significant indicators of potential areas for enhancement and development. It is essential to acknowledge that these insights reflect the experiences and viewpoints of the survey participants, and further research could contribute to a more exhaustive grasp of the field.
Discussion.
The current research delves deeply into complex testing methods in the realm of information systems and highlights the diverse challenges associated with them. This study rigorously examines performance testing, automated testing, security testing, accessibility, and usability testing through a systematic analysis of both qualitative and quantitative data.
The survey data has unveiled invaluable insights into the practical implementation of these testing methods. It is evident that the real-world application of these methods presents a myriad of challenges, ranging from resource limitations to effectively conveying requirements. The availability of skilled testers varies considerably across different geographical locations and organizations.
Conclusions.
This study has surfaced valuable perspectives from the field, enriching our understanding of the current status of complex testing methods in information systems. It underscores the significance of employing a mixed methods approach to research, one that combines qualitative and quantitative data to obtain a well-rounded comprehension of the subject matter.
REFERENCES
1. William E. Perry Effective Methods for Software Testing: Includes Complete Guidelines, Checklists, and Templates , 3rd Edition, Wiley, May 1, 2006.
2. N. Otkhozoria, Z. Azmaiparashvili, L. Petriashvili, V. Otkhozoria, and E. Akhlouri. 2023. "LABVIEW IN THE RESEARCH OF FRACTAL PROPERTIES OF THE TOPOLOGY OF NETWORKS AND STOCHASTIC PROCESSES". World Science, no. 3(81) (July). https://doi.org/10.31435/rsglobal_ws/30092023/8020.
3. Irina Chkheidze, Nona Otkhozoria, Medea Narchemashvili (2021) EVALUATION OF MEASUREMENT QUALITY USING THE MONTE-CARLO METHOD INSTRUMENTATION, PRECISION AND ACCURACY, DATA MEASUREMENT TOOLS AND SYSTEMS DOI: 10.32743/UniTech.2021.84.3-4.65-70.
4. Doborjginidze G., Petriashvili L. (2020) IMPROVING EFFICIENCY OF INVENTORY IDENTIFICATION SYSTEM. EUROPEAN SCIENCE REVIEW, Premier Publishing s.r.o ISSN: 23105577 DOI: https://doi.org/10.29013/ESR-20-1.2-84-88.
5. Giorgi Doborjginidze, Lily Petriashvili, Mariam Inaishvili (2021) Optimization of Inventory Management in the Supply Chain. Journal of Communication and Computer, David Publishing Company 16 (2021) 1-5 DOI:10.17265/1548-7709/2021.01.001.
6. Giorgi Gogichaishvli, Lily Petriashvili, Mariam InaishviliThe (2022) Algorithm of Artificial Intelligence for Transportation of Perishable Products. BULLETIN OF THE GEORGIAN NATIONAL ACADEMY OF SCIENCES, vol. 16, no. 4, 2022.
7. Tamar Bitchikashvili, Liliy Petriashvili, and Luka Kavtelishvili Jang. 2023. "DIGITALIZATION OF MANAGEMENT OF A HIGHER EDUCATIONAL INSTITUTION, NATIONAL AND INTERNATIONAL CHALLENGES AND WAYS OF SOLUTION". World Science, no. 3(81) (September). https://doi.org/10.31435/rsglobal_ws/30092023/8032.
8. Tamar Lominadze,Maka Khartishvilli,Ketevan Makhashvili,Ivane Gordigze (2017) Information and Computer Technology, Modeling and Control
Nova Science Publishers, Inc. 6080 Jericho Tpke. Suite 207 Commack, NY United States ISBN:978-1-5361-2075-2.
