CC BY-NC
14Software systems and computational methods
Правильная ссылка на статью:
Kiryanov D.A — Hybrid categorical expert system for use in content aggregation // Программные системы и вычислительные методы. - 2021. - № 4. - С. 1 - 22. DOI: 10.7256/2454-0714.2021.4.37019 URL: https://nbpublish.com'library_read_article.php?id=37019
Hybrid categorical expert system for use in content aggregation / Гибридная категориальная экспертная система для использования в агрегации контента
Кирьянов Денис Александрович
ORCID: 0000-0001-8502-8333
магистр, Балтийский государственный технический университет Военмех имени Д. Ф. Устинова 190005, Россия, г. Санкт-Петербург, ул. 1-Я красноармейская, 1
Статья из рубрики "Базы знаний, интеллектуальные системы, экспертные системы, системы поддержки
принятия решений"
DOI:
10.7256/2454-0714.2021.4.37019
Дата направления статьи в редакцию:
02-12-2021
Дата публикации:
21-12-2021
Аннотация: Предметом исследования является разработка архитектуры экспертной системы для распределенной системы агрегирования контента, основное предназначение которой категоризация агрегированных данных. Автор подробно рассматривает такие аспекты темы, как преимущества и недостатки экспертных систем, инструментарий разработки экспертных систем, классификация экспертных систем, а также рассматривается применение экспертных систем для решения проблем категоризации данных. Особое внимание уделяется описанию архитектуры предложенной экспертной системы, которая состоит из компонента для фильтрации спама, компонента определения главной категории для каждого из типов обрабатываемого контента, а также компонентов для определения подкатегорий, один из которых основан на правилах доменной области, а другой компонент использует методы машинного обучения, дополняя первый. Основным выводом данного исследования является то, что экспертные системы возможно эффективно применять для решения проблем категоризации данных в системах агрегации контента. Автором было выяснено, что гибридные решения, объединяющие подход, основанный на использовании базы знаний и правил с использованием нейронных сетей, помогают снизить стоимость экспертной системы. Новизна исследования заключается в
предложенной архитектуре системы, которая является легко расширяемой и адаптируемой к нагрузкам за счет масштабирования существующих или добавления новых модулей. Предложенный модуль определения спама основан на адаптировании поведенческого алгоритма определения спама в электронных письмах, предложенный модуль определения основных категорий контента использует два вида алгоритмов, на основе нечетких отпечатков: Fuzzy fingerprints и Twitter Topic Fuzzy Fingerprints, который изначально использовался для категоризации сообщений в соц. сети Твиттер. Работа модуля, определяющих подкатегорию на основе ключевых слов происходит во взаимодействии с базой данных-словарем (Тезаурус). Последний классификатор использует алгоритм опорных векторов для конечного определения подкатегорий.
Ключевые слова: Экспертная система, Алгоритм нечетких отпечатков, Агрегация контента, Нейронная сеть, Категоризация контента, Инженерия знаний, Метод опорных векторов, TF-IDF, CLIPS, Идентификация спама
Introduction
Modern science and industry are inconceivable without the use of computer technology. Over the past 50 years, the level of information and intellectual support of various technologies
has increased tremendously -Ш. The amount of obtained information is so great that it is very difficult for a person, even a specialist, to deal with it. To perceive and process it, special intellectual support is required.
Therefore, expert systems and decision support systems find their application in various
fields of economics, medicine, and science An expert system can be defined as a computer system designed to solve complex problems by emulating the decision-making
process of human experts ^^
Expert systems emerged as a significant practical result in the application and development of artificial intelligence, i.e., a set of scientific disciplines that study methods for solving
problems of an intellectual (creative) nature using computers The first expert systems were developed in the late 60s of the last century and were intended to create an artificial "super mind" in some subject area
The first expert systems were implemented using specialized programming languages such
as Lisp and Prolog [6]. Some of those systems are still in active use today. An example of
such a system is DENDRAL ^^ the purpose of which is to create organic molecular graphs of
non-cyclic isomers (written in Lisp). Another good example is PROSPECTOR I-8 which was successfully used in the search for mineral deposits.
There are many types and implementations of expert systems. For example, paper t9-surveys and classifies expert systems using two categories: rule-based systems and knowledge-based systems with their applications for different research and problem domains.
The purpose of this article is to propose an expert system that is a part of a distributed content aggregation system and helps categorize aggregated content. Categorization is a very complex process due to the sheer volume of content that should increase the relevance of the search result. This task also required research into the advantages and
disadvantages of expert systems, as well as the tools for their development, to develop the most appropriate architectural solution.
This paper is structured as follows. Section 1 provides an overview of the benefits of expert systems. Section 2 contains the main disadvantages of expert systems. Section 3 describes the general architecture of an expert system. The classification of expert systems is presented in Section 4. Section 5 provides an overview of the tools for creating expert systems. Examples of expert systems that perform categorization tasks are listed in Section 6. Section 7 explains the architecture of the proposed system. Finally, the conclusions are given in Section 8.
1 The advantages of expert systems
In the modern sense, an expert system is a kind of artificial intelligence (AI), i.e., a set of programs that perform the functions of a human expert in solving problems from a specific
subject area [10, p- 203!. And one of the most important differences between expert systems and other systems with artificial intelligence is that the expert system models the mechanism of human thinking in relation to solving problems in this problem area and not business logic.
The expert system, in addition to performing computational operations, forms certain considerations and conclusions based on the knowledge it has (this component is usually called the knowledge base). In addition, expert systems differ from other AIs in that they use heuristic and approximate methods to solve problems J-1!.
One of the main advantages of expert systems is performance. In general, an expert system deals with real-world objects and such operations usually require significant human experience, i.e., expertise. Well-designed expert systems find a solution within a reasonable time, which is at least no worse than that which a specialist in this subject area can solve the same task. It means that expert systems are productive, and their power lies in the high-quality awareness of task areas [11, p- 74].
Expert systems can easily analyze all aspects of a problem, which often leads to the selection of the best alternative. Such systems turn out to be extremely effective when the knowledge bases are huge because once entered the machine, knowledge is stored forever. On the other hand, an expert (person) has a limited knowledge base, and there is always a risk of loss of expert knowledge due to an expert leaving the company.
The study J-12 notes a very positive effect of expert systems on improving the general control audits in electronic accounting systems: they enhance the separation between jobs and duties inside the management of information systems. Also, the study reveals that there is an impact of the expert systems on enhancing the access controls by increasing the chance for controlling and authenticating the inputs. Finally, the expert systems enhance the security and protection of the files and there is an effect on enhancing the controls of system documentation, development, and maintenance.
Summing up the benefits of using expert systems, the following can be highlighted [11, pp-80-81! :
1 . Increased availability and reliability: Expertise can be accessed on any computer hardware and the system always completes responses on time.
2. Multiple expertise: Several expert systems can be run simultaneously to solve a problem
and gain a higher level of expertise than a human expert.
3. Explanation: Expert systems always describe of how the problem was solved.
4. Fast response: The expert systems are fast and able to solve a problem in real-time.
5. Reduced cost: The cost of expertise for each user is significantly reduced. 2 The disadvantages of expert systems
Even the best existing expert systems have certain limitations compared to a person who is an expert in their subject area. For example, most expert systems are not quite suitable for use by the end-user and high qualification is needed to work with them.
Another problem when using expert systems is the presentation of expert knowledge in a form that the system can understand. It is also known that knowledge acquisition can be very expensive and time consuming, when done correctly [13, p- 79].
Typically, the time it takes to acquire knowledge varies from case to case but can easily range from 50 to 100 man-weeks. It is also worth noting that the preparatory phase, which includes initial orientation, a feasibility study, and a selection of a programming shell, can
take an additional 15 to 25 man-weeks [14, pp- 165-1661.
Also, expert systems do not have a self-learning mechanism and are inapplicable in large subject areas. Their use is limited to subject areas in which an expert can decide in a time from several minutes to several hours. In addition, in those areas where experts may be absent, the use of expert systems turns out to be impossible J611.
It is also known that knowledge-based systems are ineffective when it comes to rigorous analysis when the number of solutions depends on thousands of different possibilities and many variables that change over time. The expert system knows the algorithm for processing knowledge but not the algorithm for solving the problem, in contrast to traditional applied applications. I t means that the knowledge processing algorithm can lead to an unintended result
Another disadvantage is a fact that a portion of knowledge in expert systems (typically less than 10 percent) escapes standard representation schemes and requires special fixes. Special fixes pose an audit risk and a security risk because they offer the opportunity to
hide the knowledge that can result in unusual or dysfunctional behavior [15, p- 91.
The study J-161 considers the ethical characteristics of an expert system such as lack of human intelligence, lack of emotions, accidental bias, and lack of values. It was also shown that the selected characteristics of the expert system negatively affect the degree of ethics in the organizational environment.
The evidence of effectiveness of expert systems in medicine is mixed. Although some reviews reported that expert systems improved the performance of health care providers and patient outcomes, other reviews were less optimistic about their effects, requiring
additional evidence to demonstrate the cost-effectiveness of these systems [13, p- 92]. For example, in the case of routine medical consultations, expert systems are irrelevant and considered to be designed to support only routine consultations so that doctors have all the patient data they need to make a diagnosis [171.
Finally, the following disadvantages of using expert systems can be summarized [11, p- 81]
1. Expert systems have superficial knowledge, and a simple task can potentially become computationally expensive.
2. Expert systems require knowledge engineers to input the data, data acquisition is very hard.
3. The expert system may choose the most inappropriate method for solving a particular problem.
4. Problems of ethics in the use of any form of AI are very relevant at present.
5 . It is a closed world with specific knowledge, in which there is no deep perception of concepts and their interrelationships until an expert provides them.
3 The general architecture of an expert system
In general view, an expert system includes the following components: a knowledge base, an inference engine, an explanation facility, a knowledge acquisition facility, and a user
interface. The general architecture of an expert system is shown in Figure 1 p-75l.
Figure 1 - Architecture of an expert system
The high-level architecture of an expert system which is shown in Figure 1 can be explained as follows [11' pp- 75-761:
1. The knowledge base stores the facts for processing. It is domain information entered by the experts.
2 . An inference engine is an interpreter of the rules, it works together with the agenda component which contains a list of queries to execute.
3 . An explanation facility is a subsystem that explains the reasoning of the expert system to a user.
4 . A knowledge acquisition facility is used to obtain information from the user in an automatic mode. It uses different techniques such as process analysis, interviews, and observation.
5. A user interface module translates the rules from its internal representation into user comprehensible form.
4 Classification of expert systems
Expert systems are usually divided into four classes according to their operating principles,
including rule-based, frame-based, fuzzy logic and neural network-based expert systems -t10-p. 2031.
4.1 Rule-based expert systems
Rule-based systems encode the knowledge of a human expert for use in an automated system using a set of statements, that is, facts, and a set of rules that embody that knowledge [18, 191. These rules are set in the IF-THEN form. Such expert systems are very
popular in medicine [20 - 27]. In [28], a unified framework for building rule-based systems is presented, which consists of the operations of rule generation, rule simplification, and rule representation.
4.2 Frame-based expert systems
The frame-based expert systems [29 - 32] have a frame that is a developed data structure containing the concept-related information: the concept name, the possible values of each attribute, and the procedural information of the target problems. Frame-based systems can deal with more complex problems, compared to the rule-based system [10, pp- 203-2041, and are often combined with a rule-based method, thus making a powerful system for solving complex problems J331.
4.3 Fuzzy logic-based expert systems
Fuzzy logic-based expert systems [34 - 40] integrate the fuzzy theory, using it as a bias of the reasoning. Such systems are highly reliable and can perform preliminary and heuristic reasoning [10 p- 204].
The purpose of fuzzy logic-based expert systems is to provide an easy way to work with systems full of uncertainty. In such systems or environments, fuzzy logic is considered very effective when inferences do not need to be precise, but acceptable to a certain degree of certainty [41].
4.4 Neural network-based expert systems
Neural network-based expert systems, as it follows from the naming, use the neural networks for building the rule base from examples given by a human expert. A neural network-based expert system increases the knowledge represented in its connections over
time by learning from examples [42].
The neural network-based approach can be used when it is difficult to determine whether the knowledge base is correct, consistent, or incomplete. It also applies in situations where
it is difficult to get an adequate set of rules from human experts [431.
Even though the neural networks were not originally designed to make expert systems t4211, this approach is actively used nowadays due to the rapid development of machine learning algorithms [10' p- 2041.
When building expert systems using the neural network-based approach, various algorithms and neural network types can be used. For instance, paper [441 shows how the feed-forward backpropagation algorithm [451 can be used for predicting the temperature of the kiln shell. Paper [461 describes an expert video surveillance system based on a recurrent neural network (RNN) [471 and a long-short term memory network (LSTM)^4811. The study [491 proposed an expert system based on the generalized regression neural network (GRNN)^501 for diagnosing hepatitis B virus disease.
5 Toolkit for creating expert systems
The development of expert systems is a very complex task requiring knowledge engineers who translate expert knowledge into the language of the expert system. To speed up the development process, specialized software is often used. This section provides a brief overview of some of the shells and programming languages that are used to create expert systems.
5.1 Exsys Corvid
Exsys Corvid -t5111 has been one of the most popular commercial shells for many years and is still actively used today. It includes tools for debugging and testing the program, editing for modifying knowledge and data. The Java-based Corvid Interface Engine allows solving complex problems using the IF-THEN rules.
Knowledge automation expert systems with Exsys Corvid software and services have been developed worldwide in a wide variety of fields such as medicine, maintenance, human
resources, government, energy, and many others The use of Exsys Corvid as a
development tool for building an expert system is shown in articles [53 - 5615.2 CLIPS
CLIPS [571 is a well-known rule-based software tool for building expert systems. It is written in the C programming language and uses forward chaining. Currently, CLIPS is actively used in numerous modern projects, such as the development of an expert system for the selection of tunnel boring machine rule-based expert systems prototyping [591, as well as a digital fitness coach [601.
5.3 Java Expert System Shell (JESS)
The Java Expert System Shell (JESS) is another popular shell for building expert systems. This shell is an interpreter for the Jess programming language and can be used in console and GUI applications. From an architectural point of view, JESS is a production system that
executes a rule-based program [611.
JESS has been used successfully in many projects, including Interactive Voice System^621, semantic web service discovery [631, security risk analysis [641, building virtual laboratory platform [651, and others.
5.4 Kappa PC
Kappa PC [66, 671 is a shell that brings together the critical technologies needed to rapidly develop low-cost and high-performance expert systems. It allows writing applications using GUI and generates standard ANSI C code. Domain components are represented as objects
and can represent real things like cars or intangible concepts like property, and these objects can be extended using methods
Applications of the Kappa PC software can be found in many projects such as an expert system for the design of commercial buses ^^ or an advisory system that helps to improve the efficiency of the transport system
5.5 Prolog
Prolog [70 - 72] is a logic programming language that is very popular in artificial intelligence programming and is often used for expert systems. The main features of Prolog are pattern matching mechanism, automatic backtracking, and tree-based data structuring.
5.6 Flex
Flex is a Prolog-based expert system's toolkit. It supports frame-based reasoning with inheritance, rule-based programming, and data-driven procedures fully integrated into a logic programming environment [73, p- 9]. There are many expert systems built using this shell, for example, an expert system for site selection for thermal power plants ^^ and an expert system for interpreting the results of the allergen microarray
5.7 Gensym G2
G2 is a powerful expert system for real-time operations provided by Gensym Corporation. G2 can process tens of thousands of rules per second, supports reasoning within a deadline and default reasoning, natural language rule definition, and task priority scheduling
G2 was used in such projects as a dynamic simulation of an opencast coal mine and implementation of a conceptual framework for modeling a biopharmaceutical manufacturing
plant J78^, where high performance and reliability were needed.
5.8 Lisp
In addition to Prolog, Lisp is another popular programming language for creating expert systems, which is actively used today in projects such as an expert system for diagnosing and treating diabetes ^^ and others.
5.9 VisiRule
VisiRule J81 is a popular visual modeling tool which is designed for building reliable decision models. VisiRule requires no programming skills and generates Flex and Prolog
code from visual models. An example of working that VisiRule can be found in the study describing the creation of a rule-based decision-making expert system.
As shown above, there are many shells and programming languages that can be used to build expert systems. Unfortunately, many tools are not currently supported. The technical report J82! provides a detailed overview of many of these.
6 Categorization and classification tasks using expert systems
Expert systems can be used to solve a categorization problem, i.e., they can determine some objects or consequences of uncertain knowledge through hierarchical categorization. The knowledge base of such categorical systems consists of a taxonomic set of verbal
categories, and their purpose is to determine the category of the input object based on the available facts Í831.
Since categorial knowledge consists only of logical relationships between facts and does not contain an element of doubt, it can be expressed as IF-THEN rules. Categorical expert systems also require an inference engine to solve a particular problem. The inference engine can use backward and forward chaining methods and include explanation and conflict
resolution modules [84' pp 25-301.
Current research shows that, in addition to the rule-based approach, the neural network approach is currently very popular in creating a classification module for such expert systems. There are many applications of expert systems in data classification and categorization problems and this section contains a description of some of them.
6.1 Categorial expert system Jurassic
A Jurassic expert system I-851 is a well-known example of categorical expert systems. The system's knowledge base consists of 423 rules, which are presented as a directed acyclic graph of a depth of five.
Jurassic uses the approach t861 of representing objects not in the form of feature sets, but in the form of lists, which makes it possible to include copies of the same object in a single object representation, differing in their position in the list. The system performs categorization using a neural deductive system. The similarity is calculated in the case of uncertain knowledge based on common features.
6.2 Expert system for categorizing multiple intelligences of students
The paper [871 presents an expert system that classifies students' abilities in one of three areas: engineering, management, and science. The system architecture includes a user interface, an inference engine, a knowledge base, a student database, and a database containing student answers to questions that are used to determine the most appropriate course for each student.
The knowledge base of the system contains predefined rules that must be corrected in the process. The system determines the preferred course for the student based on weights calculated using special functions defined for each type of intelligence for each grade.
6.3 Expert system for classification of pavement cracking
The study [88! considers a multiagent expert system for automatic distress detection. The proposed system uses an expert system as a component performing the classification task,
which is performed using a neural network. The system is considered hybrid [891 and has a complex architecture consisting of three agents and, in addition to the expert system, uses
various technologies such as fuzzy logic [90!, image processing, soft computing methods, etc.
6.4 Expert system for voltage dip classification
The paper [91! presents an expert system for classifying events of voltage dips in the power system. There are four event classes considered by the expert system: fault-induced events transformer events, induction motor events and step-change events. The classification task is based on their characteristics, which are related to the temporary decrease in the
voltage. The system's knowledge base contains the features uniquely characterizing the events in a set of rules.
6.5 Expert system for tweets classification
Expert systems are often used in the content classification task. For example, study i92-presents MISNIS, an expert system that automatically classifies tweets into a set of topics
of interest. The system uses the Twitter Topic Fuzzy Fingerprints method ^^ and compares the fuzzy fingerprint of an individual text to that of a potential author. To determine if a tweet is related to a specific topic, the system creates a topic fingerprint and a fingerprint of trending topics.
6.6 Expert system for multi-language documents categorization
The GENIE project described in the paper^94 is a multi-language rule-based text categorization expert system that is based on five stages: preprocessing, attribute-based classification, statistical classification, geographical classification, and ontological classification.
The categorization process begins with the preprocessing stage which includes
lemmatization named entities recognition [96], and keywords extraction Then it applies the attribute-based classification based on the thesaurus, i.e., a list of words and a set of their relations. The next stage is statistical classification, where the machine learning techniques are used to find patterns that correspond to the statistical information and to get labels that match the general topics of the document.
The system then applies a geographic classifier to identify possible geographic references
included in the text. The geographic classifier uses a gazetteer component i98 which represents a systematized knowledge and details about named places.
Finally, the ontological classification is performed, using a lexical database with sets of synonyms and semantic relations among them.
A similar approach for classification module architecture is used in the Hypatia project which is an expert system for documentation departments that provides categorization, semantic search, summarization, knowledge extraction, aggregation, and many other functions in the field of document analysis.
7. Proposed system
7.1 System's architecture
The proposed categorization expert system is considered as a part of a high loaded distributed content aggregation system that aggregates text data of multiple types: news, blogs, job ads, company information (including feedback on work), social events (meetups, conferences, exhibitions, etc.) and displays it in a user-friendly format and design.
Since the main purpose of this system is to provide a relevant response to a query, the categorization of the aggregated content is very important. The task is compounded by the sheer volume of data, which means the entire system must be productive and scalable.
Each of the aggregated documents has a set of properties, such as title, creation date, URL, type, short description, etc. These properties are used by the rule-based mechanism to categorize the data when the neural network approach is not sufficient to decide.
The high-level architecture of the proposed system is shown in Figure 2.
Figure 2 - Architecture of the expert system for aggregated content categorization
The system described in Figure 2 consists of a cluster of content Downloaders
[1001
i.e.,
web crawler agents, Content parser module, Classification application, Pre-processor, Spam classifier, Fuzzy fingerprint classifier, Attribute-based classifier, and SVM classifier.
The system also has a Thesaurus - a database with a list of words for different languages to categorize the data. At each step, the system tries to get labels that correspond to the categories of processed content.
The entire presented system can be divided into two parts: the first part is the information retrieval, and the second is its subsequent processing and categorization. These parts will be described below, with more emphasis on the categorization part, since content aggregation technology is not the main topic of this study.
7.2 Information retrieval
The Downloaders are responsible for information retrieval: they send hundreds of requests to the sources on the Internet and save web pages to the content repository database.
The Content parser module is a distributed set of parser applications that receive aggregated content and parse it according to business rules. The parsed content is stored in the aggregated content database. Both the content repository database and the aggregated
content database are relational databases (PostgreSQL [1011), following the master-slave concept, which is used to stabilize the system.
The Classification application module retrieves the parsed data from the aggregated content
database and adds it to the Classification message queue (Rabbit Mq [102]). The amount of information processed is very large, and the message queue helps to scale the load.
7.3 Pre-processor
The Pre-processor module automatically retrieves HTML data from the Classification message queue and processes it to ease the further work of the categorization mechanism.
The Pre-processor's architecture is shown in Figure 3.
HTML
HTML markup removal
Lowercasing Stop words removal Stemming
Pre-processed
Punctuation marks removal Lemrriatlzation Keywords
extraction data
Figure 3 - Architecture of the Pre-processor module
As it follows from Figure 3, the Pre-processor module's architecture consists of the separated applications to perform HTML markup removal, stop words removal, stemming [103], lemmatization, lowercasing, punctuation marks removal, and keyword extraction using term frequency-inverse document frequency (TF-IDF) algorithm [104].
7.4 Spam classifier
The considered content aggregation system should have an effective mechanism for detecting spam or inappropriate content. The crux of the problem is that spam can be found in various types of content, from unwanted advertising to illegal content in articles or aggregated comments or reviews. It is a very hot issue, and there are many approaches to solving it, including rule-based expert systems and systems that use machine learning algorithms.
For example, study [105] presents a cost-based heterogeneous learning framework for detecting spam in Twitter messages, which is a combination of the work of experts and a machine learning algorithm that filters spam messages.
In paper [106] spam emails have been identified using machine learning and deep learning approaches. The researchers deployed six learning models and found that XGBoost[107] has the best performance among the machine learning models to perform the spam classification task.
The proposed Spam classifier component is based on the behavioral method [108], which uses a combination of a rule-based approach and a neural network to detect spam in emails. Its architecture is illustrated in Figure 4.
Figure 4 - Architecture of the Spam classifier
When a new batch of aggregated content arrives at the Spam classifier, it first analyzes incoming data to see if there are blacklisted external links. If so, the data is considered spam and is saved to a separate database.
The next step is rule-based processing, which uses the domain knowledge from the knowledge base. If the data is considered spam, it is stored again in the spam database.
To identify spamming behaviors, it is supposed to form news, comments, blogs, and other aggregated content in accordance with their keywords, tags, date of creation, information about the author, external links, descriptions of images, etc., a nd present it in a vector form for further use of the backpropagation neural-network architecture as described in paper UJffil
7.5 Fuzzy fingerprints classifier
All aggregated content should have main categories that correspond to the general content of the meaning. In addition, there are more specific subcategories. For example, for the Sports category, some possible subcategories are Hockey or Football.
For this, the Fuzzy fingerprints classifier is used, which defines the main categories for each type of aggregated content. For content types like articles and blogs, which contain a lot of
text, this module uses the Fuzzy fingerprints method [109]. In the case of the comments
and reviews, which are less wordy, it uses the Twitter Topic Fuzzy Fingerprints method [93].
To detect the main category of the content, the fingerprint of the category is created, based on a set of training datasets containing the entities that are known to be associated with the category. The fingerprints are stored in the PostgreSQL database.
If the classifier receives ambiguous results, a rule-based approach comes into action, which uses domain logic associated with the properties of the document being analyzed.
7.6 Attribute-based and SVM classifiers
The idea to use the Attribute-based classifier was adopted from the GENIE expert system's
design J94!. It is a rule-based process that finds the subcategories of processed documents according to their properties and based on the main category found in the previous step by the Fuzzy fingerprints' classifier.
In the last step, the SVM classifier is used, built using the Support Vector Machine method[110, 111]. SVM classifier looks for matching patterns to retrieve subcategories that were probably not found by the attribute-based classifier.
8 Conclusions
The problem of content categorization is very relevant for a content aggregator that collects huge amounts of data. For this reason, an expert system architecture has been presented that classifies aggregated content using a combination of a rule-based approach and neural networks.
To find an architectural solution that is suitable for the current subject area, a study was made of the advantages and disadvantages of the expert system. Research has shown that expert systems can be very expensive, and data acquisition is often resource-intensive and time-consuming.
On the other hand, expert systems are fast and can solve problems in real-time. The proposed architecture is a hybrid solution that uses a rules-based approach to overcome the errors made by the neural network. It is expected to be more efficient than just using a rules-based approach and be able to recognize more patterns.
The proposed system has a spam classifier module that uses a combination of a rule-based approach and a neural network to detect spam in aggregated content. There is also a Fuzzy fingerprints classifier that defines the main categories for each type of aggregated content, and a rule-based approach is used to correct the results. The Attribute-based classifier defines the sub-categories of content to be processed, and the SVM classifier is used to improve the results on the final step. The proposed system is flexible and additional components can be easily added to it.
This paper also provides an overview of expert systems' development tools. It has been shown that there are many available frameworks and programming languages that are used in the development of expert systems. The author's choice is CLIPS, portable, extensible, well-documented public domain software.
Библиография
1. Басманов С.Н., Басманова А. А. Обзор эволюции экспертных систем в медицине с точки зрения соответствия основным признакам // Перспективы развития информационных технологий. 2014. №21. URL:
https ://cyberleninka.ru/article/n/obzor-evolyutsii-ekspertnyh-sistem-v-meditsine-s-tochki-zreniya-sootvetstviya-osnovnym-priznakam (last accessed: 02.12.2021).
2. Посвалюк Н. Э., Погорелов С. А. Разработка экспертной системы для определения предиктивных рисков заболеваний // Региональные проблемы. 2018. №4. URL: https ://cyberleninka.ru/article/n/razrabotka-ekspertnoy-sistemy-dlya-opredeleniya-prediktivnyh-riskov-zabolevaniy (last accessed: 02.12.2021).
3. S. N. Islam. Expert System Shell for Developing Multi Crop Expert Systems //
AFITA/WCCA 2018 Conference. 2018. URL:
https://www.researchgate.net/publication/335383070 (last accessed: 02.12.2021).
4. Макаров О. Ю., Репников В.Д., Турецкий A.B. Применение экспертной системы для анализа результатов моделирования радиоэлектронных средств на механические воздействия // Вестник ВГТУ. 2013. №6-3. URL:
https ://cyberleninka.ru/article/n/primenenie-ekspertnoy-sistemy-dlya-analiza-rezultatov-modelirovaniya-radioelektronnyh-sredstv-na-mehanicheskie-vozdeystviya (last accessed: 02.12.2021).
5. G. V. Komlev, A. S. Mitrofanova. Expert systems // Тенденции развития науки и образования. 2019. URL: http://dx.doi.org/10.18411/lj-10-2019-28 (last accessed: 02.12.2021).
6. Држевецкий Юрий Алексеевич, Затылкин Александр Валентинович, Юрков Николай Кондратьевич Экспертные системы как Прикладная область искусственного интеллекта // НиКа. 2011. №. URL: https://cyberleninka.ru/article/n/ekspertnye-sistemy-kak-prikladnaya-oblast-iskusstvennogo-intellekta (last accessed: 02.12.2021).
7. Bruce G Buchanan, E. A. Feigenbaum, J. Lederberg. Heuristic DENDRAL: A program for generating explanatory hypotheses in organic chemistry // Machine learning and heuristic data. 1968. URL: https://www.researchgate.net/publication/23622692 (last accessed: 02.12.2021).
8. R. B. McCammon. PROSPECTOR II — an expert system for mineral deposit models // International Journal of Rock Mechanics and Mining Sciences & Geomechanics Abstracts. 1996. №6. URL: https://doi.org/10.1016/0148-9062(96)81891-2 (last accessed: 02.12.2021).
9. Haider Khalaf Jabbar, Rafiqul Zaman Khan. Development of Expert Systems Methodologies and Applications // International Journal of Information Technology & Management Information System (IJITMIS). 2015. №6(2). URL: https://www.researchgate.net/publication/350804010 (last accessed: 02.12.2021).
10. Limao Zhang, Yue Pan, Xianguo Wu, Mirostew J. Skibniewski. Artificial Intelligence in Construction Engineering and Management / Springer. 2021.-263 p.
11. Rajesh Singh, Anita Gehlot, Mahesh Kumar Prajapat, Bhupendra Singh. Artificial Intelligence in Agriculture / CRC Press. 2021.-176 p.
12. Abdel-Rahman kh. El-Dalabeeh, Mohammed Said AlZughoul. The Impact of Expert Systems on Enhancing the General Controls over the Computerized Accounting Information Systems // International Journal of Academic Research in Accounting, Finance and Management Sciences. 2019. №9(4). URL:
http://dx.doi.org/10.6007/IJARAFMS/v9-i4/6838 (last accessed: 02.12.2021).
13. Lei Xing, Maryellen L. Giger, James K. Min. Artificial Intelligence in Medicine: Technical Basis and Clinical Applications / Academic Press. 2020.
14. J.C. van Dijk, P. Williams. Expert Systems in Auditing / Palgrave Macmillan, London. 1990. - 192 pp. URL: https://doi.org/10.1007/978-1-349-12474-9 (last accessed: 02.12.2021).
15. Daniel O'Leary. Audit and Security Issues with Expert Systems / Amer Inst of Certified Public. 1992.-29 p.
16. Y. Kilani, E. Haikal. Exploitation of expert system in identifying organizational ethics through controlling decision making process // Management Science Letters. 2020. №10(7). URL: http://dx.doi.org/10.5267/j.msl.2019.12.026 (last accessed: 02.12.2021).
17. Antoine Richard, Brice Mayag, François Talbot, Alexis Tsoukias, Yves Meinard. What
does it mean to provide decision support to a responsible and competent expert?: The case of diagnostic decision support systems // EURO Journal on Decision Processes. 2020. №8. URL: https://doi.org/10.1007/s40070-020-00116-7 (last accessed: 02.12.2021).
18. Alvine Boaye Belle, Timothy C. Lethbridge, Miguel Garzón, Opeyemi O. Adesina. Design and implementation of distributed expert systems: On a control strategy to manage the execution flow of rule activation // Expert Systems with Applications. 2018. №96. URL: https://doi.org/10.1016/j.eswa.2017.11.033 (last accessed: 02.12.2021).
19. C. Grosan, A. Abraham. Rule-Based Expert Systems. In intelligent Systems. // Springer. 2011. №17. URL: https://doi.org/10.1007/978-3-642-21004-4_7 (last accessed: 02.12.2021).
20. M. M. Syiam. A neural network expert system for diagnosing eye diseases // Proceedings of the tenth conference on artificial intelligence for applications, IEEE. 1994. URL: https://doi.org/10.1109/CAIA.1994.323624 (last accessed: 02.12.2021).
21. Fu Zetian, Xu Feng, Zhou Yun, Zhang XiaoShuan. Pig-vet: a web-based expert system for pig disease diagnosis // Expert Systems with Applications. 2005. №29(1). URL: https ://doi.org/10.1016/j.eswa.2005.01.011 (last accessed: 02.12.2021).
22. P. S. K. Patra, D. P. Sahu, I. Mandal. An expert system for diagnosis of human diseases // International Journal of Computer Applications. 2010. URL:
https ://www.ijcaonline.org/journal/number13/pxc387439.pdf (last accessed: 02.12.2021).
23. R. Borgohain, S. Sanyal. Rule Based Expert System for Diagnosis of Neuromuscular Disorders. // International Journal of Advance Networking and Applications. 2012. URL: https://www.researchgate.net/publication/228445821 (last accessed: 02.12.2021).
24. Rung-Ching Chen, Yun-Hou Huang, Cho-Tsan Bau, Shyi-Ming Chen. A recommendation system based on domain ontology and SWRL for anti-diabetic drugs selection // Expert Systems with Applications. 2012. №4 (39). URL:
https ://doi.org/10.1016/j.eswa.2011.09.061 (last accessed: 02.12.2021).
25. H. Alder, B.A. Michel, C. Marx, G. Tamborrini, T. Langenegger, P. Bruehlmann, J. Steurer and L.M. Wildi. Computer-based diagnostic expert systems in rheumatology: Where do we stand in 2014? // International journal of rheumatology. 2014. URL: http://dx.doi.org/10.1155/2014/672714 (last accessed: 02.12.2021).
26. V. Rawte, B. Roy. Thyroid Disease Diagnosis using Ontology based Expert System // International Journal of Engineering Research and Technology. 2015. №4 (6). URL: http://dx.doi.org/10.17577/IJERTV4IS060415 (last accessed: 02.12.2021).
27. A. M. Karim, F. V. Qelebi, A. S. Mohammed. Lecture Notes on Software Engineering // Software development for blood disease expert system. 2016. №4 (3). URL: https://www.researchgate.net/publication/330015519 (last accessed: 02.12.2021).
28. Han Liu, Alexander Gegov, Mihaela Cocea. Rule Based Systems for Big Data. A Machine Learning Approach / Springer International Publishing. 2016. - 121 pp.
29. Patrick Henry Winston. The psychology of computer vision // Pattern Recognition. 1976. URL: https://doi.org/10.1016/0031-3203(76)90020-0 (last accessed: 02.12.2021).
30. Simon C. K. Shiu, James N. K. Liu, Daniel S. Yeung. Formal description and verification of Hybrid Rule/Frame-based Expert Systems // Expert Systems with Applications. 1997. URL: https://doi.org/10.1016/S0957-4174(97)00027-4 (last accessed: 02.12.2021).
31. Sanja Petrovic, Ivan Obradovic. Frame-based blackboard expert system for signal
processing // Expert Systems with Applications. 1994. URL:
https://doi.org/10.1016/0957-4174(94)90028-0 (last accessed: 02.12.2021).
32. D. Wright, D. Stanley, H. C. Chen, A. W. Shultz, J. H. Fang. A Frame-Based Expert System to Identify Minerals in Thin Section // Microcomputer Applications in Geology 2. 1990. URL: https://doi.org/10.1016/B978-0-08-040261-1.50030-1 (last accessed: 02.12.2021).
33. Sai Kiran Yelagandula. Designing an AI Expert System // SSRN Electronic Journal. 2020. URL: http://dx.doi.org/10.2139/ssrn.3735724 (last accessed: 02.12.2021).
34. Andreas Heiß, Dimitrios S. Paraforos, Galibjon M. Sharipov, Hans W. Griepentrog. Modeling and simulation of a multi-parametric fuzzy expert system for variable rate nitrogen application // Computers and Electronics in Agriculture. 2021. URL: https://doi.org/10.1016/jj.compag.2021.106008 (last accessed: 02.12.2021).
35. M. Jayalakshmi, Lalit Garg, K. Maharajan, K. Jayakumar, Kathiravan Srinivasan, Ali Kashif Bashir, K. Ramesh. Fuzzy Logic-Based Health Monitoring System for COVID'19 Patients // Computers, Materials & Continua. 2021. №2. URL: http://dx.doi.org/10.32604/cmc.2021.015352 (last accessed: 02.12.2021).
36. Fernando Basquiroto de Souza, Émilin de Jesus Casagrande de Souza, Merisandra Côrtes de Mattos Garcia, Kristian Madeira. A fuzzy logic-based expert system for substrate selection for soil construction in land reclamation // REM-International Engineering Journal. 2018. URL: https://doi.org/10.1590/0370-44672017710155 (last accessed: 02.12.2021).
37. J. E. de Tomas Sánchez, S. de Tomás Marín, V. P. Clavell. FESAEI: a fuzzy rule-based expert system for the assessment of environmental impacts // Environ Monit Assess. 2018. URL: https://doi.org/10.1007/s10661-018-6907-9 (last accessed: 02.12.2021).
38. Samir Hadj Miloud, Kaddour Djili, Mohamed Benidir. Fuzzy Logic Expert System for Classifying Solonchaks of Algeria // Applied and Environmental Soil Science. 2018. URL: https://doi.org/10.1155/2018/8741567 (last accessed: 02.12.2021).
39. Ranjit Kaur, Vishu Madaan, Prateek Agrawal. Fuzzy Expert System to Calculate the Strength/ Immunity of a Human Body // Indian Journal of Science and Technology. 2016. URL: https://dx.doi.org/10.17485/ijst/2016/v9i44/105145 (last accessed: 02.12.2021).
40. O. C. Pires, C. Palma, J. C. Costa, I. Moita, M. M. Alves, E. C. Ferreira. Knowledge-based fuzzy system for diagnosis and control of an integrated biological wastewater treatment process // Water Sci Technol. 2006. URL: https://doi.org/10.2166/wst.2006.136 (last accessed: 02.12.2021).
41. G. F. Krivulia, Rami J. Matarneh Expert systems using fuzzy logic // Радиоэлектроника и информатика. 1998. №1 (2). URL: https://cyberleninka.ru/article/n/expert-systems-using-fuzzy-logic (last accessed: 02.12.2021).
42. Rafeek M. Kottai, A. Terry. Expert systems made with neural networks // International Journal of Neural Networks. 1989. №4. URL:
http://sysengr.engr.arizona.edu/publishedPapers/ExSysNN.pdf (last accessed : 02.12.2021).
43. N. DeClaris, Mu-Chun Su. A neural network based approach to knowledge acquisition and expert systems // Proceedings of IEEE Systems Man and Cybernetics Conference-SMC. 1993. URL: http://dx.doi.org/10.1109/ICSMC.1993.384948 (last accessed: 02.12.2021).
44. Krishna Anand, Elliriki Mamatha, Chandra S. Reddy, Mani Prabha. Design of Neural Network Based Expert System for Automated Lime Kiln System // Journal Européen des
Systèmes Automatisés. 2016. №4. URL: https://doi.org/10.18280/jesa.520406 (last accessed: 02.12.2021).
45. Murat H. Sazli. A brief review of feed-forward neural networks // Communications Faculty of Science University of Ankara. 2006. URL: http://dx.doi.org/10.1501/0003168 (last accessed: 02.12.2021).
46. Mohd. Aquib Ansari, Dushyant Kumar Singh. An expert video surveillance system to identify and mitigate shoplifting in megastores // Multimedia Tools and Applications. 2021. URL: https://doi.org/10.1007/s11042-021-11438-2 (last accessed: 02.12.2021).
47. Varsha S. Lalapura, J. Amudha, Hariramn Selvamuruga Satheesh. Recurrent Neural Networks for Edge Intelligence: A Survey // ACM Comput. 2021. URL: https://doi.org/10.1145/3448974 (last accessed: 02.12.2021).
48. Sepp Hochreiter, Jürgen Schmidhuber. LSTM can solve hard long time lag problems // Advances in Neural Information Processing Systems. 1996. URL: https://www.researchgate.net/publication/221620298 (last accessed: 02.12.2021).
49. C. Mahesh, E. Kannan, M. S. Saravanan. Generalized regression neural network based expert system for hepatitis B diagnosis // Journal of Computer Science. 2014. URL: http://dx.doi.org/10.3844/jcssp.2014.563.569 (last accessed: 02.12.2021).
50. D. F. Specht. A general regression neural network // IEEE Transactions on Neural Networks. 1991. №2(6). URL: http://dx.doi.org/10.1109/72.97934 (last accessed: 02.12.2021).
51. Exsys Corvid® Expert System Development Tool [Website]. URL: http://www.exsys.com/exsyscorvid.html (last accessed: 02.12.2021).
52. §tefan Cristian Gherghina. An Artificial Intelligence Approach towards Investigating Corporate Bankruptcy // Review of European Studies. 2015. №7. URL: http://dx.doi.org/10.5539/res.v7n7p5 (last accessed: 02.12.2021).
53. Mahir Essaheb,Ibrahim Mohamed Al-Harkan. An expert system for powder selection using EXSYS-CORVID // Research Journal of Applied Sciences, Engineering and Technology. 2014. №7(10). URL: http://dx.doi.org/10.19026/rjaset.7.488 (last accessed: 02.12.2021).
54. S. Dewanto, J. Lukas. Expert system for diagnosis pest and disease in fruit plants // EPJ Web of Conferences. 2014. URL: https://doi.org/10.1051/epjconf/20146800024 (last accessed: 02.12.2021).
55. L. IoniÇa, I. IoniÇa. Expert-GOSP-Expert system for three-phase separator diagnosis // Studies in Informatics and Control. 2015. №3. URL: http://dx.doi.org/10.24846/v24i3y201506 (last accessed: 02.12.2021).
56. M. L. Sanyang, S. M. Sapuan. Development of expert system for biobased polymer material selection: food packaging appl ication // J Food Sci Technol. 2015. URL: https://doi.org/10.1007/s13197-015-1759-6 (last accessed: 02.12.2021).
57. CLIPS. A Tool for Building Expert Systems [Website]. URL: http://www.clipsrules.net (last accessed: 02.12.2021).
58. Brij Nandan Tripathi, Anil Kumar Agrawal, Dipankar Ray, Somnath Chattopadhyaya. Expert system to select tunnel boring machine (TBM) // IOP Conference Series: Materials Science and Engineering. 2019. URL: https://doi.org/10.1088/1757-899X/691/1/012012 (last accessed: 02.12.2021).
59. A. Y. Yurin, N. O. Dorodnykh, O. A. Nikolaychuk, M. A. Grishenko. Prototyping Rule-Based Expert Systems with the Aid of Model Transformations // Journal of Computer Science. 2018. URL: https://doi.org/10.3844/jcssp.2018.680.698 (last accessed: 02.12.2021).
Leon Rothkrantz. Personalized Digital Fitness Coach // International Conference on Computer Systems and Technologies '21 (CompSysTech '21). 2021. URL: https://doi.org/10.1145/3472410.3472412 (last accessed: 02.12.2021).
61. M. Strauss. Jess The Java Expert System Shell // Seminar AI Tools. 2007. URL: https://cupdf.com/download/tutorial-jess (last accessed: 02.12.2021).
62. M. Thirumaran, P. Banupriya. Dynamic Interactive Voice Response System Using Ontology and Java Expert System Shell // Procedia Computer Science. 2015. URL: https://doi.org/10.1016/jJ.procs.2015.10.049 (last accessed: 02.12.2021).
63. A. Gnanasekar, R. M. Suresh. Rule Based Fine Tuned Web Service Discovery using JESS // Research Journal of Applied Sciences, Engineering and Technology. 2015. URL: http://dx.doi.org/10.19026/rjaset.10.2464 (last accessed: 02.12.2021).
64. D. Vitkus, J. Salter, N. Goranin, D. Ceponis. Method for attack tree data transformation and import into it risk analysis expert systems // Applied Sciences. 2020. URL: https://doi.org/10.3390/app10238423 (last accessed: 02.12.2021).
65. Saima Munawar, Saba Khalil Toor, Muhammad Aslam, Esma Aimeur. PACA-ITS: A MultiAgent System for Intelligent Virtual Laboratory Courses // Applied Sciences. 2019. URL: https://doi.org/10.3390/app9235084 (last accessed: 02.12.2021).
66. B. Mikö, Z. Zoller. Expert System Developing in Kappa Pc and Level5 Object Shells // Budapest University of Technology and Economics. 2000. URL: http://www.uni-obuda.hu/users/mikob/2000mc.pdf (last accessed: 02.12.2021).
67. E. Lamma, L. Maestrami, P. Mello, F. Riguzzi, S. Storari. Rule-based Programming for Building Expert Systems: A Comparison in the Microbiological Data Validation and Surveillance Domain // Electronic Notes in Theoretical Computer Science. 2001. URL: https://doi.org/10.1016/S1571-0661(04)00299-3 (last accessed: 02.12.2021).
68. T. C. Nian, T. C. Fai. A Fault Diagnosis Expert System for Commercial Bus Manufacturing process // International Journal of Engineering & Technology. 2018. URL: http://dx.doi.org/10.14419/ijet.v7i3.17.16624 (last accessed: 02.12.2021).
69. Resdiansyah. Smart advisory system for urban mobility scheme: South east Asia experiences // Geographia Technica. 2019. URL:
http://dx.doi.org/10.21163/GT_2019.141.25 (last accessed: 02.12.2021).
70. P. A. Flach. Simply logical-intelligent reasoning by example / Wiley professional computing. 1994. - 231 pp.
71. Ulf Nilsson, Jan Maluszynski. Logic, Programming and Prolog (2ed) / John Wiley & Sons Ltd. 1995. - 282 pp.
72. Ivan Bratko. Prolog Programming for Artificial Intelligence (4th Edition) / Pearson Education Canada. 2011. - 423 pp.
73. Dave Westwood. Flex Expert System Toolkit / Logic Programming Associates Ltd. 1996. - 251 pp.
74. K. Sambasivarao, D. Kavin Raj, Deepika Dua. An Expert System for Site Selection of Thermal Power Plants // Journal of Basic and Applied Engineering Research. 2014. URL: https://www.researchgate.net/publication/266735461 (last accessed: 02.12.2021).
75. G. Melioli, C. Spenser, G. Reggiardo, G. Passalacqua, E. Compalati, A. Rogkakou, A. M. Riccio, E. Di Leo, E. Nettis, G. W. Canonica. World Allergy Organization Journal. 2014. URL: https://doi.org/10.1186/1939-4551-7-15 (last accessed: 02.12.2021).
76. G2 Standard [Website]. URL: http://dev.gensym.com/platforms/g2-standard/ (last accessed: 02.12.2021).
77. K. Muniappen, B. Genc. Dynamic simulation of an opencast coal mine: a case study // International Journal of Coal Science and Technology. 2020. URL:
https://doi.org/10.1007/s40789-019-00287-y (last accessed: 02.12.2021).
78. Suzanne S. Farid, John Washbrook, Nigel J. Titchener-Hooker. Modelling biopharmaceutical manufacture: Design and implementation of SimBiopharma // Computers & Chemical Engineering. 2007. URL:
https://doi.org/10.1016/j.compchemeng.2006.10.020 (last accessed: 02.12.2021).
79. K. Eyasu, W. Jimma, T. Tadesse. Developing a Prototype Knowledge-Based System for Diagnosis and Treatment of Diabetes Using Data Mining Techniques // Ethiopian journal of health sciences. 2020. URL: https://doi.org/10.4314/ejhs.v30i1.15 (last accessed: 02.12.2021).
80. VisiRule Expert Systems Software [WebSite]. URL: https://www.visirule.co.uk/ (last accessed: 02.12.2021).
81. Ismail Muraina, Imran A Adeleke. Researchers' Artificial Intelligence Expert System Rule-Based Decision Making Using Visirule // International Journals of Sciences and High Technologies. 2021. URL: http://dx.doi.org/10.52155/ijpsat.v28.1.3454 (last accessed: 02.12.2021).
82. J. K. C. Kingston. Knowledge based system development tools // AIAI, University of Edinburgh, Scotland. 2000. URL: https://www.researchgate.net/publication/321225118 (last accessed: 02.12.2021).
83. A. Wichert. Categorial expert systems // Expert Systems. 2004. URL: http://dx.doi.org/10.1111/j.1468-0394.2004.00261.x (last accessed: 02.12.2021).
84. B. S. Todd. An introduction to expert systems / Univ. Oxf. Computing Lab., Programming Research Gp. 1992. - 95 pp.
85. A. Wichert. A categorical expert system "Jurassic" // Expert Systems with Applications. 2000. URL: https://doi.org/10.1016/S0957-4174(00)00029-4 (last accessed: 02.12.2021).
86. D. N. Osherson. New axioms for the contrast model of similarity // Journal of Mathematical Psychology. 1987. URL:
http://www.princeton.edu/~osherson/papers/jmp.pdf (last accessed: 02.12.2021).
87. Kunjal Mankad. Expert System Design to categorize Multiple Intelligence of Students // The IUP Journal of Computer Sciences. 2015. №3. URL:
https://www.researchgate.net/publication/281550381 (last accessed: 02.12.2021).
88. H. Zakeri, F. M. Nejad, A. Fahimifar, A. D. Torshizi, M. H. F. Zarandi. A multi-stage expert system for classification of pavement cracking // Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS). 2013. URL: https://doi.org/10.1109/IFSA-NAFIPS.2013.6608558 (last accessed: 02.12.2021).
89. S. Sahin, M. R. Tolun, R. Hassanpour. Hybrid expert systems: A survey of current approaches and appli cations // Expert Systems with Applications. 2012. URL: https://doi.org/10.1016/j.eswa.2011.08.130 (last accessed: 02.12.2021).
90. M. H. Fazel Zarandi, A. Doostparast Torshizi, I. B. Turksen, B. Rezaee. A new indirect approach to the type-2 fuzzy systems modeling and design // Information Sciences. 2013. URL: https://doi.org/10.1016/j~.ins.2012.12.017 (last accessed: 02.12.2021).
91. E. Styvaktakis, M. H. J. Bollen, I. Y. H. Gu. Expert system for voltage dip classification and analysis // Power Engineering Society Summer Meeting. 2001. URL: https://doi.org/10.1109/PESS.2001.970122 (last accessed: 02.12.2021).
92. J. P. Carvalho, H. Rosa, G. Brogueira, F. Batista. MISNIS: An intelligent platform for twitter topic mining // Expert Systems with Applications. 2017. URL: https://doi.org/10.1016/jj.eswa.2017.08.001 (last accessed: 02.12.2021).
93. H. Rosa, F. Batista, J. P. Carvalho. Twitter Topic Fuzzy Fingerprints // IEEE International Conference on Fuzzy Systems. 2014. URL: https://doi.org/10.1109/FUZZ-IEEE.2014.6891781 (last accessed: 02.12.2021).
94. A. Garrido, M. Buey, S. Escudero, A. Peiro, S. Ilarri, E. Mena. The GENIE Project-A Semantic Pipeline for Automatic Document Categorisation // Proceedings of the 10th International Conference on Web Information Systems and Technologies. 2014. URL: https://doi.org/10.5220/0004750601610171 (last accessed: 02.12.2021).
95. T. Bergmanis, S. Goldwater. Context sensitive neural lemmatization with Lematus // Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). 2018. URL: http://dx.doi.org/10.18653/v1/N18-1126 (last accessed: 02.12.2021).
96. S. Sekine, E. Ranchhod. Named Entities: Recognition, Classification and Use / John Benjamins Publishing Company. 2009.-176 pp. URL: https://doi.org/10.1075/bct.19 (last accessed: 02.12.2021).
97. G. Salton, C. Buckley. Term-weighting approaches in automatic text retrieval // Information Processing & Management. 1988. URL: https://doi.org/10.1016/0306-4573(88)90021-0 (last accessed: 02.12.2021).
98. M. F. Goodchild, L. L. Hill.Introduction to digital gazetteer research // International Journal of Geographical Information Science. 2008. URL: https://doi.org/10.1080/13658810701850497 (last accessed: 02.12.2021).
99. A. Garrido, A. Peiro, S. Ilarri. Hypatia: An Expert System Proposal for Documentation Departments // Proceedings of the SISY 2014-IEEE 12th International Symposium on Intelligent Systems and Informatics. 2014. URL:
http://dx.doi.org/10.1109/SISY.2014.6923608 (last accessed: 02.12.2021).
100. V. Shkapenyuk, T. Suel. Design and implementation of a high-performance distributed Web crawler // 18th International Conference on Data Engineering. 2002. URL: https://doi.org/10.1109/ICDE.2002.994750 (last accessed: 02.12.2021).
101. PostgreSQL: The World's Most Advanced Open Source Relational Database [Website]. URL: https://www.postgresql.org (last accessed: 02.12.2021).
102. RabbitMQ [Website]. URL: https://www.rabbitmq.com (last accessed: 02.12.2021).
103. A. Jabbar, S. Iqbal, M. I. Tamimy. Empirical evaluation and study of text stemming algorithms // Artifcial Intelligence Review. 2020. URL: https://doi.org/10.1007/s10462-020-09828-3 (last accessed: 02.12.2021).
104. Y. Zhang, Y. Zhou, J. T. Yao. Feature Extraction with TF-IDF and Game-Theoretic Shadowed Sets // Information Processing and Management of Uncertainty in Knowledge-Based Systems. IPMU 2020. Communications in Computer and Information Science. 2020. URL: https://doi.org/10.1007/978-3-030-50146-4_53 (last accessed: 02.12.2021).
105. J. Choi, C. Jeon. Cost-Based Heterogeneous Learning Framework for Real-Time Spam Detection in Social Networks with Expert Decisions // IEEE Access. 2021. №9. URL: http://dx.doi.org/10.1109/ACCESS.2021.3098799 (last accessed: 02.12.2021).
106. Md Khairul Islam, Al Amin, Rakibul Islam. Spam-Detection with Comparative Analysis and Spamming Words Extractions // 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO). 2021. URL: https://doi.org/10.1109/ICRITO51393.2021.9596218 (last accessed: 02.12.2021).
107. Huiting Zheng, Jiabin Yuan, Long Chen. Short-Term Load Forecasting Using EMD-LSTM Neural Networks with a Xgboost Algorithm for Feature Importance Evaluation //
Energies. 2017. URL: https://doi.org/10.3390/en10081168
108. Chih-Hung Wu. Behavior-based spam detection using a hybrid method of rule-based
techniques and neural networks // Expert Systems with Applications. 2009. URL: https://doi.org/10.1016/j.eswa.2008.03.002 (last accessed: 02.12.2021).
109. N. Homem, J. P. Carvalho. Authorship identification and author fuzzy fingerprints // 30th Annual Conference of the North American Fuzzy Information Processing Society, NAFIPS2011. 2011. URL: http://dx.doi.org/10.1109/NAFIPS.2011.5751998 (last accessed: 02.12.2021).
110. T. Joachims. Text Categorization with Support Vector Machines // Proc. European Conf. Machine Learning (ECML'98). 1998. URL: http://dx.doi.org/10.17877/DE290R-5097 (last accessed: 02.12.2021).
111. E. Erlin, U. Rio, Rahmiati. Text message categorization of collaborative learning skills in online discussion using support vector machine // 2013 International Conference on Computer, Control, Informatics and Its Applications (IC3INA). 2013. URL: http://dx.doi.org/10.1109/IC3INA.2013.6819190 (last accessed: 02.12.2021).
Результаты процедуры рецензирования статьи
Рецензия скрыта по просьбе автора
