CC BY
54
Principles of Efficiency and Safety Assessment in Using Exoskeletons for Patients with Lower Limb Paralyses (Review)
DOI: 10.17691/stm2016.8.4.28 Received May 12, 2016
©N.N. Rukina, MD, PhD, Senior Researcher, Department of Functional Diagnostics;
A.N. Kuznetsov, Junior Researcher, Department of Functional Diagnostics;
V.V. Borzikov, Junior Researcher, Scientific and Clinical Department;
O.V. Komkova, Physician, Department of Functional Diagnostics;
A.N. Belova, MD, DSc, Professor, Head of the Department of Functional Diagnostics
Privolzhsky Federal Research Medical Center, Ministry of Health of the Russian Federation,
18 Verkhne-Volzhskaya naberezhnaya St., Nizhny Novgorod, 603155, Russian Federation
In rehabilitation of patients who have lost their ability to move independently due to the paralysis of lower limbs, using exoskeletons is a perspective direction. In recent years a great number of robotic devices improving walking of people with lower paraparesis have been developed. However, their comparison is hindered since there are no standardized approaches to the assessment of their efficiency and safety. In this review, general principles of evaluating external robotic devices have been presented, and methods of determining safety and convenience of exoskeleton usage have been analyzed. Assessment of qualitative and quantitative parameters of exoskeleton-assisted walking has also been considered. The characteristic of the questionnaires, standard tests and biochemical investigations, which are used in approbation of exoskeletal devices in people with paraplegia has been presented. Possible ways of evaluating energy expenditure when moving in exoskeletons are shown. The need of elaborating a unified evaluation strategy of walking in exoskeletons has been substantiated.
Key words: exoskeleton; assessment of walking; approbation of exoskeleton devices; paralysis of the lower limbs.
Introduction. Bioengineering devices, enhancing functional capabilities of patients with pathology of the musculoskeletal apparatus, include, among others, exoskeletons, which are special constructions that are put on a man in the form of an external frame, reproduce the biomechanics of his movements, improve muscular power, and reduce metabolic expenditure for walking [1-7]. In rehabilitation medicine, the development of exoskeletons for patients who have lost the ability to ambulate due to paralyzation of the lower limbs, is the most grounded and perspective [8-15]. A sufficient number of models of robotic orthoses and exoskeletons enabling patients with lower paraplegia and paraparesis to stand up and sit down, walk along an even surface and ascend stairs [16-27]. Creation and improvement of such systems require assessment of their efficiency and safety. Nevertheless there are not so many publications on this topic. The majority of these works touch upon more simple robotic devices compared to skeletons [28-31] often using different metrical sets [32-34]. Assessing the efficiency of a new robotic device with functional electrostimulation for patients with lower limb paraparesis, Goldfarb et al. analyzed an average walking speed, heart rate (HR), arterial pressure (AP),
For contacts: Natalya N. Rukina, e-mail: [email protected]
gas exchange, variability of the angles in the pelvic and knee joints [30, 35]. An average walking speed and HR normalized relative to the walking speed served as criteria of evaluation of orthoses for people with paraplegia in the works of Nene, Harvey, Winchester et al. [36-39]. Ohta et al. assessed a robotic orthosis designed for patients with vertebral-cerebrospinal trauma (VCST) using walking speed, step length, amplitude of vertical and lateral displacement of the head in walking [16]. In some cases, in addition to the walking speed, the authors took into consideration the maximal distance the patient could travel without rest using the device [40-42], or the kinematics of motions in the knee or pelvic joints [43]. Kobetic et al. studied the efficiency of a robotic orthosis intended for restoration of the capacity of persons with paraparesis to standing, walking and ascending stairs by analyzing the kinematics of motions in the knee joint [9]. A short analysis of biomechanical parameters was presented also in the work of Jung et al.: the investigators performed a comparative analysis of gaits of patients with spinal cord traumas using robotic devices and without their assistance [44]. In order to evaluate the efficiency of using exoskeletons for rehabilitation of stroke patients Fan et al. analyzed indices of surface electromyogram [45].
Quantitative characteristic of the efficiency of an active lower limb exoskeleton in the work of Neuhaus et al. was given on the basis of walking speed, and an extent of efforts expended on the exoskeleton control was evaluated by registration of the HR, respiration rate, color of the skin; the authors assessed also the stability of standing (ability of the patient to catch a ball), and cognitive efforts (ability to maintain a visual contact) [22]. Apart from walking, of patient's capacity to sit down and stand up in the exoskeleton was estimated in some cases; for this purpose angles in the pelvic and knee joints [46], as well as pressure of the arms on the wheel-chair handles during these maneuvers were used [20, 21].
On the whole, it should be noted that a generally accepted methodology of exoskeleton assessment has not been worked out so far [47-50]. But the analysis of the literature showed, that a great deal of investigations are devoted to the elaboration of the general principles of approbation of novel robotic device, exoskeletons for lower limbs in particular. Approbation of exoskeletons usually includes testing of the walk in the exoskeleton and determination of such indices as energy expenditure, safety, convenience and simplicity of using the external device [24, 51]. These approaches to approbation are valid for all types of lower limb exoskeletons, making it possible to compare different variants of exoskeleton devices [52, 53].
General principles of exoskeleton approbation
The protocol of investigation should be approved by the local ethic committee in accordance with the requirements of the Declaration of Helsinki of the World Medical Association [54]. Criteria of patient selection for the investigation depend on the designation and technical characteristics of the device. Usually, only one patient [47, 48] or a small group of patients [24] participate in the test. Prior to the clinical trials full information about the work of the exoskeleton, its performance capabilities and limitations is presented to the patients, and they also sign the informed consent for participation in the study. Then the device is individually adjusted to every patient considering the length and circumference of his leg segments, and participants are instructed how to use the exoskeleton. Thus, according to Zeilig et al., informing the patient and individual adjustment of the exoprosthesis takes about 30 min, and training to walk in the exoskeleton is performed with the help of kinesotherapist during several sessions (initially the patient in the exoskeleton is trained to walk with bars, then to move with walkers and only thereafter with crutches) [24]. A physician should always be near the patient to ensure security during exoskeleton testing.
Concurrently with training the exoskeleton is adjusted to provide stability of the leg in the knee joint in the supporting phase and a sufficient lifting of the foot from the floor in the transferring phase [48]. Part of the
patients, according to the authors' observations doubt their ability to learn to use a new device or worry about possible traumatization; to help overcome doubts and fears patients are demonstrated how a trained person after VCST is walking in the exoskeleton. Exoskeletons are tested only if a patient can walk in it a distance not less than 100 m with the help of crutches (according to the data of Zeilig et al.). On average, six patients with VCST required 13.7 training sessions to learn to use exoskeletons [24].
Statistical processing of the results with a small number of observations is usually performed using nonparametric criteria.
Assessing safety and convenience of using exoskeletons
Safety is a first priority requirement to any innovative device of medical designation. Safety of using robotic devices for patients survived VCST is suggested to be evaluated according to the following parameters: occurrence and the number of falls; skin condition (a grazed or reddened skin); joint condition; AP; HR; electrocardiogram (ECG) [24]. Visual examination of the skin in the sites contacting with the exoskeleton, measurements of AP, HR and ECG recording are recommended to perform before and after testing. Pain and fatigability are self-assessed by a patient using visual-analog scale.
In some cases questionnaires are used for safety monitoring. Zeilig et al. [24] elaborated a questionnaire, which contained some statements concerning the assessment of the training process, comfort and safety of wearing an exoskeleton, medical aspects of using an external device: "I felt comfortable in doing exercises in exoskeleton"; "exoskeleton caused no pain"; "I did not get overtired using exoskeleton"; "after a training period it was convenient for me to use exoskeleton"; "a training session in exoskeleton reduced spasticity in the legs"; "I did not feel difficulties in breathing while training in exoskeleton"; "my bowel worked better when I was training to walk in exoskeleton"; "after the training course I feel sure and safe in using exoskeleton". The examined patient evaluated the degree of his agreement or disagreement with each statement using a 5-point Likert scale (strongly disagree (1); disagree (2); neither agree nor disagree (3); agree (4); strongly agree (5)). The sum of assessments of each separate judgment allows for revealing general opinion of a concrete patient, while a mean assessment of the group of examined people can give a characteristic of various aspects of using the exoskeleton.
Safety criteria for using a robotic device depend to some extent on the pathology, which caused paraplegia (VCST, stroke, myelitis, etc.). Thus, in VCST, rentgenography of the vertebra fracture area (or the area of the spinal column fixation) is supposed to be performed before and after the exoskeleton testing for safety monitoring [24].
Assessment of exoskeleton-assisted walking
Assessment of qualitative and quantitative parameters of walking is fulfilled using questionnaires, standardized tests and findings of biomechanical investigations [55, 56]. The analysis of the gait biomechanics in exoskeletal devices is usually performed by the comparison of similar characteristics of other robotic devices or with standard data [24, 43, 51].
Questionnaires for mobility assessment. Evaluating the mobility of patients using exoskeletons, sections of FIM, SCI-FAI and other scales are usually applied [47]. Section "Walking" of the FIM scale (Functional Independence Measure), developed in the 80s of the XX century by the American Academy of Physical Therapy and Rehabilitation as a standard method of measuring vital function impairment in rehabilitation settings of the USA, assesses ambulation of a patient by a 7-point system. According to this scale point "7" corresponds to the ability to walk without any assistance to the distance of more than 17 m [57-59]. Such an assessment, though suitable for patients with any disease, is categorical and rather tentative.
SCI-FAI questionnaire (Spinal Cord Injury Functional Ambulation Inventory) was developed especially for patients with a spinal cord injury in connection with the necessity to evaluate the efficiency of novel devices to restore locomotor functions [60] (Table 1). The test combines categorical (score) and qualitative assessments of walking and includes three sections ("Gait parameters", "Assistive devices", "Temporal/distance characteristics"). In the first two sections evaluation is performed for the right and left leg separately. Section "Parameters" includes 6 indices, which are considered to be most significant in the assessment of the sufferers' gait: support ability, step width, step rhythm, step height, foot contact, step length. The score evaluation was determined empirically: the higher scores were assigned to those indices, which were recognized to be more important for walking. The indices are arranged in a certain sequence requiring examination of the patient first in the frontal and then in the sagittal plane. Equal score for the right and left limb denotes a symmetrical gait. "Assistive devices" section characterizes the efficiency of using orthotics for lower limbs and devices for upper limbs allowing the patient to maintain the balance and to support the body. The score assessment of each device reflects the degree of the assistance, which a given device provides. The "Temporal/distance characteristics" comprises a score evaluation of the walking mode, which is recommended by the authors to be specified with the help of "Walking mobility" scale (Table 2). This scale was worked out by Perry et al. [61] for stroke patients and modified to patients after VCST. Additionally, the results of 2-minute walk test (the distance walked by the patient in 2 min, a walking speed in steps and meters per minute) are recorded in the investigation protocol. The score is summed for each section; a higher score obtained by the patient indicates
a higher level of function. The maximal score for the first section is 20, for the second 14, and for the third one 5. It is not valid to calculate a total score for the whole test, as its sections reflect absolutely different aspects of walking. Reliability, validity and sensitivity of the given measuring tool — SCI-FAI questionnaire — have been confirmed, which enables its use for the assessment of the efficiency of robotic devices intended for improving the ability of sick people to walk independently [60].
Biomechanical investigations. The average walking speed and maximal distance, which an examined patient can go without rest and assistance, are the most universal and accessible for measuring indices, which are evaluated in approbation of innovative robotic devices for lower extremities [36, 62, 63]. For example, approbation of a ReWalk exoskeleton by 12 patients with lower paraplegia showed, that after training sessions all of them could go independently and without rest during 5-10 min, cover the distance about 50-100 m with the speed ranging from 0.03 to 0.45 m/s (0.25 m/s on average) [51]. A more detailed study includes determination of podographic walking parameters (step length, duration of a double step, duration and ratio of leg support/transfer periods) [16, 64-66], as well as kinematic indices (alteration of the angles in the hip and knee joints in movements) [9, 20, 21, 30]. Sensors can be built in the exoskeleton construction [51, 67], or portative systems of movement registration with active markers, e.g. CODA CX1, can be used [24].
In recent years video analysis of movements has become available for a comprehensive analysis of the gait and quantitative evaluation of gait parameters [68, 69]. It enables a detailed study of kinematics, and, in combination with tensodynamometric platforms and electromyography, movement kinetics as well. Patterns of pathological walking can also be determined using this method [70]. Video analysis is being widely used to assess the walking function of patients using lower limb exoskeletons, since an explicit analysis of the obtained data allows for optimization of exoprosthesis design [71, 72]. Application of walking video analysis is of current importance in approbation of exoskeletons as well, since the application of external robotic devices can result in impairment of the normal walking pattern even in healthy people [63, 73-75]. It should be noted, that video analysis of movements in using exoskeletons is connected with some difficulties and requires the development of special investigation models.
Standardized tests. These tests can give quantitative assessment of walking in the exoskeleton, thus minimizing subjective distortion of the results. In accordance with the review devoted to the method of estimation of functional outcomes in patients with paraparesis of lower extremities, three tests are believed to be optimal tools of the assessment: Timed Up and Go (TUG), Six-Minute Walk Test (6 MWT), Ten-Meter Walk Test (10 MWT) [73, 76].
TUG test measures the time needed for a patient to stand up from a sitting position, walk a 3 m distance up to
Table 1
Spinal cord injury functional ambulation inventory SCI-FAI (according to Field-Fote et al., 2001)
Gait parameters Criteria Right limb Left limb
Support ability Lower limb support ability (successive transfer of the body mass to the leg) is preserved
in walking 1 1
The leg is not able to support or support ability is achieved by some assistive devices 0 0
Step width While walking, the leg making a step does not touch the supporting leg 1 1
While walking, the leg making a step touches the supporting leg 0 0
Foot position, when it rests on the floor during walking, does not hinder the next walking
movement by this leg 1 1
Foot position, when it rests on the floor during walking, hinders the next walking
movement by this leg 0 0
Step rhythm When one leg touches the floor with its heel, the other leg starts to perform a walking
movement:
in less than 1 s 2 2
in 1-3 s 1 1
in more than 3 s 0 0
Step height The great toe of the foot does not touch the floor, when performing a walking
movement 2 2
The great toe of the foot touches the floor at the beginning of making a step by a leg 1 1
The great toe of the foot is touching the floor during the whole time of making a step 0 0
Foot contact The heel comes in contact with the floor prior to the forefoot 1 1
The forefoot or the sole comes in contact with the floor prior to the heel 0 0
Step length The heel of the leg, which made a step, appears to be in front of the first toe
of the support leg 2 2
The first toe of the leg, which made a step, appears to be in front of the first toe
of the support leg 1 1
The first toe of the leg, which made a step, appears to be behind the first toe
of the support leg 0 0
Overall
score_/20
Assistive devices Right side LEFT side
For upper limbs (devices for No 4 4
maintaining balance/support) Cane(s) 3 3
Crutch(es) 2 2
Walkers 2
Parallel bars 0
For lower limbs No 3 3
Orthosis for ankle joint /foot 2 2
Orthosis for knee/ankle joint/foot 1 1
Orthosis for the whole lower limb 0 0
Overall
score_/14
Speed/distance of walking
Mobility (walking not assisted Walks regularly in community (never or rarely uses a wheel-chair for the travel) 5 5
by a wheel-chair is implied) Regularly at home/rarely in community 4 4
Sometimes at home/rarely in community 3 3
Rarely at home/never in community 2 2
For exercises only 1 1
Does not walk 0 0
Overall
score_/5
2-min walk test Distance, which the patient walks in two minutes Steps/min Speed/min
Ta bl e 2
Walking mobility: criteria of ambulation status definition (according to Perry et al., 1995; Field-Fote et al., 2001)
Walking Criteria of ambulation status definition
Walking as an exercise Endurance, muscular strength or the degree of assistance are such that make walking nonfunctional. Aid in standing may be needed (walking is used only for exercise)
A restricted walking around the house Is able to walk within the house, but movement is limited by low endurance, muscular strength or demands of safety (rarely walks at home/never in community)
Independent walk around the house Constantly walks the required distances at home. May need assistance in going upstairs within the house. Outside the house a wheelchair may be required (sometimes walks at home/rarely in community)
A limited movement outside the house Walks outside the house and can manage independently doors, low obstacles and curbs. For long distances a wheelchair may be needed (walks regularly at home/never in community)
Independent movement outside the house Can travel the distance approximately equal to 400 m (1/4 mile) with a speed not less than 50% of the normal one. Can provide the safety himself, can manage the stairs, doors, curbs (walks regularly in community (never or rarely uses a wheelchair for travelling)
a rear guiding line (e.g. a mark on the floor), turn around, go back to the chair and sit down again [77]. An initial position of the examined person is sitting on the chair, with HR corresponding to its value at rest. The patient is given a verbal command to stand up, go to the mark, turn, go to the chair, turn and sit down. The time from the verbal command till reaching the sitting position is fixed. 30 s after the test has been completed, HR is registered again. The patient is given the opportunity to train; once a patient has learnt to fulfill the task, he performs the test three times, the time of its performance and HR being registered [47].
A high test-retest reliability of the TUG test was confirmed in patients with various pathologies (stroke, Parkinson's disease, amputation of the limb, cerebellar ataxia etc.) [78-80]. The benefit of this test is a composite evaluation of the main movements (standing, walking, turns, returning to the sitting position) which underlie the mobility and show the person's functional capabilities, therefore its application is justified in the assessment of exoskeleton efficiency [43, 47, 51].
MWT test measures the time, which is necessary for the examined patient to walk a 10-meter distance, not considering the phase of acceleration and slowdown. A ten-meter walkway is marked on the floor along a straight line, designating the start and finish. The patient is instructed to go with a normal comfortable speed. Walking should start several meters before the first mark (acceleration). The time of crossing the first and last mark is fixed. HR is registered before the beginning of the test and 30 s after crossing the second mark. The test is repeated three times, each repetition starts only when HR level reaches the HR values at rest. Like a TUG test, the given test has demonstrated a high degree of validity and reliability in persons with neurological pathology [81-83].
6 MWT test measures a distance, an individual is able to walk over a total of 6 min. Ideally, a person walks straight 30 m (e.g. in the hospital hall), turns around, goes back 30 m more, and does so several times. The patient
is instructed to stand up from the chair and go as far as possible for 6 min. HR is measured in a sitting position before and after completion of the 6-minute walk. The test is repeated three times [47]. Initially this test was intended for assessing the function of cardiovascular and respiratory systems in patients with heart and lung pathology [84], but later it started to be applied for patients with the limited mobility caused by neurological diseases [85-87].
Both 6 MWT and 10 MWT tests allow for evaluation of the walking speed, but both tests are usually used in the investigations, as their scope differs: if the 10 MWT makes it possible to characterize the velocity of movement over a straight short distance, the results of the 6 MWT demonstrate to a more extent the degree of patient endurance and ability to maintain balance when he turns.
On the whole, the effect of the auxiliary robotic device is suggested to assess proceeding from the results of the three above mentioned tests, which complement each other: mean time to accomplish the test (TUG), mean time of 10-min walk (10 MWT) and mean distance walked over 6 min (6 MWT) [47].
Assessment of energy consumption
The efficiency of using exoskeletons requires obligatory evaluation of the efforts, spent by a patient using these devices. The assessment of energy consumption during walking, including the walk in the exoskeleton, can be done by registering oxygen consumed during walking, and the content of carbon dioxide in the expired air, and measuring HR as well [88, 89].
Gas analysis. The most important physiological index, reflecting the level of metabolic processes, is the value of oxygen uptake. With the increase of a physical load, oxygen consumption and the amount of energy spent become greater. Therefore, the most accurate way of defining energy consumption is a method of full gas analysis based on the amount of oxygen consumed and carbon dioxide released, on calculation of respiration
coefficient and respective calorific equivalent of oxygen [90, 91]. The method of gas exchange investigation is rather labor consuming and requires special equipment (e.g. an automated gas analyser). Nevertheless, the analysis of the gas content in the expired air is one of the most widely used methods of evaluating energy consumption in using robotic prostheses; with the help of this method investigators prove the advantages of novel prostheses over mechanical in terms of decreasing energy consumption during their application [91-94]. Though it should be taken into consideration, that, as a rule, patients needing exoskeletons (VCSI, stroke etc.) considerably differ by their physiological reserves from persons requiring limb prosthesis; bulky equipment necessary for investigations does not suite them [47].
Measuring HR. An indirect (surrogate) method of energy expenditure evaluation is registration of HR, which changes proportionally to the intensity of oxygen uptake by the organism, and therefore can indirectly show the level of physical activity and energy expenditure of an individual.
The method of energy expenditure by registering HR is applicable, when comparative data are more important than absolute, in particular, in comparison of energy consumption in walking with an exoskeleton and without it. Two indices are used most frequently: total heart beat index (THBI) [95] and physiological cost index (PCI) [36, 96]. Both these indices are shown to have a high correlation with oxygen uptake, though THBI calculation requires continuous HR monitoring, that is not only a labor and time consuming process, but prevents standartization of this index as well [47]. That is why, PCI is usually calculated as the relation of HR alteration under load (in comparison with HR at rest) to the speed of ambulation [36, 97]:
PCI=(HR under load - HR at rest)/speed of ambulation.
This estimate indicator is shown to be informative in monitoring the load intensity when walking with lower limb orthosis [98] to assess external devices, which improve ambulation in patients with VCSI [37, 38, 99]. In the study of Farris et al., PCI was calculated for all three walking tests (TUG, 10 MWT, 6 MWT), HR being registered before and 30 s after the test [47].
Conclusion. The analysis of publications shows, that exoskeletons are referred to perspective tools of rehabilitating patients with lower limb paralysis, though evidence of their efficiency and safety is necessary. There are no unified approaches to quantitative and comparative assessment of exoskeletons so far, therefore the development of a unified methodology for evaluation of walking in exoskeletons continues to be the task of vital importance.
Study Funding. The work was supported by the Ministry of Education and Science of the Russian Federation within the frames of the Federal targeted program "Research and developments in priority areas of advancement of the Russian scientific and technological complex for 2014-2020"; agreement on subsidy
No.14.578.21.0107 of 27.102015 (Project unique identifier RFMEF157815X0107).
Conflicts of Interest. The authors declare no conflicts of interest.
References
1. Huang V.S., Krakauer J.W. Robotic neurorehabilitation: a computational motor learning perspective. J Neuroeng Rehabil 2009; 6; 5, https://doi.org/10.1186/1743-0003-6-5.
2. Panizzolo F.A., Galiana I., Asbeck A.T., Siviy C., Schmidt K., Holt K.G., Walsh C.J. A biologically-inspired multi-joint soft exosuit that can reduce the energy cost of loaded walking. J Neuroeng Rehabil 2016; 13(1): 43, https://doi. org/10.1186/s12984-016-0150-9.
3. Galle S., Malcolm P., Derave W., De Clercq D. Enhancing performance during inclined loaded walking with a powered ankle-foot exoskeleton. Eur J Appl Physiol 2014; 114(11): 23412351, https://doi.org/10.1007/s00421-014-2955-1.
4. Malcolm P., Derave W., Galle S., De Clercq D. A simple exoskeleton that assists plantarflexion can reduce the metabolic cost of human walking. PLoS One 2013; 8(2): e56137, https://doi.org/10.1371/journal.pone.0056137.
5. Vereikin A., Kovalchuk A., Kulakova D., Semenov S. Analisys and choice of the exoskeleton's actuator kinematic structure. Science and Education of the Bauman MSTU 2014; 7: 72-93, https://doi.org/10.7463/0714.0717676.
6. Vorobiev A.A., Andrutshenko F.A., Zasypkina O.A., Solovieva I.O., Krivonozhkina P.S., Pozdnykov A.M. Terminology and classification of exoskeleton. Vestnik Volgogradskogo gosudarstvennogo meditsinskogo universiteta 2015; 3(55): 71-77.
7. Chen G., Chan C.K., Guo Z., Yu H. A review of lower extremity assistive robotic exoskeletons in rehabilitation therapy. Crit Rev Biomed Eng 2013; 41(4-5): 343-363, https:// doi.org/10.1615/critrevbiomedeng.2014010453.
8. Brown-Triolo D.L., Roach M.J., Nelson K., Triolo R.J. Consumer perspectives on mobility: implications for neuroprosthesis design. J Rehabil Res Deve 2002; 39(6): 6569-669.
9. Kobetic R., To C.S., Schnellenberger J.R., Audu M.L., Bulea T.C., Gaudio R., Pinault G., Tashman S., Triolo R.J. Development of hybrid orthosis for standing, walking, and stair climbing after spinal cord injury. J Rehabil Res Dev 2009; 46(3): 447-462.
10. Schwartz I., Meiner Z. Robotic-assisted gait training in neurological patients: who may benefit? Ann Biomed Eng 2015; 43(5): 1260-1269, https://doi.org/10.1007/s10439-015-1283-x.
11. Benson I., Hart K., Tussler D., van Middendorp J.J. Lower-limb exoskeletons for individuals with chronic spinal cord injury: findings from a feasibility study. Clin Rehabil 2016; 30(1): 73-84, https://doi.org/10.1177/0269215515575166.
12. Aach M., Meindl R.C., GeGmann J., Schildhauer T.A., Citak M., Cruciger O. Exoskeletons for rehabilitation of patients with spinal cord injuries. Options and limitations. Unfallchirurg 2015; 118(2): 130-137, https://doi.org/10.1007/s00113-014-2616-1.
13. Lajeunesse V., Vincent C., Routhier F., Careau E., Michaud F. Exoskeletons' design and usefulness evidence according to a systematic review of lower limb exoskeletons used for functional mobility by people with spinal cord injury.
Disabil Rehabil Assist Technol 2016; 11(7): 535-547, https:// doi.org/10.3109/17483107.2015.1080766.
14. Bortole M., Venkatakrishnan A., Zhu F., Moreno J.C., Francisco G.E., Pons J.L., Contreras-Vidal J.L. The H2 robotic exoskeleton for gait rehabilitation after stroke: early findings from a clinical study. J Neuroeng Rehabil 2015; 12: 54, https:// doi.org/10.1186/s12984-015-0048-y.
15. Fineberg D.B., Asselin P., Harel N.Y., Agranova-Breyter I., Kornfeld S.D., Bauman W.A., Spungen A.M. Vertical ground reaction force-based analysis of powered exoskeleton-assisted walking in persons with motor-complete paraplegia. J Spinal Cord Med 2013; 36(4): 313-321, https://doi.org/10711 79/2045772313Y.0000000126.
16. Ohta Y., Yano H., Suzuki R., Yoshida M., Kawashima N., Nakazawa K. A two-degree-of-freedom motor-powered gait orthosis for spinal cord injury patients. Proc Inst Mech Eng H 2007; 221: 629-639, https://doi. org/10.1243/09544119JEIM55.
17. Suzuki K., Mito G., Kawamoto H., Hasegawa Y., Sankai Y. Intention-based walking support for paraplegia patients with Robot Suit HAL. In: Climbing and walking robots. InTech; 2010, https://doi.org/10.5772/8835.
18. Hasegawa Y., Jang J., Sankai Y. Cooperative walk control of paraplegia patient and assistive system. IEEE International Conference on Intelligent Robots and Systems 2009; https://doi.org/10.1109/iros.2009.5354192.
19. Kwa H.K., Noorden J.H., Missel M., Craig T., Pratt J.E., Neuhaus P.D. Development of the IHMC mobility assist exoskeleton. IEEE International Conference on Robotics and Automation 2009, https://doi.org/10.1109/robot.2009.5152394.
20. Tsukahara A., Hasegawa Y., Sankai Y. Standing-up motion support for paraplegic patient with Robot Suit HAL. IEEE Int Conf Rehabil Robot 2009, https://doi.org/10.1109/ icorr.2009.5209567.
21. Tsukahara A., Kawanishi R., Hasegawa Y., Sankai Y. Sit-to-stand and stand-to-sit transfer support for complete paraplegic patients with Robot Suit HAL. Advanced Robotics 2010; 24(11): 1615-1638, https://doi. org/10.1163/016918610x512622.
22. Neuhaus P.D., Noorden J.H., Craig T.J., Torres T., Kirschbaum J., Pratt J.E. Design and evaluation of Mina: a robotic orthosis for paraplegics. IEEE Int Conf Rehabil Robot 2011, https://doi.org/10.1109/IC0RR.2011.5975468.
23. Strausser K.A., Kazerooni H. The development and testing of a Human Machine Interface for a mobile medical exoskeleton. IEEE International Conference on Intelligent Robots and Systems 2011, https://doi.org/10.1109/ iros.2011.6048674.
24. Zeilig G., Weingarden H., Zwecker M., Dudkiesicz I., Bloch A., Esquenazi A. Safety and tolerance of the ReWalk™ exoskeleton suit for ambulation by people with complete spinal cord injury: a pilot study. J Spinal Cord Med 2012; 35(2): 96101, https://doi.org/10.1179/2045772312Y.0000000003.
25. Tamez-Duque J., Cobian-Ugalde R., Kilicarslan A., Venkatakrishnan A., Soto R., Contreras-Vidal J.L. Real-time strap pressure sensor system for powered exoskeletons. Sensors (Basel) 2015; 15(2): 4550-4563, https://doi. org/10.3390/s150204550.
26. Ekelem A., Murray S., Goldfarb M. Preliminary assessment of variable geometry stair ascent and descent with a powered lower limb orthosis for individuals with paraplegia. Conf Proc IEEE Eng Med Biol Soc 2015; 2015: 4671-4674, https://doi.org/10.1109/EMBC.2015.7319436.
27. Reza S.M., Ahmad N., Choudhury I.A., Ghazilla R.A. A fuzzy controller for lower limb exoskeletons during sit-to-stand and stand-to-sit movement using wearable sensors. Sensors (Basel) 2014; 14(3): 4342-4363, https://doi. org/10.3390/s140304342.
28. Kim H., Lee J., Jang J., Park S., Han C. Design of an exoskeleton with minimized energy consumption based on using elastic and dissipative elements. International Journal of Control, Automation and Systems 2015; 13(2): 463-474, https://doi.org/10.1007/s12555-013-0386-0.
29. Koller J.R. Jacobs D.A., Ferris D.P., Remy C.D. Learning to walk with an adaptive gain proportional myoelectric controller for a robotic ankle exoskeleton. J Neuroeng Rehabil 2015; 12: 97, https://doi.org/10.1186/s12984-015-0086-5.
30. Goldfarb M., Korkowski K., Harrold B., Durfee W. Preliminary evaluation of a controlled-brake orthosis for FES-aided gait. IEEE Trans Neural Syst Rehabil Eng 2003; 11(3): 241-248, https://doi.org/10.1109/TNSRE.2003.816873.
31. Belforte G., Eula G., Appendino S., Sirolli S. Pneumatic interactive gait rehabilitation orthosis: design and preliminary testing. Proc Inst Mech Eng H 2011; 225(2): 158-169.
32. Long Y., Du Z.J., Wang W.D., Dong W. Robust sliding mode control based on GA optimization and CMAC compensation for lower limb exoskeleton. Appl Bionics Biomech 2016; 2016: 5017381, https://doi. org/10.1155/2016/5017381.
33. Lonini L., Shawen N., Scanlan K., Rymer W.Z., Kording K.P., Jayaraman A. Accelerometry-enabled measurement of walking performance with a robotic exoskeleton: a pilot study. J Neuroeng Rehabil 2016; 13: 35, https://doi.org/10.1186/s12984-016-0142-9.
34. Federici S., Meloni F., Bracalenti M., De Filippis M.L. The effectiveness of powered, active lower limb exoskeletons in neurorehabilitation: a systematic review. NeuroRehabilitation 2015; 37(3): 321-340, https://doi.org/10.3233/NRE-151265.
35. Ha K.H., Murray S.A., Goldfarb M. An approach for the cooperative control of FES with a powered exoskeleton during level walking for persons with paraplegia. IEEE Trans Neural Syst Rehabil Eng 2016; 24(4): 455-466, https://doi. org/10.1109/TNSRE.2015.2421052.
36. Nene A.V., Jennings S.J. Physiological cost index of paraplegic locomotion using the ORLAU ParaWalker. Paraplegia 1992; 30: 246-252, https://doi.org/10.1038/ sc.1992.63.
37. Harvey L.A., Davis G.M., Smith M.B., Engel S. Energy expenditure during gait using the walkabout and isocentric reciprocal gait orthoses in persons with paraplegia. Arch Phys Med Rehabil 1998; 79(8): 945-949, https://doi.org/10.1016/ S0003-9993(98)90092-2.
38. Winchester P., Carollo J.J., Habasevich R. Physiologic costs of reciprocal gait in FES assisted walking. Paraplegia 1994; 32(10): 680-686, https://doi.org/10.1038/sc.1994.110.
39. Takahashi K.Z., Lewek M.D., Sawicki G.S. A neuromechanics-based powered ankle exoskeleton to assist walking post-stroke: a feasibility study. J Neuroeng Rehabil 2015; 12: 23, https://doi.org/10.1186/s12984-015-0015-7.
40. Klose K.J., Jacobs P.L., Broton J.G., Guest R.S., Needham-Shropshire B.M., Lebwohl N., Nash M.S., Green B.A. Evaluation of a training program for persons with SCI paraplegia using the Parastep1 ambulation system: part 1. Ambulation performance and anthropometric measures. Arch Phys Med Rehabil 1997; 78: 789-793, https://doi.org/10.1016/ s0003-9993(97)90188-x.
41. Brissot R., Gallien P., Le Bot M.P., Beaubras A., Laisne D., Beillot J., Dassonville J. Clinical experience with functional electrical stimulation-assisted gait with Parastep in spinal cord-injured patients. Spine 2000; 25(4): 501-508, https://doi.org/10.1097/00007632-200002150-00018.
42. Evans N., Hartigan C., Kandilakis C., Pharo E., Clesson I. Acute cardiorespiratory and metabolic responses during exoskeleton-assisted walking overground among persons with chronic spinal cord injury. Top Spinal Cord Inj Rehabil 2015; 21(2): 122-132, https://doi.org/10.1310/sci2102-122.
43. Quintero H.A., Farris R.J., Goldfarb M. A method for the autonomous control of lower limb exoskeletons for persons with paraplegia. ASME J Med Devices 2012; 6(4): 041003, https://doi.org/10.1115/1.4007181.
44. Jung J.Y., Park H., Yang H.D., Chae M. Brief biomechanical analysis on the walking of spinal cord injury patients with a lower limb exoskeleton robot. IEEE Int Conf Rehabil Robot 2013; 2013: 6650351, https://doi.org/10.1109/ ICORR.2013.6650351.
45. Fan Y., Yin Y. Active and progressive exoskeleton rehabilitation using multisource information fusion from EMG and force-position EPP. IEEE Trans Biomed Eng 2013; 60(12): 3314-3321, https://doi.org/10.1109/tbme.2013.2267741.
46. Domingo A., Lam T. Reliability and validity of using the Lokomat to assess lower limb joint position sense in people with incomplete spinal cord injury. J Neuroeng Rehabil 2014; 11: 167, https://doi.org/10.1186/1743-0003-11-167.
47. Farris R.J., Quintero H.A., Murray S.A., Ha K.H., Hartigan C., Goldfarb M. A preliminary assessment of legged mobility provided by a lower limb exoskeleton for persons with paraplegia. IEEE Trans Neural Syst Rehabil Eng 2014; 22(3): 482-490, https://doi.org/10.1109/tnsre.2013.2268320.
48. Murray S.A., Ha K.H., Goldfarb M. An assistive controller for a lower-limb exoskeleton for rehabilitation after stroke, and preliminary assessment thereof. Conf Proc IEEE Eng Med Biol Soc 2014, 2014: 4083-4086, https://doi. org/10.1109/embc.2014.6944521.
49. Murray S.A., Ha K.H., Hartigan C., Goldfarb M. An assistive control approach for a lower-limb exoskeleton to facilitate recovery of walking following stroke. IEEE Trans Neural Syst Rehabil Eng 2014; 1-1, https://doi.org/10.1109/ tnsre.2014.2346193.
50. Afschrift M., De Groote F., De Schutter J., Jonkers I. The effect of muscle weakness on the capability gap during gross motor function: a simulation study supporting design criteria for exoskeletons of the lower limb. BioMed Eng OnLine 2014; 13(1): 111, https://doi.org/10.1186/1475-925x-13-111.
51. Esquenazi A., Talaty M., Packel A., Saulino M. The ReWalk powered exoskeleton to restore ambulatory function to individuals with thoracic-level motor-complete spinal cord injury. Am J Phys Med Rehabil 2012; 91(11): 911-921, https:// doi.org/10.1097/phm.0b013e318269d9a3.
52. Rukina N.N., Kuznetsov A.N., Borzikov V.V., Komkova O.V., Belova A.N. Surface electromyography: its role and potential in the development of exoskeleton (review). Sovremennye tehnologii v medicine 2016; 8(2): 109-118, https://doi.org/10.17691/stm2016.8.2.15.
53. Sozdanie nauchno-issledovatel'skoy laboratorii sovremennykh metodov i robototekhnicheskikh sistem dlya uluchsheniya sredy obitaniya cheloveka [Establishing a research laboratory of modern methods and robotic systems to improve human environment]. URL: http://grant.rscf.ru/prjcard_ int?14-39-00008.
54. WMA Declaration of Helsinki — Ethical Principles for Medical Research Involving Human Subjects. URL: http://www. wma.net/en/30publications/10policies/b3/.
55. del-Ama A.J., Gil-Agudo A, Pons J.L., Moreno J.C. Hybrid gait training with an overground robot for people with incomplete spinal cord injury: a pilot study. Front Hum Neurosci 2014; 8, https://doi.org/10.3389/fnhum.2014.00298.
56. Aach M., Cruciger O., Sczesny-Kaiser M., Hoffken O., Meindl R.Ch., Tegenthoff M., Schwenkreis P., Sankai Y., Schildhauer T.A. Voluntary driven exoskeleton as a new tool for rehabilitation in chronic spinal cord injury: a pilot study. Spine J 2014; 14(12): 2847-2853, https://doi.org/10.1016/j. spinee.2014.03.042.
57. Heinemann A. Relationships between impairment and physical disability as measured by the functional independence measure. Arch Phys Med Rehabil 1993; 74(6): 566-573, https://doi.org/10.1016/0003-9993(93)90153-2.
58. Dodds T. A validation of the functional independence measurement and its performance among rehabilitation inpatients. Arch Phys Med Rehabil 1993; 74(5): 531-536, https://doi.org/10.1016/0003-9993(93)90119-u.
59. Wade D.T. Measurement in neurological rehabilitation. Oxford University Press; 1992.
60. Field-Fote E.C., Fluet G.G., Schafer S.D., Schneider E.M., Smith R., Downey P.A., Ruhl C.D. The spinal cord injury functional ambulation inventory (SCI-FAI). J Rehabil Med 2001; 33(4): 177-181, https://doi. org/10.1080/165019701750300645.
61. Perry J., Garrett M., Gronley J.K., Mulroy S.J. Classification of walking handicap in the stroke population. Stroke 1995; 26(6): 982-989, https://doi.org/10.1161/01. str.26.6.982.
62. Audu M.L., To C.S., Kobetic R., Triolo R.J. Gait evaluation of a novel hip constraint orthosis with implication for walking in paraplegia. IEEE Trans Neural Syst Rehabil Eng 2010; 18(6): 610-618, https://doi.org/10.1109/ tnsre.2010.2047594.
63. Shamaei K., Cenciarini M., Adams A.A., Gregorczyk K.N., Schiffman J.M., Dollar A.M. Design and evaluation of a quasi-passive knee exoskeleton for investigation of motor adaptation in lower extremity joints. IEEE Trans Biomed Eng 2014; 61(6): 1809-1821, https://doi. org/10.1109/tbme.2014.2307698.
64. Mizrahi J., Braun Z., Najenson T., Graupe D. Quantitative weightbearing and gait evaluation of paraplegics using functional electrical stimulation. Med Biol Eng Comput 1985; 23(2): 101-107, https://doi.org/10.1007/bf02456745.
65. Braun Z., Mizrahi J., Najenson T., Graupe D. Activation of paraplegic patients by functional electrical stimulation: training and biomechanical evaluation. Scand J Rehabil Med Suppl 1985; 12: 93-101.
66. Isakov E., Mizrahi J., Najenson T. Biomechanical and physiological evaluation of FES-activated paraplegic patients. J Rehabil Res Develop 1986; 23(3): 9-19.
67. Sylos-Labini F., La Scaleia V., d'Avella A., Pisotta I., Tamburella F., Scivoletto G., Molinari M., Wang S., Wang L., van Asseldonk E., van der Kooij H., Hoellinger T., Cheron G., Thorsteinsson F., Ilzkovitz M., Gancet J., Hauffe R., Zanov F., Lacquaniti F., Ivanenko Y.P. EMG patterns during assisted walking in the exoskeleton. Front Hum Neurosci 2014; 8: 423, https://doi.org/10.3389/fnhum.2014.00423.
68. Krishnan C., Washabaugh E.P., Seetharaman Y. A low cost real-time motion tracking approach using webcam
technology. J Biomech 2015; 48(3): 544-548, https://doi. org/10.1016/j.jbiomech.2014.11.048.
69. Simon S.R. Quantification of human motion: gait analysis — benefits and limitations to its application to clinical problems. J Biomech 2004; 37(12): 1869-1680, https://doi. org/10.1016/j.jbiomech.2004.02.047.
70. Skvortsov D.V. The methods of investigation of kinematics and modern standards. Videoanalysis. Lechebnaya fizkul'turn i sportivnaya meditsina 2012; 12: 4-10.
71. Lawson B.E., Huff A., Goldfarb M. A preliminary investigation of powered prostheses for improved walking biomechanics in bilateral transfemoral amputees. Conf Proc IEEE Eng Med Biol Soc 2012, https://doi.org/10.1109/ embc.2012.6346884.
72. Kent J., Franklyn-Miller A. Biomechanical models in the study of lower limb amputee kinematics: a review. Prosthet Orthot Int 2011; 35(2): 124-139, https://doi. org/10.1177/0309364611407677.
73. Lam T., Wirz M., Lunenburger L., Dietz V. Swing phase resistance enhances flexor muscle activity during treadmill locomotion in incomplete spinal cord injury. Neurorehabil Neural Repair 2008; 22(5): 438-446, https://doi. org/10.1177/1545968308315595.
74. Van Asseldonk E.H.F., Veneman J.F., Ekkelenkamp R., Buurke J.H., van der Helm F.C.T., van der Kooij H. The effects on kinematics and muscle activity of walking in a robotic gait trainer during zero-force control. IEEE Trans Neural Syst Rehabil Eng 2008; 16(4): 360-370, https://doi.org/10.1109/ tnsre.2008.925074.
75. Moreno J.C., Barroso F., Farina D., Gizzi L., Santos C., Molinari M., Pons J.L. Effects of robotic guidance on the coordination of locomotion. J Neuroeng Rehabil 2013; 10(1): 79, https://doi.org/10.1186/1743-0003-10-79.
76. Fleerkotte B.M., Koopman B., Buurke J.H., van Asseldonk E.H.F., van der Kooij H., Rietman J.S. The effect of impedance-controlled robotic gait training on walking ability and quality in individuals with chronic incomplete spinal cord injury: an explorative study. J Neuroeng Rehabil 2014; 11(1): 26, https://doi.org/10.1186/1743-0003-11-26.
77. Podsiadlo D., Richardson S. The timed "Up & Go": a test of basic functional mobility for frail elderly persons. J Am Geriatr Soc 1991; 39(2): 142-148, https://doi. org/10.1111/j.1532-5415.1991.tb01616.x.
78. Morris S., Morris M.E., Iansek R. Reliability of measurements obtained with the timed "Up & Go" test in people with Parkinson disease. Phys Ther 2001; 81(2): 810-818.
79. Schoppen T., Boonstra A., Groothoff J.W., de Vries J., Goeken L.N.H., Eisma W.H. The timed "Up and Go" test: reliability and validity in persons with unilateral lower limb amputation. Arch Phys Med Rehabil 1999; 80(7): 825-828, https://doi.org/10.1016/s0003-9993(99)90234-4.
80. Shumway-Cook A., Brauer S., Woollacott M. Predicting the probability for falls in community-dwelling older adults using the Timed Up & Go test. Phys Ther2000; 80(9): 896-903.
81. Rossier P., Wade D.T. Validity and reliability comparison of 4 mobility measures in patients presenting with neurologic impairment. Arch Phys Med Rehabil 2001; 82(1): 9-13, https:// doi.org/10.1053/apmr.2001.9396.
82. Smith M.T., Baer G.D. Achievement of simple mobility milestones after stroke. Arch Phys Med Rehabil 1999; 80(4): 442-447, https://doi.org/10.1016/s0003-9993(99)90283-6.
83. Van Hedel H.J., Wirz M., Dietz V. Assessing walking ability in subjects with spinal cord injury: validity and reliability
of 3 walking tests. Arch Phys Med Rehabil 2005; 86(2): 190196, https://doi.org/10.1016/j.apmr.2004.02.010.
84. Roomi J., Johnson M.M., Waters K., Yohannes A., Helm A., Connolly M.J. Respiratory rehabilitation, exercise capacity and quality of life in chronic airways disease in old age. Age Ageing 1996; 25(1): 12-16, https://doi.org/10.1093/ ageing/25.1.12.
85. Eng J.J., Chu K.S., Dawson A.S., Kim C.M., Hepburn K.E. Functional walk tests in individuals with stroke: relation to perceived exertion and myocardial exertion. Stroke 2002; 33(3): 756-761, https://doi.org/10.1161/hs0302.104195.
86. Harada N.D., Chiu V., Stewart A.L. Mobility-related function in older adults: assessment with a 6-minute walk test. Arch Phys Med Rehabil 1999; 80(7): 837-841, https://doi. org/10.1016/s0003-9993(99)90236-8.
87. Van Hedel H.J.A., Wirz M., Dietz V. Standardized assessment of walking capacity after spinal cord injury: the European network approach. Neurol Res 2008; 30(1): 61-73, https://doi.org/10.1179/016164107x230775.
88. Buckley J.G., Spence W.D., Solomonidis S.E. Energy cost of walking: Comparison of "intelligent prosthesis" with conventional mechanism. Arch Phys Med Rehabil 1997; 78(3): 330-333, https://doi.org/10.1016/s0003-9993(97)90044-7.
89. Orendurff M.S., Segal A.D., Klute G.K., McDowell M.L., Pecoraro J.A., Czerniecki J.M. Gait efficiency using the C-Leg. J Rehabil Res Dev 2006; 43(2): 239, https://doi.org/10.1682/ jrrd.2005.06.0095.
90. Seymour R., Engbretson B., Kott K., Ordway N., Brooks G., Crannell J., Hickernell E., Wheeler K. Comparison between the C-leg® microprocessor-controlled prosthetic knee and non-microprocessor control prosthetic knees: a preliminary study of energy expenditure, obstacle course performance, and quality of life survey. Prosthetics and Orthotics International 2007; 31(1): 51-61, https://doi. org/10.1080/03093640600982255.
91. Chin T., Sawamura S., Shiba R., Oyabu H., Nagakura Y., Nakagawa A. Energy expenditure during walking in amputees after disarticulation of the hip. A microprocessor-controlled swing-phase control knee versus a mechanical-controlled stance-phase control knee. J Bone Joint Surg Br 2005; 87(1): 117-119.
92. Datta D., Heller B., Howitt J. A comparative evaluation of oxygen consumption and gait pattern in amputees using Intelligent Prostheses and conventionally damped knee swing-phase control. Clin Rehabil 2005; 19(4): 398-403, https://doi. org/10.1191/0269215505cr805oa.
93. Schmalz T., Blumentritt S., Jarasch R. Energy expenditure and biomechanical characteristics of lower limb amputee gait. Gait Posture 2002; 16(3): 255-263, https://doi. org/10.1016/s0966-6362(02)00008-5.
94. Kaufman K.R., Levine J.A., Brey R.H., McCrady S.K., Padgett D.J., Joyner M.J. Energy expenditure and activity of transfemoral amputees using mechanical and microprocessor-controlled prosthetic knees. Arch Phys Med Rehabil 2008; 89(7): 1380-1385, https://doi.org/10.1016/j. apmr.2007.11.053.
95. Hood V.L., Granat M.H., Maxwell D.J., Hasler J.P. A new method of using heart rate to represent energy expenditure: the total heart beat index. Arch Phys Med Rehabil 2002; 83(9): 1266-1273, https://doi.org/10.1053/apmr.2002.34598.
96. MacGregor J. The objective measurement of physical performance with long term ambulatory physiological surveillance equipment (LAPSE). In: Proceedings of 3rd
International Symposium on Ambulatory Monitoring. Stott F.D., Raftery E.B., Goulding L. (editors). London, UK: Academic Press; 1979; p. 29-39.
97. Bailey M.J., Ratcliffe C.M. Reliability of physiological cost index measurements in walking normal subjects using steady-state, non-steady-state and post-exercise heart rate recording. Physiotherapy 1995; 81(10): 618-623, https://doi. org/10.1016/s0031-9406(05)66648-5.
98. Chin T., Sawamura S., Fujita H., Nakajima S., Ojima I., Oyabu H., Nagakura Y., Otsuka H., Nakagawa A. The efficacy of physiological cost index (PCI) measurement of a subject walking with an Intelligent Prosthesis. Prosthet Orthot Int 1999; 23(1): 45-49.
99. Nene A. Physiological cost index of walking in able-bodied adolescents and adults. Clin Rehabil 1993; 7(4): 319326, https://doi.org/10.1177/026921559300700408.
