CC BY
5
DOI: 10.21122/2220-9506-2023-14-3-214-222
Automatic Measurement in Metallography
12 3
Anna Anisovich , Maria Markevich , Jigmeddorj Vanchinkhuu
,3
1Institute of Applied Physics of the National Academy of Science of Belarus, Akademicheskaya str., 16, Minsk 220072, Belarus
2Physical-Technical Institute of the National Academy of Sciences of Belarus, Kuprevich str., 10, Minsk 220141, Belarus 3National University of Mongolia, Ulaanbaatar, Mongolia
Received 20.06.2023
Accepted for publication 19.09.2023
Abstract
Quantitative analysis of the structure of metals and alloys is an important part of modern metal science. To obtain quantitative data and build dependencies, metallographic image processing programs are used, oriented both for scientific research and for use in industry. Programs capable of automatically performing metallographic analysis are of great interest to consumers. When advertising such programs, it is often claimed that they allow quantitative analysis of the structure with virtually no time. The purpose of this work was to determine the time spent on quantitative metallographic analysis in some image processing programs presented on the Belarusian market. Connected and unconnected metallographic objects were considered. It is shown that automatic quantitative analysis is possible for unconnected objects (powders, cast iron graphite). The time required is within a minute. For connected objects (structures of metals and alloys after metallographic etching), the time required to detect objects and obtain digital data is 10-40 min or more, depending on the complexity of the object, which is unacceptable for factory laboratories that analyze a large number of samples per shift. Therefore, it is recommended that potential users of metallographic image processing software always require a substantive demonstration of the automatic measurement capabilities of the proposed software.
Keywords: image processing programs, automatic measurements, grain size
Адрес для переписки: Address for correspondence:
Анисович А.Г. Anisovich А.
Институт прикладной физики НАН Беларуси, Institute of Applied Physics of the National Academy
ул. Академическая, 16, г. Минск 220072, Беларусь of Science of Belarus,
e-mail: anna-anisovich@yandex.ru Akademicheskaya str., 16, Minsk 220072, Belarus
Для цитирования:
Anna Anisovich, Maria Markevich, Jigmeddorj Vanchinkhuu.
Automatic Measurement in Metallography.
Приборы и методы измерений.
2023. - Т. 14, № 3. - С. 214-222.
DOI: 10.21122/2220-9506-2023-14-3-214-222
For citation:
Anna Anisovich, Maria Markevich, Jigmeddorj Vanchinkhuu.
Automatic Measurement in Metallography.
Devices and Methods of Measurements.
2023, vol. 14, no. 3, pp. 214-222.
DOI: 10.21122/2220-9506-2023-14-3-214-222
Б01: 10.21122/2220-9506-2023-14-3-214-222
Автоматические измерения в металлографии
12 3
А.Г. Анисович , М.И. Маркевич , Ванчинхуу Жигмэддорж
1 Институт прикладной физики Национальной академии наук Беларуси, ул. Академическая, 16, г. Минск 220072, Беларусь
2Физико-технический институт Национальной академии наук Беларуси, ул. Купревича, 10, г. Минск 220141, Беларусь
3Монгольский национальный университет, Улан-Батор, Монголия
Поступила 20.06.2023 Принята к печати 19.09.2023
Количественный анализ структуры металлов и сплавов является важной частью современного металловедения. Для получения количественных данных и построения зависимостей используются металлографические программы обработки изображений, ориентированные как на научные исследования, так и для использования в промышленности. Большой интерес у потребителя вызывают программы, способные автоматически проводить металлографический анализ. При рекламе таких программ зачастую утверждается, что они позволяют провести количественный анализ структуры практически без затрат времени. Целью данной работы являлось определение затрат времени на количественный металлографический анализ в некоторых программах обработки изображений, представленных на белорусском рынке. Рассматривались связанные и несвязанные металлографические объекты. Показано, что для несвязанных объектов (порошки, графит чугуна) возможен автоматический количественный анализ; затраты времени при этом составляют в пределах минуты. Для связанных объектов (структуры металлов и сплавов после металлографического травления) затраты времени на обнаружение объектов и получение цифровых данных составляют 10-40 мин и более в зависимости от сложности объекта, что неприемлемо для заводских лабораторий, которые анализируют большое количество образцов за смену. Поэтому потенциальным потребителям программ обработки металлографических изображений рекомендуется всегда требовать предметной демонстрации возможности автоматических измерений предлагаемого программного обеспечения.
Ключевые слова: программы обработки изображений, автоматические измерения, размер зерна
Адрес для переписки:
Анисович А.Г.
Институт прикладной физики НАН Беларуси, ул. Академическая, 16, г. Минск 220072, Беларусь e-mail: anna-anisovich@yandex.ru
Address for correspondence:
Anisovich A.
Institute of Applied Physics of the National Academy of Science of Belarus,
Akademicheskaya str., 16, Minsk 220072, Belarus e-mail: anna-anisovich@yandex.ru
Для цитирования:
Anna Anisovich, Maria Markevich, Jigmeddorj Vanchinkhuu.
Automatic Measurement in Metallography.
Приборы и методы измерений.
2023. - Т. 14, № 3. - С. 214-222.
DOI: 10.21122/2220-9506-2023-14-3-214-222
For citation:
Anna Anisovich, Maria Markevich, Jigmeddorj Vanchinkhuu.
Automatic Measurement in Metallography.
Devices and Methods of Measurements.
2023, vol. 14, no. 3, pp. 214-222.
DOI: 10.21122/2220-9506-2023-14-3-214-222
Introduction
Quantitative imaging of microstructures is an important part of modern materials science. It allows the linear dimensions and areas of structural units to be measured and, based on this, various dependencies to be established, graphs to be created, etc. In the past, quantitative metallography was based on manual measurements, which has been the subject of extensive research. In some cases, where possible, analogue equipment was used [1], which is still prescribed in the standards in force, in particular GOST 21073.4-75 "Non-ferrous metals. Determination of grain size by the planimetric method".
At present, there are numerous image processing programs that automate the work of a metallurgist and provide ample opportunities for quantitative materials science. Metallurgical laboratories are equipped with metallographic complexes for analyzing the structure of metals and alloys, of which computer analysis tools are an important part [2]. At the same time, any possibility that allows to automate the work of the operator and to minimize the influence of the human factor in the analysis of the structure of metals and alloys is very attractive. Therefore, development in this direction is quite active [3], not only in materials science, but also in other branches of sciences [4]. Quantitative parameters of microstructure, such as grain size, can also be obtained by methods based on other principles, in particular electron backscatter diffraction (EBSD) [5].
Not only is the number of software products increasing, but the number of companies and intermediaries involved in selling them is also growing. Various organizations, especially factories, are offered to purchase programs for quantitative metallographic analysis of the structure. At the same time, it is claimed that the software allows automatic processing of images of structures and obtaining results in a minimum of time. After the purchase of such software, it is often the case that the claimed automation is not true.
The purpose of this work was to determine the time spent on quantitative metallographic analysis in some image processing programs presented on the Belarusian market.
Materials and methods of experiment
Scale image No. 4 according to GOST 5639-82 "Steels and alloys. Methods of detecting and deter-
mining grain size", as well as images of microstructures of high strength cast iron and carbon steel and photographs of structures obtained by scanning electron microscopy were selected as objects of study.
A metallographic complex based on an MI-1 inverted metallographic microscope was used for photography and quantitative processing. The image was captured using a video camera with output to a personal computer monitor. Image processing was carried out using the IMAGE-SP program [6], which allows to measure the area, minimum and maximum diameter, length, width and average grain size, as well as some other parameters. The program was calibrated using a certified object micrometer (GOST 7513-55). The illustrations available on the Internet for the SIAMS 700 program [7] are also included in the consideration. Both programs - SIAMS and IMAGE-SP - belong to reliable software traditionally offered for purchase as part of metallographic complexes for studying the structure of metals and alloys.
Main part
In order to take measurements in any image processing program, the program must specify which objects are to be processed. To do this, these objects must be detected and painted in conditional colors (creating a so-called mask) according to their size. Detection is done by selecting parts of the image and adjusting the brightness range.
When studying so-called unconnected objects, it is possible to automatically detect objects for analysis [8]. Examples of such objects are powders, chemical crystals, granules and so on, i.e. a set of objects in the field of view of a microscope, each of which can be considered as an individual object. For them, the position of some structural elements in relation to others is not important; only their presence, quantity, size and distribution in space are of interest. Unconnected objects can be quantitatively analyzed in image processing programs in a minimum of time [9]. Figure 1 shows an example of unconnected objects (commercial diamond crystals) for which the dimensions were measured in an image processing program. The object detection is almost automatic because the objects and the substrate (slide) differ significantly in brightness. In principle, an image of such an object obtained in a bright or dark field can be considered as binarized, which does not require any additional processing for quantitative processing. Figure 1 shows the "mask" after the "object de-
tection" operation; objects that fall within a certain dimensional interval are painted with a certain color and are taken into account in the table (on the right in Figure 1), which shows their linear dimensions, area
and some functions derived from them (perimeter, conditional diameter, shape factor, etc.). The analysis was carried out "in a few mouse clicks" and the time required was minimal.
Figure 1 - Detection of unconnected objects (diamond crystals) in an image processing program
The same applies to the possibility of measuring the size of graphite inclusions in gray cast iron (Figure 2a), if the section is not etched to the microstructure. Due to the large difference in brightness between graphite and the metal matrix, graphite
inclusions can be considered unconnected objects. The image in Figure 2a is presented with a blue mask already applied. The convenience of detecting such objects makes it possible to create industry-oriented image processing programs [10].
BUFFER1 [2] 100% - 2ат{1)
Sß Ф-h 1 Ш ® •
■чЗВ
cgf -■'<'-'%HF^s У
Г 100 цт
и к < ) < » |. м
цт MAG ,:0; HVfl; ¡>В:0;
a b
Figure 2 - Detection of unconnected (a) and connected (b) objects (iron graphite) in an image processing program
The situation changes radically when metallographic etching is performed. For connected objects, their position relative to each other and how they change within the sample is important. In metallography, connected objects are the structures of mul-
tiphase alloys, single-phase materials with a grain structure, etc. In particular, inclusions of graphite in gray cast iron on a thin section after etching can only be considered connected objects (Figure 2b). Therefore, analysis of the structure in automatic mode is
not possible since other details of the image (in this case, pearlite) are also recognized by the computer program as separate objects simultaneously with graphite. Such an image has to be corrected manually. The time required for such work is 10-30 min, which is not sufficient for the factory laboratory, where hundreds of structures are analyzed per shift.
Real images of the structure are always imperfect. A fairly good image of the structure of Steel 3 is shown in Figure 3. The image contains relatively few defects and the etching shows the structure well for qualitative analysis. However, the brightness of the image is uneven and there are areas where the grain boundaries are not sufficiently developed by the etchant. These seemingly minor imperfections do not allow automatic grain selection. The stages of image selection are shown in Figure 4
as the colouring is changed in different brightness ranges. The left, brightest part of the image is painted first. The grain boundaries are not coloured and the grains are not fully coloured. On further attempts to colour all the grains on the left side of the image, the grains merge with the boundaries to form a single object, and on the right side, the grains are separated by the boundaries but are not fully coloured. The best result for object selection is shown in Figure 5a. In practice, there are two objects in the image: red and yellow. "Cutting" into the grains to get a satisfactory result has to be done manually (Figure 5b). The time required to process the image was more than 30 min. In such a situation, it is sometimes quicker to create the image Figure 5 by manually "outlining" each grain, which is far from automatic.
Figure 3 - IMAGE-SP program window, the initial stage of image selection
a b
Figure 4 - Steps in the Object Detection Procedure in IMAGE-SP
c
When advertising ordinary software products, dealers and representatives of development companies often omit required manual steps. However, in order to attract a customer, a result similar to that shown in Figure 5b is usually presented.
b
Figure 5 - Masks of objects obtained in the image processing program: a - automatic execution; b - manual execution
Image processing software recognizes objects by their brightness [11]. Black and white (binarized) images are best suited for this purpose. Figure 6a shows a black and white image of standard No. 4 GOST 5639-82, for which the "object detection" operation was performed in the "IMAGE-SP" program. Under the condition of ideal image quality (no "garbage", open grain boundary lines), the detection of objects (grains) is automatic and the analysis can be performed "in two clicks". There are, however, certain peculiarities. The reference structure is indicated by a circle. This used to be done to facilitate comparison, as we see the structure on a circular field
due to the design of the equipment in the microscope objective. The grains that are cut off by a circle are perceived by the program as separate objects. In addition, although it is technically possible to introduce the rejection of such objects in automatic mode, it can be time consuming. The same situation occurs with any other structure containing, for example, scratches, which are also perceived by the program as lines delimiting the object. It should be remembered that the quality of real structures obtained in the laboratory depends significantly on many factors: staff qualifications, capabilities of the equipment used, properties of the sample itself, time allotted for sample preparation, significance of the results of the analysis, customer requirements, etc. As a rule, the quality of the section is neglected as much as possible in urgent analyses, especially in factory production, when the metallographic laboratory must give an answer within 10-20 min. An example of such a section is shown in Figure 6b. Improvement by any method is out of the question in this case. In this case, there is no question of improving it by any methods.
Therefore, we have to admit that the simplest and most reliable way to determine the grain size is the comparison method according to GOST 5639-82. The human eye is quite accurate in determining whether a structure belongs to a certain value. An error (or discrepancy) of 1 point declared by GOST is enough to confirm the correctness of the results. As a rule, the operator is rarely mistaken in this case.
When processing images, various filters can be applied. Here is a partial list: median, white balance, edge detection, maximum filter, low and high pass filters, detail enhancement, smoothing, brightness, differential, etc.
Figure 7 shows some stages of image processing of a single-phase grain structure in the SIAMS 700 program [7] using various filters. Despite the fact that this program is a well-known and reliable software product, it took 15 steps to restore the grain boundary mesh, including: local contrast, threshold segmentation, skeletonization, skeleton decoupling, fine particle removal, closure, skeletonization, inversion, transformation , restoration, inversion, closure, topological skeletonization, masking. Thus, "automatic" structure analysis requires a certain amount of time to carry out preparatory operations. As a result of the processing, each grain of the structure is marked and ready for measurement [12], Figure 8.
Приборы и методы измерений Devices and Methods of Measurements
2023. - Т. 14, № 3. - С. 214-222 2023, vol. 14, no. 3, pp. 214-222
Anna Anisovich et al. Anna Anisovich et al.
Figure 6 - Microstructure standard according to GOST 5639-88, the result of the "object detection" operation (a); an example of low-quality thin sections; steel 08kp, section, etching (b)
Figure 8 - Images demonstrating the capabilities of the SIAMS 700 program
Direct processing of the image obtained in a Figure 9 shows the result of identifying objects in scanning electron microscope also takes a lot of time. such an image, performed manually within 40 min.
Figure 9 - SEM image of the surface of the galvanic coating: a - original; b - with an object detection mask
Measurements of individual objects in the structure obtained with a scanning microscope (Figure 10) are not particularly time-consuming and are often sufficient.
Figure 10 - Nickel nanoparticles, scanning electron microscopy
In [13] the problems of the use of different options for the processing of a scanning electron microscope image were considered. An automated method was developed to analyze the shape and size of ductile pits formed during fracture of VT23 and VT23M titanium alloys. The method is based on the analysis of the image topology and includes the operations of smoothing the original fractographic image, convolution with a filter to detect topological ridges, determination of the threshold value with subsequent skeletonization to identify the boundaries between the pits, and clustering to isolate connected areas. Considering the listed sequence of operations, such image processing also takes a lot of time.
Conclusion
It is noted that the software market offers automatic data processing programs for quantitative analysis in metallography.
The possibilities of automatic analysis of connected and unconnected metallographic objects are considered. It is shown that the time required for detecting unconnected objects (powders, gray cast iron graphite) is minimal and can practically be attributed to automatic measurements. The time spent on data processing for connected objects in some image processing programs is analyzed. It is shown that on average the time spent on detecting objects (grains or phases of metal alloys) is 10-40 minutes, which is unacceptable for industrial metallographic laboratories.
Potential users of image processing software are encouraged to always request a substantive demonstration of the automatic measurement capabilities of the offered software.
Acknowledgments
The work was supported by the Belarusian Republican Foundation for Fundamental Research, project no. T23MN-003.
References
1. Planimeter. Russian Academy of Sciences, Siberian Branch. Target program "Electronic Library of the Siberian Branch of the Russian Academy of Sciences". [Electronic Resource]. Available from: http://www.nsc.ru/ win/elbib/data/publ_cat/412.pdf [Accessed 05.27.2023].
2. Anisovich AG. Measurement of Steel Structure Elements in the Specialized Module of the IMAGE-SP Image Processing Software. Pribory i metody izmereniy = Devices and Methods of Measurements. 2020;11(4):279-288. DOI: 10.21122/2220-9506-2020-11-4-279-288
3. Jastrzebska I, Piwowarczyk A. Traditional vs. Automated Computer Image Analysis - A Comparative Assessment of Use for Analysis of Digital SEM Images of High-Temperature Ceramic Material. Materials. 2023;(16):812. DOI: 10.3390/ma16020812
4. Arthur Francisco Araujo Fernandes, Joao Ricardo Rebougas Dorea1, Guilherme Jordao de Magalhaes Rosa. Image Analysis and Computer Vision Applications in Animal Sciences: An Overview. Front. Vet. Sci., Sec. Livestock Genomics. 2020;7. DOI: 10.3389/fvets.2020.551269
5. Lutchenko NA, Arbuz AS, Kavalek AA, Panin EA, Popov FE, Magzhanov MK. Study of the influence of large shear deformations and vortex flow of metal on the formation of an equiaxed ultrafine-grained structure of the E110 zirconium alloy using the XRP method. Casting and metallurgy. 2023;(1):128-134.
DOI: 10.21122/1683-6065-2023-1-128-134
6. UP SYSPROG. [Electronic Resource]. Available from: https://sys-prog.com. [Accessed 05/29/2023].
7. SIAMS. [Electronic Resource]. Available from: https://siams.com/siams700/ [Accessed 05/28/2023].
8. Panteleev VG, Egorova OV, Klykova EI. Computer microscopy. M.: Tekhnosphere Publishing; 2005. 304 p.
9. Anisovich AG. Possibilities of using dark-field illumination for the analysis of unrelated objects. Casting and metallurgy. 2013;69(1):116-122.
10. Sachek OA, Chichko AN, Likhousov SG, Maty-ushinets TV, Chichko OI. Parameterization of images of microstructures of cast iron with nodular graphite based on the density function of graphite distribution by inclusion sizes. Casting and metallurgy. 2017;86(1):50-58.
11. Gonzalez R, Woods R. Digital image processing. M.: Tekhnosphere Publishing; 2005. 1072 p.
12. pharma [Electronic Resource]. Available from: https://pharma-se.ru/products/sistemy-analiza-izo-brazheniy/sistema-analiza izobrazheniy-siams-700 [Accessed 05/28/2023].
13. Konovalenko I, Maruschak P, Prentkovskis O. Automated Method for Fractographic Analysis of Shape and Size of Dimples on Fracture Surface of High-Strength Titanium Alloys. Metals. 2018;8(3):161.
DOI: 10.3390/met8030161
