Evaluation of state-of-the-art models for improving the diagnosis of mango tree diseases through supervised learning of symptom images in Burkina Faso.
A
A
DiandaZoéyandéOumarou2✉Emailoumarou.dianda@inera.bf
KaboréEmile3Emailemilekabore73@gmail.com
KeitaZakaria1
CheickOumar1Emailzakariacheickoumarkeita@gmail.com
ZidaIssaka3
KindaZakaria2
LankoandéBenjamin3Emaillankoandehatina@yahoo.fr
MaloSadouanouan1Emailsadouanouan@yahoo.fr
Wonniissa.1
1A
Institute for the Environment and Agricultural Research, Central Horticulture LaboratoryNational Center for Scientific and Technological ResearchFarako- Bâ Station, Bobo-DioulassoBurkina Faso 2Yembila Abdoulaye Toguyeni University (UYAT), Higher Institute for Sustainable Development (ISDD)Fada N’GourmaBurkina Faso
3Higher School of Computer Science (ESI)Nazi Boni University (UNB)Bobo- Dioulasso, Burkina Faso
1Dianda Zoéyandé Oumarou*, 2Kaboré Emile, 3Keita Zakaria Cheick Oumar, 1Zida Issaka, 3Kinda Zakaria, 2Lankoandé Benjamin, 3Malo Sadouanouan, 1Wonni issa.
1National Center for Scientific and Technological Research / Institute for the Environment and Agricultural Research, Central Horticulture Laboratory, Farako-Bâ Station, Bobo-Dioulasso, Burkina Faso;
2Yembila Abdoulaye Toguyeni University (UYAT), Higher Institute for Sustainable Development (ISDD), Fada N'Gourma, Burkina Faso, emilekabore73@gmail.com, lankoandehatina@yahoo.fr
3Nazi Boni University (UNB), Higher School of Computer Science (ESI), Bobo-Dioulasso, Burkina Faso, zakariacheickoumarkeita@gmail.com, sadouanouan@yahoo.fr
Corresponding author: oumarou.dianda@inera.bf,
Abstract
In Burkina Faso, the mango industry faces numerous phytosanitary constraints. This situation is exacerbated by producers' lack of knowledge about diseases and their symptoms, and the low uptake of control technologies. This study aims to develop a tool using artificial intelligence-based approaches for better integrated management of the main diseases affecting mango trees.
Surveys conducted in 40 mango orchards yielded 11,001 images of the characteristic symptoms of three major diseases, including 4,527 for anthracnose, 3,038 for bacterial disease and 3,436 for dieback. The data underwent several preprocessing steps. To ensure a balance between disease classes, 3,000 images per class were selected, for a total of 9,000 images. The images were then annotated and used for training with the pre-trained YOLOv11 model. Following training, three models were formed : V2-3M (MAP@50 = 50.3% ; precision = 55.1% ; recall = 49.1%), V3-3M (MAP@50 = 23% ; precision = 56.8% ; recall = 26.7%), and V4-3M (MAP@50 = 46.8% ; precision = 52% ; recall = 45.3%). The most effective model is the V2-3M, as it combines 55.1% accuracy, 50.3% MAP@50 and 49.1% recall.
In order to improve diagnosis and phytosanitary management in orchards, it would be useful to integrate treatment recommendations into the model, then deploy it on a mobile application and promote it to producers.
Key words :
mango tree
diseases
artificial intelligence
automatic diagnosis
Burkina Faso
A
Introduction
A
Mangoes are the fifth most produced fruit in the world (by tonnage) behind bananas/plantains, citrus fruits, grapes and apples, with a production of 51 million tonnes in 2017
1. Burkina Faso contributes between 11% and 18% of mango production in West Africa
2. Mangoes are a very important socio-economic and climate issue in Burkina Faso. Mango production and export contribute significantly to the country's income.
Indeed, the mango sector generates more than 15 billion in turnover per year1. In addition, it contributes to food security in producer areas and vegetation cover, limiting the effects of climate change 2. The mango value chain in Burkina Faso is a source of employment. Its activities employ 28,000 people in 21,000 jobs as entrepreneurs or similar (farmers, trackers, retailers, etc.) 2, around 350 permanent jobs in processing and packaging companies for fresh exports, and around 7,000 seasonal jobs throughout the chain 3.
The mango sector faces enormous phytosanitary constraints, particularly insect pests 4 and also major diseases such as anthracnose, bacterial disease and dieback567. These diseases cause significant damage in orchards, such as deterioration in fruit quality, tree death and reduced yields89. This damage causes enormous losses, such as loss of income for producers, management costs, reduced productivity, etc.10. Unfortunately, producers have little understanding of these diseases and their symptoms, epidemiological aspects and diagnostic difficulties. Added to this is the limited dissemination of available control technologies, resulting in low adoption by producers. Nowadays, artificial intelligence is a powerful decision-making tool in agriculture, particularly in the automatic diagnosis of crop diseases 11. In India, automatic diagnosis and classification models for crop pests have been implemented 1213.
This aspect of AI for agricultural development is still largely unexplored in Burkina Faso, specifically for the diagnosis of mango tree diseases. The aim of this study is to design an effective AI-based automatic diagnosis model for the main mango tree diseases in Burkina Faso.
MATERIAL AND METHODS
Study area
The study was conducted in the Guiriko (Houet and Kénédougou provinces) and Tannounyan (Comoé and Léraba provinces) regions (Fig. 1), which account for approximately 70% of national mango production. Orchards in this area are affected by major diseases such as dieback 14, bacterial disease 6 and anthracnose5. The local economy is based on agriculture, livestock farming and trade, with the mango industry supported by industrial and artisanal processing units.1516
Collection of image data on diseases in mango orchards
Surveys, collection and compilation of representative images
Surveys were conducted in 10 orchards in each of the four provinces studied (Kénédougou, Houet, Comoé and Léraba), for a total of 40 mango orchards. The selection was based on the accessibility of the orchard and the consent of the producer. Careful observations were made in the orchards. These enabled the identification of mango trees showing symptoms of the three main diseases, namely dieback, anthracnose and bacterial disease. In the selected orchards, photographs of the symptoms of the main diseases were taken with smartphones.
The image collection operation mainly focused on the leaves, fruit and the entire tree in cases of severe decline. The images were taken during the day and from several angles of the organs affected by the diseases in order to obtain a better representation of the different symptoms. The images collected were stored on an external hard drive by disease class.
Pre-processing, image annotation
The images were pre-processed to improve their quality and usability. This mainly involved resizing them to dimensions compatible with YOLOv11, normalising colours and correcting brightness, and increasing the data (data augmentation) through rotation, inversion, cropping and noise to improve the robustness of the model. After pre-processing, batches of 3,000 images for each disease were selected, for a total of 9,000 images for all three diseases (anthracnose, bacterial disease and dieback). These selected images were imported into the Roboflow platform for annotation.
Image annotation consisted of drawing bounding boxes around the symptoms and associating them with a class corresponding to each disease (Fig. 2). This methodical work made it possible to build a systematically annotated dataset that will be used for training.
Image training
Supervised transfer learning with the pre-trained YOLOv11 algorithm was used. YOLOv11 (You Only Look Once, version 11) is a convolutional neural network (CNN) designed for real-time object detection and simultaneously enables :
A
• Automatic extraction of relevant visual features,
• Localisation of symptoms via bounding boxes,
• Classification of detected diseases.
The entire supervised training process was conducted via the Roboflow platform, which provides an integrated environment for managing datasets and training computer vision models. The annotated data was divided into three sets : 75% for training (training set), 20% for validation (validation set), and 5% for testing (test set). Regularisation techniques such as early stopping were applied to avoid overfitting. All data was made available on a platform for easy access.
Model performance was evaluated using standard object detection metrics such as:
Precision : the proportion of correct predictions among all predictions made. It indicates the model's ability to limit false detections.
Recall : this is the proportion of cases correctly detected in relation to all existing positive cases. It reflects the model's ability to not omit any symptoms that are present.
mAP@50 (mean Average Precision at 50% IoU): this is an overall indicator of object detection performance, calculated as the average precision across all classes, with an intersection over union (IoU) threshold set at 50%.
These metrics were used to evaluate the models' ability to correctly identify and locate symptoms of mango tree diseases, while ensuring a balance between accuracy and completeness.
Data processing and analysis
The data was organised and classified in Excel 2019. Excel was used to total the number of images per disease and to create graphs. The GIS tool (My Coordinates) was used to record the geographical coordinates of the various sites for mapping purposes using QGIS software. Robboflow software was used for image annotation and model training.
RESULTS
Symptoms of the three main annotated diseases
Surveys carried out in the four provinces enabled the symptoms of anthracnose, bacterial disease and dieback to be identified and annotated using the Roboflow platform.
Anthracnose is characterised by black spots that develop into necrosis on the leaves and deep necrotic lesions on the fruit (Fig. 3).
Bacterial disease manifests as irregular oily spots on the leaves, sometimes perforated, and blackish star-shaped and cracked lesions on the fruit, sometimes with bacterial exudate (Fig. 4). The dieback caused the leaves to wilt and gradually turn brown, with partial (10 to 90%) and total (100%) coverage (Fig. 5).
Performance of automatic detection models for major diseases.
Training identified three model variants named V2-3M, V3-3M and V4-3M. These models were evaluated based on the performance of standard metrics, namely precision, recall and Mean Average Precision at an IoU of 50% (mAP@50) (Fig. 6). The evaluation reveals contrasting performances in the detection of symptoms of anthracnose, bacterial disease and mango tree decline. The V2-3M model stands out with its best results, with a mAP@50 of 50,3%, precision of 55,1% and recall of 49,1%. The V4-3M model performs slightly worse, with an mAP@50 of 46.8%, an accuracy of 52% and a recall of 45,3%. In contrast, the V3-3M model shows the lowest results, with an mAP@50 of 23,5% and a recall of only 26,7%, despite relatively good precision (56,8%).
DISCUSSION
Distinctive symptoms of mango tree diseases: a solid basis for establishing an automatic diagnostic system.
Accurate identification of phytopathological symptoms is a fundamental prerequisite for the development of digital diagnostic tools, particularly those using AI. The symptoms documented in orchards largely corroborate the classic descriptions established by researchers. Indeed, for anthracnose, observations of irregular brown spots on leaves, sunken black lesions on fruit and necrosis of young twigs are consistent with the work of 17 and 18, which highlight similar symptoms of anthracnose in humid mango-producing areas, where relative humidity and poor aeration promote infection. The work of 19has also demonstrated the early appearance of symptoms as early as the flowering stage, directly influencing yield.
With regard to bacterial disease, the photographed symptoms captured, such as translucent oily spots, leaf perforations and exudates on fruit, are typical of infection by Xanthomonas campestris pv. mangiferaeindicae. These symptoms were described by 6 in Burkina Faso and West Africa, who highlighted the rapid progression of bacterial lesions. Recognition of these visual characteristics is crucial in order to differentiate this disease from anthracnose, whose lesions can sometimes overlap on the fruit. With regard to decline, symptomatic analysis reveals leaf wilting, progressive browning of twigs, and fruit abortion 20. This description corresponds to the symptoms associated with complex fungal infections, particularly Lasiodiplodia spp, as reported by 21.
All of this symptomatic data thus constitutes a consistent database for training AI models, particularly through deep learning, to identify major diseases. This has been demonstrated in the work of 22 on the automatic identification of wheat diseases in Europe using AI algorithms. Also, based on the training of approximately 8,438 images of symptoms acquired on PlantVillage, 23 have set up a system for the automatic detection of diseases in vineyards and mango trees in India. This will constitute a database of the symptoms of the main diseases affecting mango trees and, above all, a significant step forward in overcoming the lack of phytosanitary expertise and speeding up decision-making in the field by producers.
Best model for automatic detection of major mango tree diseases.
The performance achieved by the V2-3M, V3-3M and V4-3M models demonstrates differentiated capabilities in detecting the symptoms of major mango tree diseases from annotated images with accuracies greater than 50%. The V2-3M model, with an mAP@50 of 50.3%, appears to be the most effective, confirming the importance of good parameterisation and optimised architecture in automatic detection tasks. Its performance combines relatively balanced precision (55,1%) and recall (49,1%), indicating that it can be used as a starting point for a functional prototype of a mobile plant health diagnosis tool 24. These metrics show a good compromise between the model's ability to correctly locate symptoms and its ability to minimise both false positives and false negatives.
On the other hand, the poor performance of the V3-3M model (mAP@50 = 23,5% ; recall = 26,7%) despite similar accuracy (56,8%) highlights limitations in the generalisation of learning. This model seems to struggle to capture symptomatic diversity, particularly due to reduced sensitivity to morphological and chromatic variations in symptoms.
The metrics of the V4-3M model, which are intermediate (mAP@50 = 46,8%) and reflect a certain robustness, albeit less marked than V2-3M, show that improved performance depends on a compromise between architectural complexity, annotation quality and training image diversity. This finding is consistent with the observations of 25, who showed that training models on highly diversified image databases significantly improves the robustness of artificial intelligence tools applied to agriculture.
Furthermore, the satisfactory performance of the V2-3M model is in line with recent research into leaf disease detection using deep learning. For example, 26 achieved a mAP of 51% on tomato diseases using CNN architectures. 12 achieved 99% accuracy for a cashew anthracnose diagnosis model using tools such as Mobilenet and Inception. In terms of performance, the V2-3M model is the most effective. Its ability to balance accuracy (55,1%) and recall (49,1%), combined with an mAP@50 of 50,3%, makes it the most suitable for initial operational application. The V4-3M model, although fairly close, remains slightly less robust, while V3-3M should be ruled out due to its insufficient results. Thus, V2-3M provides a solid basis for an automated diagnostic system, with prospects for improvement.
A
These results confirm the feasibility of using artificial intelligence models for the automatic detection of major mango tree diseases, while highlighting the need to continue optimising algorithms and enriching training databases
27. The integration of such a tool into a mobile application could strengthen early detection capabilities and improve the responsiveness of phytosanitary interventions in Burkina Faso.
CONCLUSION
Anthracnose, bacterial disease and dieback are major phytosanitary constraints affecting mango trees. Unfortunately, producers have little knowledge of the epidemiological aspects of these diseases or the control techniques available. This study was conducted with the aim of designing an accurate automatic diagnostic model for the main diseases affecting mango trees using artificial intelligence. Training the collection of symptomatic images showed that the V2-3M model performed better in terms of metrics for automatic disease detection.
These relevant results open up new prospects for integrating AI tools into agroecological practices, particularly for phytosanitary monitoring and management in orchards. It would be wise to integrate treatment recommendations into the model, deploy it on a mobile application, and promote it for the benefit of producers, all of which will contribute to effective disease management in mango orchards.
ACKNOWLEDGEMENTS
The research was conducted at the Regional Center of Excellence in Fruits and Vegetables (CRE/FL) based at the Institute of Environment and Agronomic Research (INERA) in Farako-bâ, Burkina Faso.
A
A
Author Contribution
**DZO** : Conceptualization; Funding acquisition; Methodology; Resources; Roles/Writing - original draft,**KE :** Manuscript’s writing ,**DZO, KE, ZI, KZCO :** Data collection,**KE** and **KZCO** : Initial processing, data treatement and analysis,**ZI, KZ, LB, MS, WI** : Critical revision and improvement of the scientific contentAll authors have read and approved the final version of the manuscript.
KE and KZCO : Initial processing, data treatement and analysis,
All authors have read and approved the final version of the manuscript.
A
Data Availability
Data from this study will be made available to the journal as needed via the corresponding author's e-mail address.
REFERENCE
1.Food and agriculture organization (FAO)- Statistical Yearbook. FAO Rome, (2021).
2.APEX. Fiche Sectorielle: Mangue Du Burkina Faso. (2018). https://www.apexb.bf/catalogue-de-produits/mangue? doi:https://www.apexb.bf/catalogue-de-produits/mangue?
3.Ministry of Agriculture and Halieutic Resources (MARAH). Filière Mangue: Les Acteurs Font Le Bilan de La Campagne.. (2023).
4.Zida, I. et al. Effectiveness of Four Integrated Pest Management Approaches in the Control of Fruit Flies (Diptera: Tephritidae) in Mango Agro-Ecosystems in the South-Sudanian Zone of Burkina Faso. Adv. Ento- mology. 11, 124–142 (2023).
5.Bougoum, H. et al. Caractérisation de Colletotrichum spp agent pathogène de l ’ anthracnose du manguier (Mangifera indica L.) au Burkina Faso. J. Appl. Biosci. 190, 19999–20020 (2023).
6.Zombré, C. diversite genetique et pathologique de xanthomonas citripv. mangiferaeindicae, bacterie responsable de la maladie des taches noires du manguier au burkina faso et en afrique de l’ouest » (Université Joseph Ki-Zerbo, Ouagadodugou, 2016).
7.Dianda, Z. O. et al. Prévalence du dessèchement du manguier et evaluation de la fréquence des champignons associés à la maladie au Burkina Faso. J. Appl. Biosci. 126, 12686 (2018).
8.Dembele, D. D. & Camara, B. Evaluation pré et post-récolte de l ’ incidence et de la sévérité de l ’ anthracnose du manguier au nord de la Côte d ’ Ivoire. ResearchGate 1–2 doi: (2019). https://www.researchgate.net/publication/341314189
9.Paul-alfred, K. K. Profitability and Competitiveness of the Mango Sector in Ivory Coast. Int. J. Econ. Financ Res. 10, 12–16 (2024).
10.PIP COLEACP. Nouveaux ravageurs et maladies invasives. Bactériose du manguier provoquée par Xanthomonas citri pv. mangiferaeindicae.
COLEACP PIP 1–14 p. doi: (2012).
www.coleacp.org/pip 11.Lahrache, R. L ’ impact de l ’ intelligence artificielle sur la prise de décision The Impact of Artificial Intelligence in Decision Making. 7, 660–678 (2024).
12.Jayaprakash, V. & Rajagopal, M. K. cashew dataset generation using augmentation and ralsgan and a transfer learning based tinyml approach abstract: arXiv Prepr. arXiv2304.08766 (2023).
A
13.Tirkey, D., Singh, K. K. & Tripathi, S. Performance analysis of AI-based solutions for crop disease identification, detection, and classification. Smart Agric. Technol. 5, 100238 (2023).
14.Dianda, O. et al. Prévalence du dessèchement du manguier et evaluation de la fréquence des champignons associés à la maladie au Burkina Faso. J. Appl. Biosci. 12686–12699. https://dx.doi.org/10.4314/jab.v126i1.6 (2018).
A
15.INSD. Profil de Pauvreté de La Région Des Hauts Bassins. (2023).
A
16.INSD.
5è Recensement Général de La Population et de l’Habitat. (2022).
www.insd.bf doi:www.insd.bf
17.Dembele, D. D., Og, L., Georges, D. & Amari, E. Pre and postharvest assessment of mango anthracnose incidence and severity in the north of Côte d ’ Ivoire Pre and postharvest assessment of mango anthracnose incidence and severity in the north of Côte d ’ Ivoire. 14 p. (2020). 10.4314/ijbcs.v13i6.24
18.Dofuor, A. K. et al. Mango anthracnose disease: the current situation and direction for future research. Front. Microbiol. 14, 1–18 (2023).
19.Kankam, F. & Adomako, J. Anthracnose Disease of Mango: Epidemiology, Impact and Management Options. (2022). 10.5772/intechopen.105934
20.Dianda, Z. O. et al. P. Prévalence du dessèchement du manguier et evaluation de fréquence des champignons associés à la maladie au Burkina Faso. J. Appl. Biosci. 12686–12699. https://dx.doi.org/10.4314/jab.v126i1.6 (2018).
21.Oumarou Zoéyandé Dianda1, Issa Wonni1, Léonard Ouédraogo1, Philippe Sankara2, Charlotte 4 Tollenaere1, 3, Emerson M. Del Ponte4, D. F. Lasiodiplodia species associated with mango (Mangifera indica L.) decline in Burkina Faso and influence of climatic factors on the disease distribution. (2023).
22.Picon, A. & Alvarez-Gila, A. C, M. S. & Amaia Ortiz-Barredo, Jone Echazarra, A. J. Réseaux neuronaux convolutifs profonds pour la classification des maladies des cultures à l’état sauvage à partir d’appareils de capture mobiles. ScienceDirect 161, 280–290 (2020).
23.Rao, U. S., Swathi, R., Sanjana, V., Arpitha, L. & Chandrasekhar, K. Deep Learning Precision Farming: Grapes and Mango Leaf Disease Detection by Transfer Learning. Glob. Transitions Proc. 2, 535-544p (2021).
24.Elkadi, K. Expérimentation d’un modèle de détection précoce des maladies de la tomate par apprentissage profond. Rev. Marocaine Prot. des. Plantes. 14, 19–30 (2020).
25.Ramcharan, A., Mccloskey, P., Baranowski, K. & Mbilinyi, N. A. Mobile-Based Deep Learning Model for Cassava Disease Diagnosis. Front. Plant. Sci. 10, 1–8 (2019).
26.Boulent, J., Foucher, S. & Théau, J. Convolutional Neural Networks for the Automatic Identification of Plant Diseases. Front. Plant. Sci. 10, 15 (2019).
27.Hossain, M. A., Sakib, S., Abdullah, H. M. & Arman, S. E. Deep learning for mango leaf disease identification: A vision transformer perspective. Heliyon 10, 36361 (2024).
List of figures