Skip to main content
Download PDF

Rapid, automated detection of stem canker symptoms in woody perennials using artificial neural network analysis

Plant Methods volume 11, Article number: 57 (2015) Cite this article

Abstract

Background

Pseudomonas syringae can cause stem necrosis and canker in a wide range of woody species including cherry, plum, peach, horse chestnut and ash. The detection and quantification of lesion progression over time in woody tissues is a key trait for breeders to select upon for resistance.

Results

In this study a general, rapid and reliable approach to lesion quantification using image recognition and an artificial neural network model was developed. This was applied to screen both the virulence of a range of P. syringae pathovars and the resistance of a set of cherry and plum accessions to bacterial canker. The method developed was more objective than scoring by eye and allowed the detection of putatively resistant plant material for further study.

Conclusions

Automated image analysis will facilitate rapid screening of material for resistance to bacterial and other phytopathogens, allowing more efficient selection and quantification of resistance responses.

Background

The bacterial phytopathogen Pseudomonas syringae encompasses pathovars that infect over 180 plant species. Three distinct clades of P. syringae (pv morsprunorum race 1, pv. morsprunorum race 2 and pv. syringae) are the major causal agents of bacterial canker of Prunus species grown worldwide [1]. This genus of stone fruit trees includes economically important species such as cherry and plum. The bacteria are able to infect all aerial plant organs, including leaves, blossom and fruit. Severe damage to the tree occurs when bacteria infect woody tissues via wounds or leaf scars to produce necrotic cankers that are often associated with extensive gummosis [2]. These cankers cause girdling of branches and may result in dieback or eventual death of the tree when affecting the main trunk [3]. The disease commonly results in tree losses of approximately 20 %, however, in severe cases, losses of up to 75 % have been reported in the US [4, 5].

Current control methods for this disease are limited. They include good hygiene when pruning, to reduce the likelihood of infection and the use of copper-based spays to control epiphytic bacterial populations [6]. The breeding of resistant cultivars, complemented with excellent sanitation methods, would be the most effective control of this disease [7]. At present, no cultivars have been shown to exhibit complete resistance; however there is variation in disease susceptibility [2], meaning breeding approaches could be successful. Therefore, a rapid disease screening method would be highly beneficial in Prunus breeding programmes, to allow the identification of resistant genotypes.

Susceptibility to bacterial canker is usually determined by visually assessing natural infection in the field over several years [8]. This approach is time consuming and different environmental conditions between fields may lead to misleading results [9]. Several rapid laboratory-based assays have been proposed, including the use of cut shoots [3, 8, 10], immature fruits [11, 12] and micro-propagated plantlets [9] to examine disease susceptibility. In this study we assessed the use of the cut shoot assay to screen Prunus cultivars for susceptibility to bacterial canker. The assay involves inoculating first-year dormant shoots with P. syringae and estimating disease severity based on the extent of necrosis. This approach, although more rapid than field-based observations, was found to be variable between assessors, being based on a subjective appraisal of lesion development and therefore lacked reproducibility, as has been shown in other similar studies [13]. A more rapid and high-throughput alternative to visual assessment involves the use of automated image analysis software [14, 15].

Automated image analysis is becoming a popular tool for plant disease assessment as it potentially provides greater speed, accuracy and reliability [16]. Nilsson [17] was the first to report the utility of remote sensing and image analysis for plant pathology. After Nilsson, various studies successfully applied image analysis in the visible region for disease severity assessment [18–22], with such techniques excellently reviewed in [23]. Digital image analysis has been compared with visual disease assessment for several diseases such as coffee rust [24], powdery mildew [25], yellow rust [26] and citrus canker [27]. These studies indicated that colour or monochrome image analysis provided more accurate measurement, whilst drastically reducing the time required for examination [16, 28].

Among the different image analysis algorithms used to measure disease severity, the conversion from RGB (Red Green Blue) to HSI (Hue, Saturation and Intensity) colour space is commonly used and the hue value has been considered to be an effective channel to discriminate healthy and diseased areas on colour images [16]. The hue channel threshold can be set manually or automatically to segment diseased from healthy areas using software such as Adobe Photoshop [29], ASSESS© [30], Scion image software (Scion Corporation, Frederick, MD) [21], ImageJ [31] or other custom developed software programs [32, 33].

Other more sophisticated algorithms have been proposed for the automatic classification of plant diseases using colour images. Naikwadi [34] converted RGB images to HSI format and applied Spatial Gray-level Dependence Matrices (SGDM) as the colour co-occurrence texture analysis method for only H (hue) and S (saturation) images. Grey-level co-occurrence methodology was used to calculate the features, which were inputted into neural networks for recognition. Apart from HSI colour space, colour images have also been converted to the L1 L2 L3 colour model for disease area measurement [18, 35]. Schikora [19] utilised this method for the image-based analysis of plant infection with human pathogens. The L2 and L3 values plus the information of the surrounding pixels were classified via supervised learning techniques such as neural networks or support vector machines.

The use of Artificial Neural Networks (ANN) has recently become a popular tool of pattern recognition in image analysis [36] and disease quantification [37]. ANN is an efficient computational model inspired by the parallel nervous systems of animals [38]. It is widely implemented in machine learning and has been applied to the food and agricultural industry [39, 40]. The use of ANN has also been trialed for detection and quantification of various plant diseases [41–44]. The whole system is based upon an interconnection of neurons, which computes the output from the input variables. Besides input and output layers, ANN systems always have one or more hidden layers between them. A training dataset is used to update the adaptive weights of all the neurons in order to minimize the mean square error between the output and ideal values below a certain criteria [38].

This paper reports the development of an automated image analysis software which utilises ANN to analyse images of cherry and plum shoots exhibiting necrosis due to bacterial canker, with the goal of improving the accuracy of disease resistance screening. The software developed reduces the time and subjectivity involved in disease assessment and has the potential to be applied during screening of other important tree diseases.

Results and discussion

Quantification based on automated image analysis

A feed-forward artificial neural network (ANN), which is also known as multi-layer perceptrons (MLP), was implemented for the classification of diseased and healthy shoot tissue (see “Methods” section for full details). The recognition of diseased area is based on the colour, and only R, G and B values were used as the input variables of the ANN model. The training samples consisted of pixels labelled as healthy and diseased, and in total 75,155 pixels were manually labeled from 13 images, covering all the variation in colour due to disease. All the images were taken under the same illumination, and the colours of the diseased region showed little variation. The image analysis was applied to 420 images of inoculated shoots, producing estimates of percentage area and length of necrosis to determine disease severity.

To determine the utility of our image analysis software we compared results with both a current method of disease image analysis and expert measurements made by eye. 84 images (block 1 and 2) (e.g. Fig 1a) were analysed by our software to determine percentage area of necrosis, which was then correlated with the output for the same images produced using ImageJ manual thresholding (Fig. 1b). We also used the software to determine the length of necrosis on each shoot (at the longest point), which was correlated with data for the same images, measured manually using a caliper. The software produced both a pictorial output (e.g. Fig 1c) and raw data (available on github).

Fig. 1
figure 1

Images of cut shoots with thresholding of disease using ImageJ and the automated software. Shoots were inoculated with either the virulent strain Pss 9097 or with sterile 10 mM MgCl2 as a control. a Original image, b thresholding with Image J, c thresholding with automated software. 1: Cherry cv. Van, 2: Cherry cv. Napoleon, 3: Cherry cv. Roundel, 4: Cherry cv. Merton Glory, 5: Plum cv. Victoria, 6: Plum cv. Marjorie’s seedling

Full size image

Correlation analysis and linear regression indicated results were highly similar using the image analysis software and the other methods of assessment. Figure 2 shows the correlation of percentage area of necrosis whilst Fig. 3 shows the same for necrosis length. A linear regression produced r2 values of 0.87 and 0.81 for percentage area and length respectively. In both Figs. 2 and 3, there was deviation between the linear regression line and the ideal calibration line. This difference between methods likely resulted from using an arbitrarily threshold in ImageJ and subjective labelling of diseased pixels in training images. To further test this, Lin’s concordance coefficient [45] was calculated with rhoC values of 0.9 (moderate correlation) and 0.89 (poor correlation as <0.9) for the area and length data respectively. Due to the lower score for the length data when comparing manual measurement and the new software, this data was not used in further analysis of the experiment. This poor rhoC value for the length dataset could be due to manual assessment of length being more subjective. It was sometimes difficult to measure length of necrosis accurately due to natural blemishes on the sample shoots. The automated software could provide a more objective method than classification by eye, however this would need further testing to validate. Overall, the correlation analysis indicated that the automated software could produce results comparable to currently used manual assessment.

Fig. 2
figure 2

Comparison between the measurements by automated image analysis software and assessment by ImageJ on diseased area. The linear fitted line indicated the deviation from the ideal calibration line

Full size image
Fig. 3
figure 3

Comparison between the measurements by automated image analysis software and manual measurements by experts on the length of the diseased area. The linear fitted line indicated the deviation from the ideal calibration line

Full size image

The accuracy of the automated measurements relied on an expert’s selection of diseased areas on the images used as the training data. This was necessary to ensure all the typical colours of both diseased and healthy areas were included, reducing the potential for misclassification. The criteria used during prediction of the percentage disease were selected empirically. To our knowledge this is the first time that image analysis and machine-learning algorithms have been applied to disease quantification on plant shoots. Compared with assessment by eye/use of ImageJ manual thresholding, the image analysis software only needs to be trained once by an experienced expert. Many images captured under the same lighting condition can therefore be processed using the same model, which could reduce the subjectivity. The time taken to process all 420 images was approximately 42 s (0.1 s per image) with current hardware and ANN model, so the image analysis software was much faster than traditional methods (ImageJ 60–100 s per sample). The results were also compared with other common image thresholding methods such as fixed thresholding and Otsu’s method. It was found that the fixed thresholding produced a comparable correlation with manual assessment (r2 = 0.86) but Otsu’s thresholding methods showed poor results (see Additional file 1: Figure S6 and S7).

With a proper training dataset, the chosen method provided a fast, automated and objective method for disease quantification on cherry shoots. It could be utilised for general disease quantification during other biological experiments with different illumination condition. ANN is a more flexible approach than other thresholding methods, since biologists only need to label regions as diseased or healthy rather than arbitrarily determining a threshold for disease. Further development of the software could involve more input parameters such as texture information, so ANN is more extendable to other input variables.

Development of automated image analysis software and a graphical user interface

In order to make the software user-friendly, a graphical user interface was developed. The GUI can be used to select the training data on a series of images from a particular folder (see Additional file 1: Figure S1). This selection is semi-automatic as user interaction is necessary to drag the mouse and draw a rectangle within healthy and diseased regions. The colour information of all the pixels inside the rectangle is recorded as healthy or diseased to train the ANN model.

The trained ANN model can subsequently be applied to calculate the percentage area of necrosis. The pixels labelled as diseased are coloured as red (Additional file 1: Figure S2). The resulting image with false colour can be further analysed to estimate the length of disease by measuring the height of the fitted rectangles (Additional file 1: Figure S3). The source code of the software is available on Github (https://github.com/eastmallingresearch/Cherry_shoots).

Results of pathogenicity assays on cherry and plum

Following training, the automated image analysis software was used for a resistance screen to produce percentage area necrosis data for six strains of P. syringae inoculated onto four cultivars of cherry and two cultivars of plum. The strains included P. syringae pv. morsprunorum race 1 isolated from cherry (5244) and plum (5300), P. syringae pv. morsprunorum race 2 isolated from cherry (5255) and P. syringae pv. syringae isolated from cherry (9097) and plum (9293). A strain isolated from hazelnut (P. syringae pv. avellanae) was also used for comparison as a non-pathogen of Prunus.

The plant cultivars (cvs) were chosen as they have a range of susceptibility to the different races of P. syringae that infect Prunus. The cherry cv Van is reported to be universally susceptible, whilst cv Merton Glory is tolerant/has a lower susceptibility to the pathogen [46, 47]. The cultivars Napoleon and Roundel are reported to show differential susceptibility to the different races of P. syringae pv. morsprunorum [47], with cv Napoleon being resistant to R2 but susceptible to R1 and vice versa for cv Roundel. For plum, the cv Victoria is highly susceptible, while cv Marjorie’s Seedling is reportedly resistant/tolerant [48].

The different strains of P. syringae caused variable levels of necrosis on shoots of cherry (Fig. 4) and plum (Fig. 5). An analysis of variance (ANOVA) was performed using the log transformed percentage data (Additional file 1: Figure S4). The ANOVA revealed that there was a significant effect of Pseudomonas strain on percentage area of necrosis (p < 0.001, df = 6), likely due to variation in the virulence of the different strains. There was no significant difference in percentage area of necrosis between the two Prunus species (p = 0.06, df = 1) indicating both species exhibit similar levels of susceptibly to the disease. However there was a significant interaction between Prunus species and P. syringae strain (p < 0.001, df = 6). This indicates that the different P. syringae strains show differential virulence on cherry and plum (Figs. 4, 5).

Fig. 4
figure 4

Percentage area of necrosis on cherry shoots inoculated with P. syringae for four cherry cultivars (plotted on a log scale with back-transformed values as the scale). Cv Van is universally susceptible, whilst cv Merton Glory has tolerance/lower susceptibility. Cv Napoleon is resistant to Psm R2 but susceptible to R1 and vice versa for cv Roundel. The control was sterile 10 mM MgCl2. The mean values were calculated using ANOVA. LSD Least Significant Difference

Full size image
Fig. 5
figure 5

Percentage area of necrosis on plum shoots inoculated with P. syringae for two plum cultivars (plotted on a log scale with back-transformed values as the scale). Cv Victoria is highly susceptible and cv Marjorie’s Seedling is resistant/tolerant. The control was sterile 10 mM MgCl2. Mean values were calculated using ANOVA. LSD Least Significant Difference

Full size image

On cherry, the three strains isolated from cherry (Psm R1 5244, Psm R2 5255 and Pss 9097) were generally associated with severe necrosis (>5 % of total shoot area), whilst necrosis caused by other strains failed to exceed 5 % shoot area. Pss 9097 caused significant symptom development on all cultivars, whereas necrosis caused by the two races of Psm isolated from cherry, varied considerably between cultivars. This supports previous hypotheses that cherry cultivars exhibit differential susceptibility towards the two races of Psm [49]. In the global ANOVA (Table S1) there was no overall interaction between strain, cultivar and species. However, when the comparison was restricted to Van and Roundel, a highly significant interaction (p = 0.004) was detected between the two cultivars and the strains, which is driven by the differences between Psm R1 and Psm R2. The cultivars Roundel and Van showed differential susceptibility to the two Psm races. On Van, Psm R1 caused more severe necrosis than Psm R2, whilst on Roundel this response was reversed. One reason for this could be that plant immunity responses to the different races vary between cultivars. Overall the results indicated that no single cultivar of cherry was tolerant to all strains. The symptoms on Merton Glory never exceeded 25 % of the shoot area, indicative of partial tolerance. Therefore, a cross between Merton Glory and a more susceptible cultivar could be used to further investigate the genes involved in tolerance/resistance.

On plum (Fig. 5), the level of necrosis was generally higher on cv Victoria compared to Marjorie’s Seedling. Interestingly, the two strains originally isolated from plum (Psm R1 5300 and Pss 9293) caused a higher level of necrosis on plum than on cherry. Also, when inoculated on plum they generally caused more severe necrosis than strains isolated from cherry and hazelnut (Psm R1 5244, Psm R2 5255 and Ps. avellanae). The virulence of these plum strains on plum could be due to host-specific factors, which allow the pathogens to survive longer and cause more necrosis in their natural (homologous) host.

The plum cultivar Marjorie’s Seedling showed some resistance to most strains, with the severity of necrosis being similar to the control (inoculation with sterile MgCl2). It was also more tolerant to the virulent Pss strain 9097. This supports previous reports that this cultivar is tolerant to bacterial canker. Therefore, Marjorie’s Seedling could be a target for further investigations of the genetics of resistance.

Conclusion

In this study a method for automated image analysis to measure the severity of disease symptoms was developed using a machine learning approach. To validate the reliability of our automated software, cherry and plum shoot images were analysed to measure necrosis using the free program ImageJ [31]. The ImageJ analysis was based on the hue value of the colour images and the threshold between the diseased and healthy area was determined arbitrarily, resulting in a loss of the colour information from the other two channels. The 3D shape of cherry shoots resulted in shadows, leading to a colour similar to the diseased area in grayscale images or the hue channel of HSV space, but still distinguishable by the naked eye. Furthermore, manual image analysis using ImageJ can only process one image at a time and the images need to be loaded manually before applying the thresholding technique, which is extremely time consuming.

Due to the variation in the colour of diseased and healthy areas, it is difficult to set arbitrary thresholds for all three channels of colour space. The new image analysis method employed artificial neural networks (ANN) for the training and classification of a colour dataset. With the expert’s selection of training data featured by the RGB values and ANN as the classification algorithm, the quantification of disease was highly correlated with a subjective quantification method implemented in ImageJ. The software greatly reduced the time requirements for disease assessment when compared to manual thresholding with imageJ. This assisted in the objective identification of differences in cultivar susceptibility to the various strains that cause bacterial canker. This software therefore provides opportunities to shorten time taken for disease assessment dramatically. The software would facilitate the use of the cut shoot test for high-throughput screening during breeding programmes. This would enable the selection of putatively resistant material from mapping populations, which often contain hundreds of individuals. Finally, this software is highly adaptable and could be implemented during the screening of other tree diseases.

Methods

Bacterial strains

Strains of Pseudomonas syringae were grown on King’s B agar (Sigma) at 25 °C. For liquid culture, strains were grown in Luria Broth (Melford) at 25 °C, 150 rpm. Strains were obtained from various sources (Table 1) and included representatives of the three major clades that infect Prunus (Psm Race 1, Psm Race 2 and Pss) as well as an out-group strain belonging to pv. avellanae which was isolated from hazelnut (Corylus avellana).

Table 1 List of bacterial strains used in pathogenicity assays, with source host and reference
Full size table

Plant material

Dormant first-year shoots were collected from mature cherry and plum trees in December 2014 at East Malling Research, Kent.

Pathogenicity assay on cut shoots

The cut shoot pathogenicity assay was performed as in previous studies [3, 8]. Each cultivar x strain treatment was replicated 10 times, resulting in 420 inoculations. To prepare the bacteria, single colonies were inoculated in LB and shaken overnight. These cultures were spun down using a centrifuge (4000 rpm, 10 min) and re-suspended in 10 mM MgCl2. The concentration was adjusted to 1 × 107 CFU/ml (confirmed by dilution plating) and sterile 10 mM MgCl2 was used for the control. For the plant material, dormant first-year shoots of similar diameter (5 mm) were collected from cherry and plum trees in December and cut into 10 cm sections using secateurs. These were surface-sterilised in 0.5 % hypochlorite for 5 min and rinsed with tap water. The shoot sections were air-dried overnight.

To inoculate, the top 5 mm of each shoot tip was removed with a scalpel and dipped for 5 min in the bacterial suspension. The wound was covered with parafilm (Fisher Scientific, UK) and the shoot bases were freshly cut (approx. 5 mm) and placed in transparent-boxes immersed in water to a depth of 20 mm. The shoots were incubated in the closed boxes at 15 °C with 16-hour light, 8-hour dark cycle for 1 week. Separate boxes were used for each bacterial isolate to prevent cross-contamination. Next, the shoots were transferred to −2 °C for one week to simulate frost damage. Finally, the basal 10 mm of each shoot was removed and they were placed in a completely randomised design (generated using Genstat [50]) in water-soaked Oasis Foam (Oasis Floral, UK) in trays containing 30 mm of water. These were incubated for a further 4 weeks at 15 °C with the same light conditions as previously described. The trays were covered with cling-film to maintain a high humidity.

The shoots were assessed for severity of stem canker by peeling back the uppermost layer of bark from the top 30 mm of the shoot to expose the symptoms, which were photographed digitally. The length of necrosis was also manually measured with a caliper.

Imaging system

All the images were captured using a SLR camera (Canon EOS 1000D) with 53 mm focal length and 1/15 s exposure time. Two 60 W incandescent light bulbs were used to illuminate the samples from each side. The distance between the lens and the samples was 35 cm. Due to the high resolution of the imagery device (3888 × 2592 pixels), three shoots were placed on a spectralon white platform (SphereOptics) and imaged together in order to enhance the contrast between the foreground and background. The images were captured using EOS utility software (Canon) and saved as JPG files. Individual shoots were cropped from each image and due to small variations in the size of shoots, the resolution of the images varied from 43 × 754 to 282 × 839 pixels. All the images were saved and processed on a Dell desktop computer (Intel® Xeon(R) CPU X5560 @ 2.80 GHz × 16). The automated image analysis software was written in C++ [51] utilising the OpenCV Library [52] on an Ubuntu 14.04 operating system.

Statistics

Genstat [50] was used to perform the statistical analysis using a nested ANOVA (nesting cultivar by species), whilst Excel [53] was used to produce bar charts (Fig. 4 and 5). The residuals of ANOVA tests were assessed for normality using qqnorm (residuals). If the residuals were not normally distributed the data was log transformed (with the addition of 0.1 to area prior to log transformation) and the ANOVA repeated. Log transformation was selected rather than the more conventional square root transformation, as the full spectrum of percentage disease was not used and the relationship between residuals and fitted values was less biased. Furthermore, a log transformation is more appropriate to study multiplicative interactions between factors. Full ANOVA tables and residual plots can be found in the supplementary information (Additional file 1: Tables S1, S2; Figures S4, S5). A complete randomised design for the positioning of cherry shoots in trays after inoculation was produced using Genstat [50].

Image analysis with ImageJ

ImageJ [31] was used to manually measure the disease severity on an image-by-image basis. Firstly, the three cherry shoots were cropped from the original image and converted from RGB to HSI colour space. A threshold was manually chosen to determine the total number of pixels in the shoot (compared to the total in the whole image containing the background). The total number of pixels in the shoot was named R1. The second threshold on the hue channel was used to segment the diseased and healthy areas. As the diseased area always showed darker intensity than the healthy area, the background could be easily separated. The total number of pixels in the diseased area was called R2. The proportion of the diseased area was calculated using the ratio of the diseased area (R2) to the total shoot area (R1).

Automated image analysis software

The automated image analysis software was developed in C++ with open computer vision library (OpenCV 2.4.9), and the interface was designed by Qt designer. The software is programmed to load all images in a single folder and process them in a batch with the prediction parameters included and output the percentage area of necrosis and the necrosis length.

The original images were converted to grayscale and the pixels belonging to the three shoots were segmented from the background by setting an arbitrary threshold. All the contours were detected, those <500 pixels were considered noise and were discarded leaving only the three shoots. Rectangles were fitted to all three contours, which were cropped from background and saved as three individual images for further processing.

A feed-forward artificial neural network (ANN) was implemented for the imaging classification. The ANN model consists of one input layer with three neurons, one binary output layer and one hidden layer with 16 neurons (Additional file 1: Figure S8). The input layer was the same size as the sample feature variables (Red Green and Blue) in this experiment. The input is passed to each neuron of the hidden layer and summed up with certain weights. A symmetrical sigmoid function was applied to the sum for each neuron and the output of each neuron on the hidden layer was further summed up with weights to the output. The model is trained with a training dataset to adjust the weights iteratively in order to minimize the error between ideal and real output.

Thirteen images were selected for extraction of the training dataset. The expert labelled pixels as diseased by drawing squares of different sizes by pressing the left mouse button to the diseased region. Similarly, the right button was used to label pixels as healthy. The original images were kept in RGB format and the R, G and B values were used as the three variables for the training phase.

In the prediction phase, the segmentation was applied first with an arbitrary threshold to separate the pixels belonging to the shoot from the background and input to the classification model, which reduces the computation cost. The R, G and B values for each pixel were taken as feature variables, classified by ANN and labelled as diseased or healthy. The pixels labelled as diseased were also false coloured as red for visualization. Ratios between the number of pixels in the diseased area and total area were calculated automatically and saved in text files. The length of necrosis measurement was based on the false colour image. Any red regions with less than 10 pixels were regarded as noise so were removed, whilst all other red regions were fitted with rectangles. If the area of fitted rectangles were less than 10,000 pixels, the correspondent red regions were further removed unless the regions were near the top of the shoots (at the point of infection). This was required to remove any blemishes that were not due to the disease. The final length was calculated by measuring the difference between the top and bottom of the rectangle.

The software is available from the East Malling github repository, (www.github.com/organizations/eastmallingresearch/).

References

  1. Bultreys A, Kaluzna M. Bacterial cankers caused by Pseudomonas syringae on stone fruit species with special emphasis on the pathovars syringae and morsprunorum race 1 and race 2. J Plant Pathol. 2010;92:S1.21–33.

    Google Scholar 

  2. Roberts SJ. HNS179 Final Report 2013. http://tinyurl.com/hgkrkje.

  3. Santi F, Russell K, Menard M, Dufour J. Screening wild cherry (Prunus avium) for resistance to bacterial canker by laboratory and field tests. For Pathol. 2004;34:349–62.

    Article  Google Scholar 

  4. Wenneker M, Janse JD, De Bruine JA. Bacterial canker of plum trees, caused by Pseudomonas syringae pathovars, as a serious threat for plum production in the Netherlands. Commun Agric Appl Biol Sci. 2011;76:575–8.

    PubMed  CAS  Google Scholar 

  5. Spotts RA, Wallis KM, Serdani M, Azarenko AN. Bacterial canker of sweet cherry in Oregon—infection of horticultural and natural wounds, and resistance of cultivar and rootstock combinations. Plant Dis. 2010;94:345–50.

    Article  Google Scholar 

  6. Wimalajeewa DLS, Cahill R, Hepworth G, Schneider HG, Washbourne JW. Chemical control of bacterial canker (Pseudomonas syringae pv. syringae) of apricot and cherry in Victoria. Aust J Exp Agric. 1991;31:705–8.

    Article  CAS  Google Scholar 

  7. Thomidis T, Exadaktylou E. Susceptibility of 30 cherry (Prunus avium) genotypes to the bacterium Pseudomonas syringae pv. syringae. New Zeal J Crop Hortic Sci. 2008;36(October 2013):215–220.

  8. Krzesinska EZ, Nina A, Azarenko M. Excised twig assay to evaluate cherry rootstocks for tolerance to Pseudomonas syringae pv. syringae. HortScience. 1992;27:153–5.

    Google Scholar 

  9. Vicente JG, Roberts SJ. Screening wild cherry micropropagated plantlets for resistance to bacterial canker. In: Santa Lacobellis N, Collmer A, Hutcheson SW, Mansfield JW, Morris C, Murillo J, Schaad NW, Stead DE, Surico G, Ullrich MS, editors. Pseudomonas syringae and related pathogens. Netherlands: Springer; 2003. p. 1–8.

    Google Scholar 

  10. Gilbert V, Planchon V, Legros F, Maraite H, Bultreys A. Pathogenicity and aggressiveness in populations of Pseudomonas syringae from Belgian fruit orchards. Eur J Plant Pathol. 2010;126:263–77.

    Article  Google Scholar 

  11. Latorre BA, Jones AL. Pseudomonas morsprunorum, the cause of bacterial canker of sour cherry in Michigan, and its epiphytic association with P. syringae. Phytopathology. 1979;69:335–9.

    Article  Google Scholar 

  12. Renick LJ, Cogal AG, Sundin GW. Phenotypic and genetic analysis of epiphytic Pseudomonas syringae populations from sweet cherry in Michigan. Plant Dis. 2008;92:372–8.

    Article  CAS  Google Scholar 

  13. Rousseau C, Belin E, Bove E, Rousseau D, Fabre F, Berruyer R, Guillaumès J, Manceau C, Jacques M-A, Boureau T. High throughput quantitative phenotyping of plant resistance using chlorophyll fluorescence image analysis. Plant Methods. 2013;9:17.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  14. Fahlgren N, Gehan MA, Baxter I. Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. Curr Opin Plant Biol. 2015;24:93–9.

    Article  PubMed  Google Scholar 

  15. Patil JK, Kumar R. Advances in image processing for detection of plant diseases. J Adv Bioinform Appl Res. 2011;2:135–41.

    Google Scholar 

  16. Bock CH, Poole GH, Parker PE, Gottwald TR. Plant disease severity estimated visually, by digital photography and image analysis, and by hyperspectral imaging. CRC Crit Rev Plant Sci. 2010;29:59–107.

    Article  Google Scholar 

  17. Nilsson HE. Remote sensing and image processing for disease. Prot Ecol. 1980;2:271–4.

    Google Scholar 

  18. Camargo A, Smith JS. An image-processing based algorithm to automatically identify plant disease visual symptoms. Biosyst Eng. 2009;102:9–21.

    Article  Google Scholar 

  19. Schikora M, Neupane B, Madhogaria S, Koch W, Cremers D, Hirt H, Kogel KH, Schikora A. An image classification approach to analyze the suppression of plant immunity by the human pathogen Salmonella Typhimurium. BMC Bioinform. 2012;13:171.

    Article  Google Scholar 

  20. Kim Khiook IL, Schneider C, Heloir MC, Bois B, Dair X, Adrian M, Trouvelot S. Image analysis methods for assessment of H2O2 production and Plasmopara viticola development in grapevine leaves: application to the evaluation of resistance to downy mildew. J Microbiol Methods. 2013;95:235–44.

    Article  PubMed  CAS  Google Scholar 

  21. Wijekoon CP, Goodwin PH, Hsiang T. Quantifying fungal infection of plant leaves by digital image analysis using Scion Image software. J Microbiol Methods. 2008;74:94–101.

    Article  PubMed  CAS  Google Scholar 

  22. Kokko EG, Conner RL, Lee B, Kuzyk AD, Kozu GC. Quantification of common root rot symptoms in resistant and susceptible barley by image analysis. Can J Plant Pathol. 2000;22:38–43.

    Article  Google Scholar 

  23. Barbedo JGA. Digital image processing techniques for detecting, quantifying and classifying plant diseases. SpringerPlus. 2013;2:660.

    Article  Google Scholar 

  24. Price TV, Gross R, Ho WJ, Osborne CF. A comparison of visual and digital image-processing methods in quantifying the severity of coffee leaf rust (Hemileia vastatrix). Aust J Exp Agric. 1993;33:97–101.

    Article  Google Scholar 

  25. Olmstead JW, Lang GA, Grove GG. Assessment of severity of powdery mildew infection of sweet cherry leaves by digital image analysis. HortScience. 2001;36:107–11.

    Google Scholar 

  26. Huang W, Lamb DW, Niu Z, Zhang Y, Liu L, Wang J. Identification of yellow rust in wheat using in situ spectral reflectance measurements and airborne hyperspectral imaging. Precis Agric. 2007;8:187–97.

    Article  Google Scholar 

  27. Bock CH, Cook AZ, Parker PE, Gottwald TR. Automated image analysis of the severity of foliar citrus canker symptoms. Plant Dis. 2009;93:660–5.

    Article  Google Scholar 

  28. Lemein T, Cox D, Albert D, Mori N. Accuracy of optical image analysis compared to conventional vegetation measurements for estimating morphological features of emergent vegetation. Estuar Coast Shelf Sci. 2015;155:66–74.

    Article  Google Scholar 

  29. Iyer-Pascuzzi AS, Symonova O, Mileyko Y, Hao Y, Belcher H, Harer J, Weitz JS, Benfey PN. Imaging and analysis platform for automatic phenotyping and trait ranking of plant root systems. Plant Physiol. 2010;152:1148–57.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  30. Jackson EW, Obert DE, Menz M, Hu G, Avant JB, Chong J, Bonman JM. Characterization and mapping of oat crown rust resistance genes using three assessment methods. Phytopathology. 2007;97:1063–70.

    Article  PubMed  CAS  Google Scholar 

  31. Abràmoff MD, Magalhães PJ, Ram SJ. Image processing with ImageJ. Biophotonics Int. 2004;11:36–41.

    Google Scholar 

  32. Martin DP, Rybicki EP. Microcomputer-based quantification of maize streak virus symptoms in Zea mays. Phytopathology. 1998;88:422–7.

    Article  PubMed  CAS  Google Scholar 

  33. Ahmad IS, Reid JF, Paulsen MR, Sinclair JB. Color classifier for symptomatic soybean seeds using image processing. Plant Dis. 1999;83:320–7.

    Article  Google Scholar 

  34. Naikwadi S, Niket A. Advances in image processing for detection of plant diseases. Int J Appl or Innov Eng Manag. 2013;2:168–75.

    Google Scholar 

  35. Schikora M, Schikora A. Image-based analysis to study plant infection with human pathogens. Comput Struct Biotechnol J. 2014;12:1–6.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev. 1958;65:386–408.

    Article  PubMed  CAS  Google Scholar 

  37. Al-Hiary H, Bani-Ahmad S, Reyalat M, Braik M, ALRahamneh Z. Fast and accurate detection and classification of plant diseases. Int J Comp Appl. 2011;17(1):31–38.

    Google Scholar 

  38. Krogh A. What are artificial neural networks? Nat Biotechnol. 2008;26:195–7.

    Article  PubMed  CAS  Google Scholar 

  39. Wu D, Sun D-W. Advanced applications of hyperspectral imaging technology for food quality and safety analysis and assessment: a review—Part I: Fundamentals. Innov Food Sci Emerg Technol. 2013;19:1–14.

    Article  CAS  Google Scholar 

  40. Wu D, Sun D-W. Advanced applications of hyperspectral imaging technology for food quality and safety analysis and assessment: a review—Part II: Applications. Innov Food Sci Emerg Technol. 2013;19:15–28.

    Article  CAS  Google Scholar 

  41. Hetzroni A, Miles GE, Engel BA, Hammer PA, Latin RX. Machine vision monitoring of plant health. Adv Space Res. 1994;14:203–12.

    Article  PubMed  CAS  Google Scholar 

  42. Pydipati R, Burks TF, Lee WS. Statistical and neural network classifiers for citrus disease detection using machine vision. Trans ASAE. 2005;48:2007–14.

    Article  Google Scholar 

  43. Huang KY. Application of artificial neural network for detecting Phalaenopsis seedling diseases using color and texture features. Comput Electron Agric. 2007;57:3–11.

    Article  Google Scholar 

  44. Wang H, Li G, Ma Z, Li X. Application of neural networks to image recognition of plant diseases. In Proceedings of the 2012 International Conference on Systems and Informatics (ICSAI). 2012:2159-2164.

  45. Nita M, Ellis MA, Madden LV. Reliability and accuracy of visual estimation of phomopsis leaf blight of strawberry. Phytopathology. 2003;93:995–1005.

    Article  PubMed  CAS  Google Scholar 

  46. Long L, Olsen J Sweet cherry cultivars for brining, freezing, and canning in Oregon. 2013. https://catalog.extension.oregonstate.edu/files/project/pdf/em9056.pdf. Accessed 12 May 2015.

  47. APS. Merton cherries from England. J Fruit Var Hortic Dig. 1966; 20:46.

  48. RHS. Bacterial canker. [https://www.rhs.org.uk/advice/profile?PID=86].

  49. Garrett CME. Pathogenic races of Pseudomonas morsprunorum. In Proceedings of the IVth International Conference on Plant pathogenic Bacteria Vol II; 1978:889–890.

  50. VSN International. Genstat for Windows 14th Edition. 2011. www.GenStat.co.uk. Accessed 12 May 2015.

  51. Oualline S. Practical C++ Programming. 2nd ed. CA: O’Reilly; 2003.

    Google Scholar 

  52. Laganière R. OpenCV 2 Computer Vision Application Programming Cookbook. 2011.

  53. Microsoft. Microsoft Excel [computer software]. 2011. Redmond: Microsoft.

Download references

Authors’ contributions

RJH devised the study in collaboration with MH and BL. MH and BL carried out experimental work and software development respectively. JM and RWJ assisted with the development of the pathogenicity test. All authors read and approved the final manuscript.

Acknowledgements

We thank Steve Roberts and David Guttman for generously providing bacterial strains. We also thank Karen Russell and Connie Garrett for valuable advice about the pathogenicity test development and its potential deployment in breeding programmes.

Competing interests

The authors declare that they have no competing interests.

Author information

Author notes

    Authors and Affiliations

    1. East Malling Research, New Road, East Malling, ME19 6BJ, Kent, UK

      Bo Li, Michelle T. Hulin, Philip Brain & Richard J. Harrison

    2. Faculty of Natural Sciences, Imperial College London, SW7 2AZ, London, UK

      John W. Mansfield

    3. School of Biological Sciences, University of Reading, Reading, RG6 6AJ, UK

      Michelle T. Hulin, Robert W. Jackson & Richard J. Harrison

    Authors
    1. Bo Li
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Michelle T. Hulin
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Philip Brain
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. John W. Mansfield
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Robert W. Jackson
      View author publications

      You can also search for this author in PubMed Google Scholar

    6. Richard J. Harrison
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding author

    Correspondence to Richard J. Harrison.

    Additional information

    Bo Li and Michelle T. Hulin equally contributed to this work

    Additional file

    13007_2015_100_MOESM1_ESM.pdf

    Additional file 1. Figure S1. A standard view of the GUI during manual selection of training data. Figure S2. A standard view of the GUI during percentage area of necrosis estimation. Figure S3. A standard view of the GUI during necrosis length estimation. Figure S4. Visual output of ANOVA from Genstat including the histogram of residuals, fitted-value plot and normality plots. Figure S5. Interaction plot showing percentage necrosis for all P. syringae strains on the different Prunus species cherry and plum. The mean values from the ANOVA were used and Least Significant Difference bars calculated during the ANOVA. The means are plotted on a log scale with back-transformed values as the scale. Strains isolated from cherry are highlighted in red whilst those isolated from plum are highlighted in purple. Figure S6. The relationship between the percentage area of necrosis measured using ImageJ or automated image analysis software using fixed thresholding. The linear fitted line indicated the deviation from the ideal calibration line. Figure S7. The relationship between the percentage area of necrosis measured using ImageJ or automated image analysis software using adaptive thresholding. The linear fitted line indicated the deviation from the ideal calibration line. Figure S8. Graphical depiction of an artificial neural network (ANN) model containing one input layer with three neurons, one binary output layer and one hidden layer with sixteen neurons. Table S1. List of bacterial strains used in pathogenicity assays, with source host and reference. Table S2. ANOVA table generated using Genstat. The ANOVA was performed on the log transformed (+0.1) raw data values. The formula used was aov(strain*(species/cv)+box).

    Rights and permissions

    Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Li, B., Hulin, M.T., Brain, P. et al. Rapid, automated detection of stem canker symptoms in woody perennials using artificial neural network analysis. Plant Methods 11, 57 (2015). https://doi.org/10.1186/s13007-015-0100-8

    Download citation

    • Received:

    • Accepted:

    • Published:

    • DOI: https://doi.org/10.1186/s13007-015-0100-8

    Keywords

    Plant Methods

    ISSN: 1746-4811