Title : Deep learning and grapes: the digitalization of plants, one plant at a time
Abstract:
Since the dawn of agriculture, crop monitoring and inspection remains a mainstay of every farmer’s routine. Today, many farmers visually inspect their crops armed with a variety of tools to help ensure ideal plant health and performance. Although human visual inspection remains an essential part of agriculture, it has many challenges and many limitations. Research over the last decade or so has assessed the applicability of computer vision and deep learning to address the crop inspection challenge. These approaches have shown tremendous promise, they are only just now beginning to go beyond the research phase into commercialization. Around 2015, image processing methods using deep neural networks began to replace the earlier classical computer vision approach, providing both better performance and more generalizable results. Again, through the early work of the CMU team, a StalkNet architecture was developed, which combines an RCNN feature detector with a GAN based pixel segmentation.
To date, StalkNet has been trained to measure dozens of widely varying features in different crops, ranging from leaf necrosis to fruit ripeness to sorghum seed size for grain yield. Bloomfield currently services 16 wine, table and juice grape vineyards in three countries (i.e., US, France & Italy) as well as a blueberry grow in Peru.. Flash combines high-resolution flash lighted stereo RGB images with a cloud-based deep learning pipeline to inspect and assess the health and performance of each and every plant in a field or grow, one plant at a time. The result, so far, with Bloomfield’s vineyard customers is yield estimation, pest/disease detection, labor saving and digitalization. This comprehensive analysis forms the foundation for Bloomfield’s health and performance assessment of each geo-located plant, one plant at a time through a web-based dashboard accessible via tablet, cellphone or computer. Bloomfield’s approach to inspecting and assessing plants contrasts sharply with the visual inspection which includes sparse subjective judgements of randomly sampled plant
