From space to farm: readying NASA satellites to help growers

An autonomous robot - a base on wheels fitted with computer vision technology that snaps images of grapevines in near real-time - rolls down a long row of plants in a vineyard at Cornell AgriTech in Geneva, New York.

The Cornell-developed "PhytoPatholoBot"detects spectral signatures of three kinds of devastating grape diseases - powdery mildew, downy mildew and grapevine leafroll virus - leading to early management of pathogens without needing farmworkers to spot them. Ultimately, data collected by such robots will help to ground-truth NASA satellite data that could one day detect plant diseases from space.

This was one of many research projects presented at a technology demonstration on Aug. 20, part of a three-day "Space for Ag Tour" by NASA leaders to better understand the remote sensing needs of Cornell AgriTech researchers, specialty crop growers and local stakeholders. NASA leadership visited Cornell's main campus, Cornell AgriTech, sites in Niagara county and the Cornell Lake Erie Research and Extension Lab in Portland, New York.

The tour was designed to foster two-way dialogue with growers and stakeholders to improve NASA Earth Science's Earth-observing satellites and instruments for specialty crop agriculture and viticulture and foster a broader conversation about how to effectively translate research into practice.

"My hope is that by having this Space for Ag Tour here, by showing them New York viticulture as well as what we have to offer here at Cornell, it can help grow the specialty crop footprint within NASA as well as their footprint in pest and disease research," said Katie Gold, the event's main organizer and an assistant professor and the Susan Ekert Lynch Faculty Fellow in the Plant Pathology and Plant-Microbe Biology Section of the School of Integrative Plant Science (SIPS) at Cornell AgriTech, which is in the College of Agriculture and Life Sciences.

"I think there's amazing potential for the satellite data that's being collected both now and in the future with the eventual launch of the Surface Biology and Geology satellite to be applied to specialty crops," said Gold, who is an expert on ground-based and remote plant disease sensing and applied grape pathology. The meetings were intended to raise awareness among NASA leaders and scientists of the unique challenges facing specialty crops, including pests and diseases, so they can make those connections in their own research and applications, she said.

"For NASA leadership, it's an opportunity as they think long-term about observational needs and priorities that helps them make the case for the observations that are necessary, from a scientific perspective, to make an impact on the different concerns that farmers have," said Alyssa Whitcraft, a research professor in the Department of Geographical Sciences at the University of Maryland, whose work focuses on satellite remote sensing of agriculture. Whitcraft is the founding executive director of NASA Acres and co-founding deputy director of NASA Harvest, respectively the U.S. and international NASA consortia on food security and agriculture. Gold is the institutional lead for NASA Acres at Cornell.

As part of the demonstrations, Yun Yang, assistant professor in SIPS' Soil and Crop Sciences Section at Cornell AgriTech, described her NASA Acres-funded research to monitor plant water use using remote sensing, and understanding the impacts of agricultural practices on water resource sustainability.

One of Yang's research projects seeks to estimate water loss to evaporation and transpiration in California vineyards. Vineyard managers want to know how much and when to irrigate in spring based on groundwater depletion, which is a global issue, especially in California.

Her team built an instrument to better monitor water fluxes on the ground, which provides validation for NASA Landsat satellite data that can be used to estimate water loss to evapotranspiration when farmers irrigate. By knowing how much water is used, based on a simple water balance, they can tell how much water is needed. Yang's team has been developing a dashboard for users. "With this dashboard, we can really hand the technology we have to the growers," Yang said. "And when they are in the field, we can easily check the information and help them manage irrigation."

Applied roboticist Yu Jiang, assistant professor in SIPS' Horticulture Section at Cornell AgriTech, demonstrated the PhytoPatholoBot that he and doctoral student Ertai Liu developed with Gold with funding from NASA Acres and U.S. Department of Agriculture National Institute of Food and Agriculture VitisGen3.

The PhytoPatholoBot eliminates background noise from cloud cover or sunlight to provide a constant, high-quality image and has autonomous navigation using GPS. The bot provides a readout per row of vines with red areas denoting higher infection and white areas showing lower infection, and coupled with AI, allows for near real-time inferences of disease that growers may use to focus their treatment efforts on plants that need it most.

"We can scan and scale all the field, we are also generating the results that are ready to be realized by the growers, and hopefully, while working together to integrate this data stream back to NASA to see if we can train remote sensing models and make a bigger impact for small grower stakeholders," Jiang said. Additionally, researchers can use data from the robots to train NASA airborne sensing better than humans, Gold said.

The hope is to use robots to automate data collection, to make it possible to gather measurements for millions of acres.

Following Jiang, Sarah Emery, assistant professor of entomology at Cornell AgriTech, presented her work to develop risk maps for spotted lanternfly infestations, a growing threat to grape and other growers in New York.

"We've been trying to understand how this insect pest is going to be moving across the landscape and develop a model to assess the risk to individual vineyards across New York state," Emery said.

In collaboration with the New York State Department of Agriculture and Markets, the model being developed will overlay observations of spotted lanternfly (90,000 sightings have been recorded across the state) with maps of vineyards and locations of its preferred host, tree of heaven. Eventually, they plan to create a public-facing system so that growers can input their information and get back a level of risk.

The hope is to use hyperspectral data (which allows for the identification of objects and materials by analyzing their unique spectral signatures) from satellites to identify light reflectance patterns of non-crop plants across the landscape to create risk maps at finer and wider scales. Emery has teamed with Gold and doctoral student Jaclyn Eller for the project.

Also, Jason Londo, associate professor of fruit crop physiology and climate adaptation in SIPS Horticulture Section at Cornell AgriTech, described using hyperspectral and multispectral approaches to understanding plant stress in grapes and apples using drones. He hopes to one day use similar data from satellites, but needs better resolution to be able to detect stress on a tree-by-tree basis, he said.

Other visiting NASA personnel included Karen St. Germain, division director of the Earth Science Division in the Science Mission Directorate at NASA. Steven Wolf, associate professor of natural resources and the environment in CALS, organized events at Cornell's Ithaca campus.