Digital Agriculture Datasets

Agricutural datasets for developing AI and robotics systems applied to agriculture

Image classification

• PlantCLEF2022: Image-based plant identification at global scale - https://www.imageclef.org/plantclef2022
• Deep Learning for Non-Invasive Diagnosis of Nutrient Deficiencies in Sugar Beet Using RGB Images: https://zenodo.org/records/4106221#.YqdMcexBzon
• Weed25: A deep learning dataset for weed identification: https://doi.org/10.3389/fpls.2022.1053329
• A phenotyping weeds image dataset for open scientific research: https://zenodo.org/records/7598372
• SorghumWeedDataset_Classification and SorghumWeedDataset_Segmentation datasets for classification, detection, and segmentation in deep learning: https://doi.org/10.1016/j.dib.2023.109935

Semantic segmentation

• Sugar Beets 2016: https://www.ipb.uni-bonn.de/data/sugarbeets2016/

Scene understanding

• RELLIS-3D: A Multi-modal Dataset for Off-Road Robotics: Semantic segmentation on 2D RGB images and 3D LiDAR pointclouds - https://github.com/unmannedlab/RELLIS-3D/tree/main
• RUGD Dataset: The RUGD dataset focuses on semantic understanding of unstructured outdoor environments for applications in off-road autonomous navigation. The datset is comprised of video sequences captured from the camera onboard a mobile robot platform. - http://rugd.vision/
• GOOSE dataset: GOOSE is the German Outdoor and Offroad Dataset and is a 2D & 3D semantic segmentation dataset framework. In contrast to existing datasets like Cityscapes or BDD100K, the focus is on unstructured off-road environments - https://goose-dataset.de/docs/

Synthetic datasets for semantic segmentation

• Data synthesis methods for semantic segmentation in agriculture: A Capsicum annuum dataset: https://doi.org/10.1016/j.compag.2017.12.001

Object detection

• Dataset on UAV RGB videos acquired over a vineyard including bunch labels for object detection and tracking: https://www.sciencedirect.com/science/article/pii/S2352340922010514
• ACFR Orchard Fruit Dataset: https://data.acfr.usyd.edu.au/ag/treecrops/2016-multifruit/
• An annotated visual dataset for Automatic weed detection and identification: https://zenodo.org/records/3906501
• GrapeMOTS: UAV vineyard dataset with MOTS grape bunch annotations recorded from multiple perspectives for enhanced object detection and tracking: https://doi.org/10.1016/j.dib.2024.110432
• CornWeed Dataset: A dataset for training maize and weed object detectors for agricultural machines: https://zenodo.org/records/7961764
• CitDet: A Benchmark Dataset for Citrus Fruit Detection: https://robotic-vision-lab.github.io/citdet/

Instance segmentation (detection + segmentation)

• Embrapa Wine Grape Instance Segmentation Dataset – Embrapa WGISD: https://github.com/thsant/wgisd
• SorghumWeedDataset_Classification and SorghumWeedDataset_Segmentation datasets for classification, detection, and segmentation in deep learning: https://doi.org/10.1016/j.dib.2023.109935
• The CropAndWeed Dataset: a Multi-Modal Learning Approach for Efficient Crop and Weed Manipulation: https://doi.org/10.1109/WACV56688.2023.00372
• The ACRE Crop-Weed Dataset: https://zenodo.org/records/8102217
• ROSE Challenge dataset: Crop-weed dataset with images collected in different years by different robots - https://www.challenge-rose.fr/en/dataset-download/
• MinneApple: A Benchmark Dataset for Apple Detection and Segmentation: https://github.com/nicolaihaeni/MinneApple

Tracking

• Dataset on UAV RGB videos acquired over a vineyard including bunch labels for object detection and tracking: https://www.sciencedirect.com/science/article/pii/S2352340922010514
• GrapeMOTS: UAV vineyard dataset with MOTS grape bunch annotations recorded from multiple perspectives for enhanced object detection and tracking: https://doi.org/10.1016/j.dib.2024.110432

Hyperspectral imaging

• CitrusFarm Dataset: CitrusFarm is a multimodal agricultural robotics dataset that provides both multispectral images and navigational sensor data for localization, mapping and crop monitoring tasks - https://ucr-robotics.github.io/Citrus-Farm-Dataset/

Robotics

These are multimodal datasets encompassing data from different sensors like RGB, stereo, and RGB-D cameras, LiDARs, IMUs, GPS, thermal cameras, hyperspectral cameras, etc. Normally, they do not have labels.

• Sugar Beets 2016: https://www.ipb.uni-bonn.de/data/sugarbeets2016/
• CitrusFarm Dataset: CitrusFarm is a multimodal agricultural robotics dataset that provides both multispectral images and navigational sensor data for localization, mapping and crop monitoring tasks - https://ucr-robotics.github.io/Citrus-Farm-Dataset/
• A high-resolution, multimodal data set for agricultural robotics: A Ladybird's-eye view of Brassica: https://doi.org/10.1002/rob.21877
• RELLIS-3D: A Multi-modal Dataset for Off-Road Robotics: Semantic segmentation on 2D RGB images and 3D LiDAR pointclouds - https://github.com/unmannedlab/RELLIS-3D/tree/main
• RUGD Dataset: The RUGD dataset focuses on semantic understanding of unstructured outdoor environments for applications in off-road autonomous navigation. The datset is comprised of video sequences captured from the camera onboard a mobile robot platform. - http://rugd.vision/
• GOOSE dataset: GOOSE is the German Outdoor and Offroad Dataset and is a 2D & 3D semantic segmentation dataset framework. In contrast to existing datasets like Cityscapes or BDD100K, the focus is on unstructured off-road environments - https://goose-dataset.de/docs/

Collectors of datasets

• Quantitative Plant: Website that collects datasets for image classification, semantic segmentation and phenotyping - https://www.quantitative-plant.org/dataset
• A survey of public datasets for computer vision tasks in precision agriculture: Collection of datasets for detection and segmentation of weeds and fruits and phenotyping tasks (e.g., damage and disease detection, biomas prediction, yield estimation) - https://doi.org/10.1016/j.compag.2020.105760

Tools to create synthetic datasets

• CropCraft: CropCraft is a python script that generates 3D models of crop fields, specialized in real-time simulation of robotics applications - https://github.com/Romea/cropcraft
• TomatoSynth: TomatoSynth provides realistic synthetic tomato plants training data for deep learning applications, reducing the need for manual annotation and allowing customization for specific greenhouse environments, thus advancing automation in agriculture - https://github.com/SCT-lab/TomatoSynth