Rice Map** in a Subtropical Hilly Region Based on Sentinel-1 Time Series Feature Analysis and the Dual Branch BiLSTM Model
Abstract
:1. Introduction
- This study proposes a new feature combination, (VV − VH)/(VV + VH) feature combination, which can increase the difference between rice and non-rice crops in tropical or subtropical hilly areas.
- A dual branch BiLSTM network (DB-BiLSTM) is designed, which can ensure the independent learning of multiple features and realize the effective combination of (VV − VH)/(VV + VH) and VH polarization features.
2. Materials and Methods
2.1. Study Area
2.2. Experimental Data and Sample Dataset
2.3. Methods
2.3.1. Analysis and Characterization of Scattering Characteristics of Rice
2.3.2. Dual Branch BiLSTM (DB-BiLSTM) Model
2.3.3. Accuracy Assessment
3. Results
3.1. Comparison of Different Feature Combinations
3.2. Comparison of Different Methods
3.3. Rice Map**
4. Discussion
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Desa, U. Transforming Our World: The 2030 Agenda for Sustainable Development. 2016. Available online: https://sdgs.un.org/publications/transforming-our-world-2030-agenda-sustainable-development-17981 (accessed on 5 June 2022).
- Kuenzer, C.; Knauer, K. Remote sensing of rice crop areas. Int. J. Remote Sens. 2012, 34, 2101–2139. [Google Scholar] [CrossRef]
- FAOSTAT. Statistical Database of the Food and Agricultural Organization of the United Nations; FAOSTAT: Rome, Italy, 2010. [Google Scholar]
- Wang, Z.; Yang, X.; Zhou, C. Geographic knowledge graph for remote sensing big data. J. Geo-Inf. Sci. 2021, 23, 13. [Google Scholar] [CrossRef]
- Orynbaikyzy, A.; Gessner, U.; Conrad, C. Crop type classification using a combination of optical and radar remote sensing data: A review. Int. J. Remote Sens. 2019, 40, 6553–6595. [Google Scholar] [CrossRef]
- Liu, C.-A.; Chen, Z.-X.; Shao, Y.; Chen, J.-S.; Hasi, T.; Pan, H.-Z. Research advances of SAR remote sensing for agriculture applications: A review. J. Integr. Agric. 2019, 18, 506–525. [Google Scholar] [CrossRef] [Green Version]
- Zhu, Z.; Woodcock, C.E. Object-based cloud and cloud shadow detection in Landsat imagery. Remote Sens. Environ. 2012, 118, 83–94. [Google Scholar] [CrossRef]
- Huang, X.; Wang, J.; Shang, J.; Liao, C.; Liu, J. Application of polarization signature to land cover scattering mechanism analysis and classification using multi-temporal C-band polarimetric RADARSAT-2 imagery. Remote Sens. Environ. 2017, 193, 11–28. [Google Scholar] [CrossRef]
- Mosleh, M.K.; Hassan, Q.K.; Chowdhury, E.H. Application of remote sensors in map** rice area and forecasting its production: A review. Sensors 2015, 15, 769–791. [Google Scholar] [CrossRef] [Green Version]
- Hoang, H.K.; Bernier, M.; Duchesne, S.; Tran, Y.M. Rice Map** Using RADARSAT-2 Dual- and Quad-Pol Data in a Complex Land-Use Watershed: Cau River Basin (Vietnam). IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2016, 9, 3082–3096. [Google Scholar] [CrossRef]
- Clauss, K.; Ottinger, M.; Leinenkugel, P.; Kuenzer, C. Estimating rice production in the Mekong Delta, Vietnam, utilizing time series of Sentinel-1 SAR data. Int. J. Appl. Earth Obs. Geoinf. 2018, 73, 574–585. [Google Scholar] [CrossRef]
- Clauss, K.; Ottinger, M.; Kuenzer, C. Map** rice areas with Sentinel-1 time series and superpixel segmentation. Int. J. Remote Sens. 2017, 39, 1399–1420. [Google Scholar] [CrossRef] [Green Version]
- Singha, M.; Dong, J.; Zhang, G.; ** Using Time-Series Sentinel-1 SAR Data in the Mun River Basin, Thailand. Remote Sens. 2020, 12, 3959. [Google Scholar] [CrossRef]
- Boschetti, M.; Busetto, L.; Manfron, G.; Laborte, A.; Asilo, S.; Pazhanivelan, S.; Nelson, A. PhenoRice: A method for automatic extraction of spatio-temporal information on rice crops using satellite data time series. Remote Sens. Environ. 2017, 194, 347–365. [Google Scholar] [CrossRef] [Green Version]
- Bazzi, H.; Baghdadi, N.; El Hajj, M.; Zribi, M.; Minh, D.H.T.; Ndikumana, E.; Courault, D.; Belhouchette, H. Map** Paddy Rice Using Sentinel-1 SAR Time Series in Camargue, France. Remote Sens. 2019, 11, 887. [Google Scholar] [CrossRef] [Green Version]
- Chang, L.; Chen, Y.-T.; Chan, Y.-L.; Wu, M.-C. A Novel Feature for Detection of Rice Field Distribution Using Time Series SAR Data. In Proceedings of the IGARSS 2020–2020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA, 26 September–2 October 2020; pp. 4866–4869. [Google Scholar]
- Pan, B.; Zheng, Y.; Shen, R.; Ye, T.; Zhao, W.; Dong, J.; Ma, H.; Yuan, W. High Resolution Distribution Dataset of Double-Season Paddy Rice in China. Remote Sens. 2021, 13, 4609. [Google Scholar] [CrossRef]
- Ndikumana, E.; Ho Tong Minh, D.; Baghdadi, N.; Courault, D.; Hossard, L. Deep Recurrent Neural Network for Agricultural Classification using multitemporal SAR Sentinel-1 for Camargue, France. Remote Sens. 2018, 10, 1217. [Google Scholar] [CrossRef] [Green Version]
- Mansaray, L.R.; Kabba, V.T.S.; Zhang, L.; Bebeley, H.A. Optimal multi-temporal Sentinel-1A SAR imagery for paddy rice field discrimination; a recommendation for operational map** initiatives. Remote Sens. Appl. Soc. Environ. 2021, 22, 100533. [Google Scholar] [CrossRef]
- Yang, L.; Huang, R.; Huang, J.; Lin, T.; Wang, L.; Mijiti, R.; Wei, P.; Tang, C.; Shao, J.; Li, Q.; et al. Semantic Segmentation Based on Temporal Features: Learning of Temporal-Spatial Information from Time-Series SAR Images for Paddy Rice Map**. IEEE Trans. Geosci. Remote Sens. 2021, 60, 1–16. [Google Scholar] [CrossRef]
- Shao, Y.; Fan, X.; Liu, H.; ** Patterns with Sentinel-1 Multitemporal Imagery. Master’s Thesis, University of Twente, Enschede, The Netherlands, 2018. [Google Scholar]
- He, Z.; Li, S.; Wang, Y.; Dai, L.; Lin, S. Monitoring Rice Phenology Based on Backscattering Characteristics of Multi-Temporal RADARSAT-2 Datasets. Remote Sens. 2018, 10, 340. [Google Scholar] [CrossRef] [Green Version]
- Park, S.; Im, J.; Park, S.; Yoo, C.; Han, H.; Rhee, J. Classification and Map** of Paddy Rice by Combining Landsat and SAR Time Series Data. Remote Sens. 2018, 10, 447. [Google Scholar] [CrossRef] [Green Version]
- You, N.; Dong, J.; Huang, J.; Du, G.; Zhang, G.; He, Y.; Yang, T.; Di, Y.; ** intensity in a mixed single- and double-crop** region in South China using all available Sentinel 1/2 images. Int. J. Appl. Earth Obs. Geoinf. 2021, 101, 102351. [Google Scholar] [CrossRef]
- Son, N.-T.; Chen, C.-F.; Chen, C.-R.; Minh, V.-Q. Assessment of Sentinel-1A data for rice crop classification using random forests and support vector machines. Geocarto Int. 2018, 33, 587–601. [Google Scholar] [CrossRef]
- Wei, S.; Zhang, H.; Wang, C.; Wang, Y.; Xu, L. Multi-Temporal SAR Data Large-Scale Crop Map** Based on U-Net Model. Remote Sens. 2019, 11, 68. [Google Scholar] [CrossRef] [Green Version]
- Fernandez-Beltran, R.; Baidar, T.; Kang, J.; Pla, F. Rice-yield prediction with multi-temporal sentinel-2 data and 3D CNN: A case study in Nepal. Remote Sens. 2021, 13, 1391. [Google Scholar] [CrossRef]
- Kussul, N.; Lavreniuk, M.; Skakun, S.; Shelestov, A. Deep learning classification of land cover and crop types using remote sensing data. IEEE Geosci. Remote Sens. Lett. 2017, 14, 778–782. [Google Scholar] [CrossRef]
- Xu, L.; Zhang, H.; Wang, C.; Wei, S.; Zhang, B.; Wu, F.; Tang, Y. Paddy Rice Map** in Thailand Using Time-Series Sentinel-1 Data and Deep Learning Model. Remote Sens. 2021, 13, 3994. [Google Scholar] [CrossRef]
- Thorp, K.R.; Drajat, D. Deep machine learning with Sentinel satellite data to map paddy rice production stages across West Java, Indonesia. Remote Sens. Environ. 2021, 265, 112679. [Google Scholar] [CrossRef]
- Sun, C.; Zhang, H.; Xu, L.; Wang, C.; Li, L. Rice Map** Using a BiLSTM-Attention Model from Multitemporal Sentinel-1 Data. Agriculture 2021, 11, 977. [Google Scholar] [CrossRef]
- Liu, Y.; Zhao, W.; Chen, S.; Ye, T. Map** Crop Rotation by Using Deeply Synergistic Optical and SAR Time Series. Remote Sens. 2021, 13, 4160. [Google Scholar] [CrossRef]
- Lin, Z.; Zhong, R.; ** Using Multi-Task Spatiotemporal Deep Learning and Sentinel-1 SAR Time Series. Remote Sens. 2022, 14, 699. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Nguyen, D.B.; Gruber, A.; Wagner, W. Map** rice extent and crop** scheme in the Mekong Delta using Sentinel-1A data. Remote Sens. Lett. 2016, 7, 1209–1218. [Google Scholar] [CrossRef]
- Phan, H.; Le Toan, T.; Bouvet, A. Understanding Dense Time Series of Sentinel-1 Backscatter from Rice Fields: Case Study in a Province of the Mekong Delta, Vietnam. Remote Sens. 2021, 13, 921. [Google Scholar] [CrossRef]
- Li, Z.; Yuan, J.; Zhang, W. Fuzzy C-Mean Algorithm with Morphology Similarity Distance. In Proceedings of the 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery, Tian**, China, 14–16 August 2009; pp. 90–94. [Google Scholar]
- Van Houdt, G.; Mosquera, C.; Nápoles, G. A review on the long short-term memory model. Artif. Intell. Rev. 2020, 53, 5929–5955. [Google Scholar] [CrossRef]
- Olah, C. Understanding LSTM Networks. 2015. Available online: https://colah.github.io/posts/2015-08-Understanding-LSTMs/ (accessed on 3 December 2021).
- Hameed, Z.; Garcia-Zapirain, B.; Ruiz, I.O. A Computationally Efficient BiLSTM Based Approach for the Binary Sentiment Classification. In Proceedings of the 2019 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Ajman, United Arab Emirates, 10–12 December 2019; pp. 1–4. [Google Scholar]
- Vapnik, V.N. An overview of statistical learning theory. IEEE Trans. Neural Netw. 1999, 10, 988–999. [Google Scholar] [CrossRef] [Green Version]
- Congalton, R.G. A review of assessing the accuracy of classifications of remotely sensed data. Remote Sens. Environ. 1991, 37, 35–46. [Google Scholar] [CrossRef]
- McHugh, M.L. Interrater reliability: The kappa statistic. Biochem. Med. 2012, 22, 276–282. [Google Scholar] [CrossRef]
Orbit–Scene: 113-71 | |||||||
---|---|---|---|---|---|---|---|
No. | Date | No. | Date | No. | Date | No. | Date |
1 | 21 March 2019 | 7 | 25 June 2019 | 13 | 5 September 2019 | 19 | 16 November 2019 |
2 | 14 April 2019 | 8 | 7 July 2019 | 14 | 17 September 2019 | 20 | 28 November 2019 |
3 | 26 April 2019 | 9 | 19 July 2019 | 15 | 29 September 2019 | 21 | 10 December 2019 |
4 | 20 May 2019 | 10 | 31 July 2019 | 16 | 11 October 2019 | 22 | 22 December 2019 |
5 | 1 June 2019 | 11 | 12 August 2019 | 17 | 23 October 2019 | ||
6 | 13 June 2019 | 12 | 24 August 2019 | 18 | 4 November 2019 |
Field Research Plots | |||
---|---|---|---|
Crop | Number of Plots | Number of Pixels | |
Rice | 10 | 1156 | |
Corn | 6 | 182 | |
Others | 5 | 504 | |
Number of samples | |||
Class | Pixels for training (80%) | Pixels for testing (20%) | Total (100%) |
Rice | 4030 | 1008 | 5038 |
Non-rice | 8640 | 2160 | 10,800 |
Layers | Input | Output |
---|---|---|
Branch1/2 | BatchSize × 22 × 1 | BatchSize × 64 |
Concatenate | BatchSize × 64, BatchSize × 64 | BatchSize × 128 |
Fully Connected Layer1 | BatchSize × 128 | BatchSize × 32 |
Fully Connected Layer2 | BatchSize × 32 | BatchSize × 2 |
Softmax | BatchSize × 2 | BatchSize × 1 |
Features | |||||
---|---|---|---|---|---|
RF | |||||
VH | 87.30 | 91.35 | 88.74 | 90.03 | 0.7255 |
VH + VV | 86.59 | 87.98 | 90.40 | 89.17 | 0.7157 |
91.04 | 89.79 | 95.67 | 92.64 | 0.8123 | |
BiLSTM | |||||
VH | 93.43 | 97.58 | 92.38 | 94.91 | 0.8567 |
VH + VV | 93.32 | 98.14 | 91.09 | 94.48 | 0.8606 |
93.97 | 99.43 | 90.92 | 94.98 | 0.8748 | |
DB-BiLSTM | |||||
VH + VV | 94.46 | 98.80 | 92.30 | 95.44 | 0.8841 |
97.29 | 99.11 | 96.54 | 97.81 | 0.9424 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Sun, C.; Zhang, H.; Ge, J.; Wang, C.; Li, L.; Xu, L. Rice Map** in a Subtropical Hilly Region Based on Sentinel-1 Time Series Feature Analysis and the Dual Branch BiLSTM Model. Remote Sens. 2022, 14, 3213. https://doi.org/10.3390/rs14133213
Sun C, Zhang H, Ge J, Wang C, Li L, Xu L. Rice Map** in a Subtropical Hilly Region Based on Sentinel-1 Time Series Feature Analysis and the Dual Branch BiLSTM Model. Remote Sensing. 2022; 14(13):3213. https://doi.org/10.3390/rs14133213
Chicago/Turabian StyleSun, Chunling, Hong Zhang, Ji Ge, Chao Wang, Liutong Li, and Lu Xu. 2022. "Rice Map** in a Subtropical Hilly Region Based on Sentinel-1 Time Series Feature Analysis and the Dual Branch BiLSTM Model" Remote Sensing 14, no. 13: 3213. https://doi.org/10.3390/rs14133213