83 lines
7.0 KiB
Plaintext
83 lines
7.0 KiB
Plaintext
|
o
|
|||
|
|
î/<iw) ã
|
|||
|
|
@ sÀ d Z ddlZddlZddlZddlmZ ddl m
|
|||
|
|
Z
|
|||
|
|
ddl m Z m
|
|||
|
|
Z
|
|||
|
|
ddlmZ ddlZddlmZ ddlZddlZddlZddlmZ dd lmZ g d
|
|||
|
|
¢d d d
|
|||
|
|
dddddddddf
|
|||
|
|
dd„ZdS )zy
|
|||
|
|
Training module for land classification using Sentinel-2 and Sentinel-1 data
|
|||
|
|
from Microsoft Planetary Computer STAC API
|
|||
|
|
é N)Útrain_test_split)Ú LabelEncoder)Úclassification_reportÚconfusion_matrix)Ú
|
|||
|
|
XGBClassifier)Údatetime)ÚClient)Úload)gffffffZ@gš™™™™™"@gÍÌÌÌÌŒZ@gš™™™™™#@z2023-03-01/2023-05-31é é é z1train/ST_training data_updated_1130points_new.shpéd gš™™™™™¹?Tc
|
|||
|
|
9
|
|||
|
|
s do‡fdd„ }
|
|||
|
|
‡ fdd„}�z·|
|
|||
|
|
du r t ¡ d¡}d|› d�}
|
|||
|
|
|
|
|||
|
|
d d
|
|||
|
|
ƒ t d ¡}|ƒ |
|
|||
|
|
d d
|
|||
|
|
ƒ |jdg| |dd|iid�}t| ¡ ƒ}|ƒ t|ƒ|kr`t|ƒ| }|dd|… d|… }|
|
|||
|
|
dt|ƒ› d�dƒ |
|
|||
|
|
ddƒ dd„ |D ƒ}t |g d¢d|| t
|
|||
|
|
j dd �}| d d d dœ¡}|ƒ |
|
|||
|
|
d d!ƒ |jd"g| |d#�}t| ¡ ƒ}t|ƒ|kr¼t|ƒ| }|dd|… d|… }|
|
|||
|
|
dt|ƒ› d$�d%ƒ |
|
|||
|
|
d&d'ƒ d(d„ |D ƒ}t |d)d*gd|| t
|
|||
|
|
j dd �}d
|
|||
|
|
t
|
|||
|
|
|d) |d) d
|
|||
|
|
k¡¡ |d+< d
|
|||
|
|
t
|
|||
|
|
|d* |d* d
|
|||
|
|
k¡¡ |d,< |ƒ |
|
|||
|
|
d-d.ƒ |d |d |d |d d/ }|d g d0¢¡}| | ¡}|jd1d2�}|
|
|||
|
|
d3d4ƒ t |¡} | jdk�rI| d¡} d} d5D ]
|
|||
|
|
} | | jv �rY| } n�qM| du �rjtd6t| jƒ› �ƒ‚|
|
|||
|
|
d7d8ƒ g } g } | ¡ D ]X\}!}"|"j}#|#j}$|#j}%|"| }&zA|j |$|%d9d:�j }'|d, j |$|%d9d:�jd1d2�j }(|d+ j |$|%d9d:�jd1d2�j })|'|(|)g}*t
|
|||
|
|
|*¡ ¡ �sÇ| |*¡ | |&¡ W �qw Y �qwt
|
|||
|
|
!| ¡} t
|
|||
|
|
!| ¡} |ƒ |
|
|||
|
|
d;t| ƒ› d<�d=ƒ t"ƒ }+|+ #| ¡},t$| |,d>d?|,d@�\}-}.}/}0|
|
|||
|
|
dAdBƒ | �rdCndD}1t%||||1dEd?dFd
|
|||
|
|
dG�}2|2 &|-|/¡ |
|
|||
|
|
dHdIƒ |2 '|-|/¡}3|2 '|.|0¡}4|
|
|||
|
|
dJdKƒ t(j)t(j* +|
|
|||
|
|
¡dLdM� t, -|2|+dNœ|
|
|||
|
|
¡ i dOt ¡ .¡ “dPdQ“dRdd"g“dSg dT¢“dUt|-ƒ“dVt|.ƒ“dWt/|3ƒ“dXt/|4ƒ“dYdZ“d[|1“d\dE“d]|“d^|“d_|“d`| “da|“db|“}5|
|
|||
|
|
0ddc¡}6t|6ddƒ�}7t1j-|5|7dedf� W d ƒ n 1 �s©w Y |
|
|||
|
|
dgdhƒ dL|
|
|||
|
|
|6|3|4t|-ƒt|.ƒ|+j2 3¡ diœW S t4�yê }8 z|
|
|||
|
|
djt5|8ƒ› �dkƒ dt5|8ƒdLdlœW Y d}8~8S d}8~8w t6�y
|
|||
|
|
}8 z|
|
|||
|
|
dmt5|8ƒ› �dkƒ dt5|8ƒdnœW Y d}8~8S d}8~8ww )pa}
|
|||
|
|
Train a land classification model using Sentinel-2 and Sentinel-1 data
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
bbox: [min_lon, min_lat, max_lon, max_lat]
|
|||
|
|
time_range: "YYYY-MM-DD/YYYY-MM-DD"
|
|||
|
|
max_scenes: maximum number of scenes to load
|
|||
|
|
cloud_cover: maximum cloud cover percentage
|
|||
|
|
resolution: resolution in meters (e.g., 20)
|
|||
|
|
training_shapefile: path to training shapefile
|
|||
|
|
n_estimators: number of trees for XGBoost
|
|||
|
|
max_depth: maximum tree depth
|
|||
|
|
learning_rate: learning rate for XGBoost
|
|||
|
|
use_gpu: whether to use GPU for training
|
|||
|
|
output_model_path: path to save trained model (auto-generated if None)
|
|||
|
|
status_callback: Optional callback function to report progress
|
|||
|
|
cancel_check: Optional function that returns True if training should be cancelled
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
Dictionary containing training results
|
|||
|
|
Nc s: ˆ rzˆ | |ƒ W n
|
|||
|
|
t y ˆ | ƒ Y nw t| ƒ dS )zHelper to update statusN)Ú TypeErrorÚprint)ÚmessageÚprogress)Ústatus_callback© ú3/home/x79/CSIROBoeingPhase5-Vietnam/train_module.pyÚ
|
|||
|
|
update_status= s ÿ z"train_model.<locals>.update_statusc s ˆ r ˆ ƒ r t dƒ‚dS dS )z%Check if training should be cancelledzTraining cancelled by userN)ÚInterruptedErrorr )Ú cancel_checkr r Úcheck_cancellationG s
|
|||
|
|
ÿz'train_model.<locals>.check_cancellationz
|
|||
|
|
%Y%m%d_%H%M%Sz model_train/model_xgboost_gpu_z.joblibz-Connecting to Microsoft Planetary Computer...r z3https://planetarycomputer.microsoft.com/api/stac/v1z"Searching for Sentinel-2 scenes...é
|
|||
|
|
zsentinel-2-l2azeo:cloud_coverÚlt)Ú collectionsÚbboxr ÚqueryzFound z Sentinel-2 scenesr zLoading Sentinel-2 data...é c S ó g | ]}t |¡‘qS r ©Úplanetary_computerÚsign©Ú.0Úitemr r r Ú
|
|||
|
|
<listcomp>l ó z train_model.<locals>.<listcomp>)ZB04ZB08ZSCLz
|
|||
|
|
EPSG:32648F)ZbandsÚcrsÚ
|