基于集成学习与知识蒸馏的岩性智能识别方法研究

Research on intelligent lithology recognition method based on ensemble learning and knowledge distillation

  • 摘要: 为研究基于图像开展岩性智能判识这一工程问题,针对铁路隧道施工现场实地岩块进行拍照,开展岩块手标本鉴定,并结合相关地质资料,赋予岩块图像岩性标签。采用旋转翻转等操作进行图像增强工作,构建岩性图像样本集,对比3种卷积神经网络(DenseNet121、InceptionV3、ResNet50V2)在岩性样本集上的分类效果;使用集成学习方法,探究上述3种基学习器在各组合方式及各元学习器下(逻辑回归、支持向量机、决策树)的集成效果,将最优组合下集成模型的分类预测能力蒸馏到轻量化模型(MobileNetV2)中,通过设置不同的蒸馏温度比选出最优的蒸馏学生模型;最后结合公开数据集和新收集的岩块图像进行泛化性验证。结果表明:DenseNet121、InceptionV3和ResNet50V2的总体分类准确率分别为95.11%、92.37%和91.77%,逻辑回归集成了DenseNet121和ResNet50V2的模型表现最佳,总体准确率达到97.73%;温度系数为20时,蒸馏出的学生模型大小比教师模型缩减了近94%,总体分类准确率可达96.66%;此外,蒸馏模型在额外新数据集上的总体准确率达到92.9%,显著优于人工判识。

     

    Abstract: To address the engineering challenge of intelligent lithology identification based on images, this study involves photographing rock blocks at railway tunnel construction sites, conducting hand-specimen identification, and assigning lithology labels to the rock images in combination with relevant geological data. Image enhancement techniques, such as rotation and flipping, were employed to construct a lithological image dataset. Subsequently, the classification performance of three convolutional neural networks (DenseNet121, InceptionV3, and ResNet50V2) on this dataset was compared. Ensemble learning was utilized to investigate the integration effects of these three base learners under various combination strategies and with different meta-learners (Logistic Regression, Support Vector Machine, and Decision Tree). The classification predictive capability of the optimal ensemble model was then distilled into a lightweight model (MobileNetV2). By setting different distillation temperatures, the optimal student model was selected. Finally, generalization was validated using both public datasets and newly collected rock block images.

     

/

返回文章
返回