关键词: 野生动物监测, 未知类别检测, 大语言模型, 视觉语言模型, 生态推理

Abstract:

Objective: In response of the problem of low recognition rate of unknown categories in infrared camera monitoring images of wildlife in open environments, a method for unknown category detection is proposed that does not rely on explicit environmental descriptions or habitat metadata, but only relies on known species labels. This method is designed for adapting to the common scenario of limited information in real monitoring dataset. Method: An envisioning unknown animal (EUA) method was proposed based on visual language feature matching, and the method integrated the ecological reasoning capability of large language model (LLM) with the cross-modal alignment of vision-language models to construct a monitoring framework for open environments. First, an ecologically-informed prompt was designed to guide the LLM to infer the regional ecological context solely from the set of known species sets and generate a list of potential species with ecological plausibility. Second, the text descriptions of these potential species were combined with known categories to construct an expanded vision-language semantic space. Finally, an outlier detection score (ODS) mechanism was introduced to robustly detect unknown categories by calculating the deviation in matching distribution of images between known categories and potential species. Result: Experiments on two public datasets, Dataset3 (D3) and North American Camera Trap Images (NACTI), demonstrated that EUA significantly outperformed existing methods. In the most challenging scenario with 5 unknown categories, the average false positive rate at 95% true positive rate (FPR@95TPR) of EUA was 57.86%, which was 16.19 percentage points lower than the suboptimal method. The area under the receiver operating characteristic curve (AUC) reached 84.31%, representing a 4.64 percentage point improvement. Ablation experiment confirmed that the ecologically-guided potential species generation and the scoring ODS mechanism were the core drivers of this performance gain. Visualization analysis further showed that EUA effectively separated the distributions of known and unknown samples, validating the effectiveness of the design. Conclusion: This study achieves a paradigm shift from “passive classification” to “proactive prediction”, providing an effective solution to the problem of unknown category detection in real-world monitoring scenarios lacking environmental priors. The EUA method not only achieves a breakthrough in performance, but also explores a feasible path for embedding ecological knowledge into AI reasoning processes, offering a new direction for building the next generation of ecologically-aware intelligent wildlife monitoring systems.

Key words: wildlife monitoring, unknown category detection, large language models, vision-language models, ecological reasoning