Can Edge-Deployable Vision-Language Models Identify Species?

The research asks whether practical 2–8B general-purpose vision-language models have verifiable fine-grained species-identification knowledge and how their performance compares with the expert model BioCLIP. The comparison examines model scale and family, closed-set and open-set prompting, image-processing choices, and the change from clean photographs to camera-trap images. It also investigates whether classification difficulty is more closely associated with taxonomic level, image quality, or model type. Open-ended querying is treated as a separate risk: the evaluation checks whether models generate species names that are syntactically valid but taxonomically nonexistent, and whether hallucination risk has a consistent ordering across models.

The work adds no model-architecture or task-representation mechanism. Its analytical mechanism is a controlled comparison across model type, scale, prompt format, image processing, and image domain. General-purpose VLMs are evaluated alongside BioCLIP, while clean photographs and camera-trap images expose the effect of changing visual conditions. Closed-set prompts constrain answers to candidate species, whereas open-ended prompts reveal whether a generative model refuses, overreaches, or invents a species name. Independent resampling is used to examine whether observed performance differences and the ordering of hallucination risk persist beyond a single sample.

Within the tested edge-deployment range, general-purpose VLMs show species-classification knowledge substantially above chance but remain clearly behind the smaller BioCLIP expert model. Every model significantly degrades when moving from clean images to camera-trap images, and BioCLIP’s degradation is not statistically different from that of the best general-purpose model. The authors therefore judge that the main difficulty is more likely image discernibility and domain shift than a fine-grained classification defect specific to general-purpose VLMs. Open-ended queries produce species names that are linguistically well formed but taxonomically nonexistent, and the relative hallucination-risk ordering is reproduced by independent resampling. The evaluation also reports effects associated with model family, scale, prompts, and image processing, together with latency, memory use, refusal, and overreach behavior.

The conclusions are limited to Qwen3-VL 2B/4B/8B, Gemma3 4B, and BioCLIP under Q4 quantization, 96 species, iNaturalist clean photographs, six LILA camera-trap image collections, specified closed-set or open-set prompts, and the tested image-processing conditions. They do not establish behavior for models above 32B, frontier models, full-precision VLMs, or independent external camera networks and sites. BioCLIP uses forced selection, while generative VLMs may refuse or exceed the candidate set, so their results are affected by a design difference. The attribution of BioCLIP’s advantage to specialized training data and of degradation to image quality remains an interpretation from these tests, not a result established across untested deployment conditions.