Vicuna, a model fine-tuned from LLaMA using ChatGPT conversations, is evaluated zero-shot on the same UniversalNER benchmark. Vicuna-7B scores 14.2% and Vicuna-13B scores 18.0% average F1, both far below ChatGPT's 34.9%. The paper notes that LLaMA and Alpaca perform even worse, close to zero F1. In the out-of-domain evaluation (Table 3), Vicuna-7B scores 13.0% and Vicuna-13B scores 17.5% average F1.
Vicuna was designed for general instruction following, not targeted NER; the gap with ChatGPT reflects the difference between generic distillation and targeted distillation.