Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
API Pack: A Massive Multi-Programming Language Dataset for API Call Generation
2025-01-22
· ICLR 2025 Poster ·
anchor
Findings
IC-383
GPT-4-1106, GPT-3.5-1106, and unfine-tuned CodeLlama-13b achieve 44.3%, 39.5%, and 38.5% API call accuracy respectively on unseen APIs (Level 3) with 3-shot retrieved prompting in the API Pack evaluation