Llama 3.2 11B Instruct

Meta Llama

Llama 3.2 11B Vision Instruct is a sophisticated multimodal language model expertly fine-tuned for visual understanding. It excels at tasks like identifying objects, reasoning about image content, creating descriptive captions, and answering diverse questions related to images. The model takes both text and images as input, then produces articulate text-based responses.

Model Specifications

Technical details and capabilities of Llama 3.2 11B Instruct

Core Specifications

10.6B Parameters

Model size and complexity

128.0K / 128.0K

Input / Output tokens

December 30, 2023

Knowledge cutoff date

September 24, 2024

Release date

Capabilities & License

Multimodal Support

Supported

Web Hydrated

No

License

Llama 3.2 Community License

Resources

API Reference

https://huggingface.co/meta-llama/Llama-3.2-11B-Vision-Instruct

Code Repository

https://github.com/facebookresearch/llama

Performance Insights

Check out how Llama 3.2 11B Instruct handles various AI tasks through comprehensive benchmark results.

100

75

50

25

0

91.1

AI2 Diagram

91.1

(91%)

88.4

DocVQA

88.4

(88%)

83.4

ChartQA

83.4

(83%)

75.2

VQAv2 (test)

75.2

(75%)

73

MMLU

73

(73%)

68.9

MGSM

68.9

(69%)

51.9

MATH

51.9

(52%)

51.5

MathVista

51.5

(52%)

50.7

MMMU

50.7

(51%)

33

MMMU-Pro

33

(33%)

32.8

GPQA

32.8

(33%)

AI2 Diagram

DocVQA

ChartQA

VQAv2 (test)

MMLU

MGSM

MATH

MathVista

MMMU

MMMU-Pro

GPQA

Detailed Benchmarks

Dive deeper into Llama 3.2 11B Instruct's performance across specific task categories. Expand each section to see detailed metrics and comparisons.

Knowledge

MMLU

91.8%

75.2%

75.2%

Qwen2.5-Coder 32B Instruct

75.1%

74.9%

Llama 3.2 11B Instruct

73.0%

71.8%

71.3%

Qwen2 7B Instruct

70.5%

Llama 3.2 3B Instruct

63.4%

Current model

Other models

Avg (74.2%)

MATH

97.9%

Phi-3.5-MoE-instruct

59.5%

Gemini 1.5 Flash 8B

58.7%

Qwen2.5-Coder 32B Instruct

57.2%

Ministral 8B Instruct

54.5%

Llama 3.2 11B Instruct

51.9%

50.6%

49.7%

Qwen2 7B Instruct

49.6%

32.6%

Current model

Other models

Avg (56.2%)

GPQA

87.7%

Qwen2.5 7B Instruct

36.4%

35.9%

35.7%

33.3%

Llama 3.2 11B Instruct

32.8%

Llama 3.2 3B Instruct

32.8%

32.3%

30.8%

Qwen2 7B Instruct

25.3%

Current model

Other models

Avg (38.3%)

Non categorized

MMMU

Gemini Pro 2.5 Experimental

81.7%

Gemini 1.5 Flash 8B

53.7%

53.6%

53.6%

52.5%

Llama 3.2 11B Instruct

50.7%

47.9%

Phi-3.5-vision-instruct

43.0%

0.0%

Current model

Other models

Avg (48.5%)

MMMU-Pro

Mistral Small 3.1 24B

49.3%

Qwen2-VL-72B-Instruct

46.2%

Llama 3.2 90B Instruct

45.2%

Llama 3.2 11B Instruct

33.0%

Current model

Other models

Avg (43.4%)

MathVista

74.9%

Llama 3.2 90B Instruct

57.3%

56.7%

Gemini 1.5 Flash 8B

54.7%

52.8%

Llama 3.2 11B Instruct

51.5%

46.6%

Phi-3.5-vision-instruct

43.9%

0.0%

Current model

Other models

Avg (48.7%)

ChartQA

Claude 3.5 Sonnet

90.8%

88.1%

Mistral Small 3.1 24B

86.2%

85.7%

Llama 3.2 90B Instruct

85.5%

Llama 3.2 11B Instruct

83.4%

Phi-3.5-vision-instruct

81.8%

81.8%

76.1%

Current model

Other models

Avg (84.4%)

AI2 Diagram

Llama 3.2 90B Instruct

92.3%

Llama 3.2 11B Instruct

91.1%

Current model

Other models

Avg (91.7%)

DocVQA

Claude 3.5 Sonnet

95.2%

93.2%

92.8%

90.7%

Llama 3.2 90B Instruct

90.1%

Llama 3.2 11B Instruct

88.4%

85.6%

85.6%

Current model

Other models

Avg (90.2%)

MGSM

92.0%

Gemini 1.5 Flash

82.6%

80.6%

75.1%

74.5%

Llama 3.2 11B Instruct

68.9%

Phi-3.5-MoE-instruct

58.7%

Llama 3.2 3B Instruct

58.2%

56.3%

Phi-3.5-mini-instruct

47.9%

Current model

Other models

Avg (69.5%)

Providers Pricing Coming Soon

We're working on gathering comprehensive pricing data from all major providers for Llama 3.2 11B Instruct. Compare costs across platforms to find the best pricing for your use case.

OpenAI

Anthropic

Google

Mistral AI

Cohere

Share your feedback

Hi, I'm Charlie Palars, the founder of Deepranking.ai. I'm always looking for ways to improve the site and make it more useful for you. You can write me through this form or directly through X at @palarsio.

Your feedback helps us improve our service

Stay Ahead with AI Updates

Get insights on Gemini Pro 2.5, Sonnet 3.7 and more top AI models