Gemini 1.5 Flash

Google

Gemini 1.5 Flash is a swift and adaptable multimodal model designed to handle a wide range of tasks efficiently. It accepts various inputs, including audio, images, video, and text, and delivers text-based outputs. Optimized for efficiency, this model excels at code generation, data extraction, and text editing, making it perfect for focused, repetitive tasks.

Model Specifications

Technical details and capabilities of Gemini 1.5 Flash

Core Specifications

1.0M / 8.2K

Input / Output tokens

October 31, 2023

Knowledge cutoff date

April 30, 2024

Release date

Capabilities & License

Multimodal Support

Supported

Web Hydrated

License

Proprietary

Resources

Research Paper

https://arxiv.org/pdf/2403.05530

API Reference

https://ai.google.dev/gemini-api/docs/models/gemini#gemini-1.5-flash

Playground

https://ai.google.dev/studio

Performance Insights

Check out how Gemini 1.5 Flash handles various AI tasks through comprehensive benchmark results.

100

XSTest

(97%)

86.5

Hellaswag

86.5

(87%)

86.2

GSM8K

86.2

(86%)

85.5

BigBench_Hard

85.5

(86%)

82.6

MGSM

82.6

(83%)

79.8

Natural2Code

79.8

(80%)

78.9

MMLU

78.9

(79%)

77.9

MATH

77.9

(78%)

76.1

Video-MME

76.1

(76%)

74.3

HumanEval

74.3

(74%)

74.1

WMT23

74.1

(74%)

71.9

MRCR

71.9

(72%)

67.3

MMLU-Pro

67.3

(67%)

65.8

MathVista

65.8

(66%)

62.3

MMMU

62.3

(62%)

57.4

PhysicsFinals

57.4

(57%)

53.6

Functional_MATH

53.6

(54%)

GPQA

(51%)

48.9

Vibe-Eval

48.9

(49%)

47.2

HiddenMath

47.2

(47%)

34.8

AMC_2022_23

34.8

(35%)

9.6

FLEURS

9.6

(10%)

XSTest

Hellaswag

GSM8K

BigBench_Hard

MGSM

Natural2Code

MMLU

MATH

Video-MME

HumanEval

WMT23

MRCR

MMLU-Pro

MathVista

MMMU

PhysicsFinals

Functional_MATH

GPQA

Vibe-Eval

HiddenMath

AMC_2022_23

FLEURS

Model Comparison

See how Gemini 1.5 Flash stacks up against other leading models across key performance metrics.

67.3

MMLU-Pro - Gemini 1.5 Flash

67.3

(75%)

63.7

MMLU-Pro - Qwen2.5 14B Instruct

63.7

(71%)

70.4

MMLU-Pro - Phi-4

70.4

(78%)

MMLU-Pro - Grok-2 mini

(80%)

MMLU-Pro - Qwen2.5 32B Instruct

(77%)

68.9

MMLU-Pro - Llama 3.3 70B Instruct

68.9

(77%)

78.9

MMLU - Gemini 1.5 Flash

78.9

(88%)

79.7

MMLU - Qwen2.5 14B Instruct

79.7

(89%)

84.8

MMLU - Phi-4

84.8

(94%)

86.2

MMLU - Grok-2 mini

86.2

(96%)

83.3

MMLU - Qwen2.5 32B Instruct

83.3

(93%)

MMLU - Llama 3.3 70B Instruct

(96%)

77.9

MATH - Gemini 1.5 Flash

77.9

(87%)

MATH - Qwen2.5 14B Instruct

(89%)

80.4

MATH - Phi-4

80.4

(89%)

MATH - Grok-2 mini

(81%)

83.1

MATH - Qwen2.5 32B Instruct

83.1

(92%)

MATH - Llama 3.3 70B Instruct

(86%)

GPQA - Gemini 1.5 Flash

(57%)

45.5

GPQA - Qwen2.5 14B Instruct

45.5

(51%)

56.1

GPQA - Phi-4

56.1

(62%)

GPQA - Grok-2 mini

(57%)

49.5

GPQA - Qwen2.5 32B Instruct

49.5

(55%)

50.5

GPQA - Llama 3.3 70B Instruct

50.5

(56%)

74.3

HumanEval - Gemini 1.5 Flash

74.3

(83%)

83.5

HumanEval - Qwen2.5 14B Instruct

83.5

(93%)

82.6

HumanEval - Phi-4

82.6

(92%)

85.7

HumanEval - Grok-2 mini

85.7

(95%)

88.4

HumanEval - Qwen2.5 32B Instruct

88.4

(98%)

88.4

HumanEval - Llama 3.3 70B Instruct

88.4

(98%)

MMLU-Pro

MMLU

MATH

GPQA

HumanEval

Gemini 1.5 Flash

Qwen2.5 14B Instruct

Phi-4

Grok-2 mini

Qwen2.5 32B Instruct

Llama 3.3 70B Instruct

Detailed Benchmarks

Dive deeper into Gemini 1.5 Flash's performance across specific task categories. Expand each section to see detailed metrics and comparisons.

Math

GSM8K

97.1%

90.8%

90.0%

88.9%

88.7%

86.2%

Phi-3.5-mini-instruct

86.2%

Qwen2.5-Coder 7B Instruct

83.9%

Qwen2 7B Instruct

82.3%

Gemma 2 9B

68.6%

Current model

Other models

Avg (86.3%)

Coding

HumanEval

Claude 3.5 Sonnet

93.7%

Nova Micro

81.1%

Codestral-22B

81.1%

Llama 3.1 70B Instruct

80.5%

75.9%

74.3%

74.1%

73.0%

Llama 3.1 8B Instruct

72.6%

Ministral 8B Instruct

34.8%

Current model

Other models

Avg (74.1%)

Reasoning

Hellaswag

Gemini 1.5 Pro

93.3%

Gemini 1.5 Flash

86.5%

Current model

Other models

Avg (89.9%)

Knowledge

MMLU

91.8%

DeepSeek-V2.5

80.4%

Llama 3.1 Nemotron 70B Instruct

80.2%

79.7%

79.0%

78.9%

78.9%

77.6%

76.9%

Llama 3.2 3B Instruct

63.4%

Current model

Other models

Avg (78.7%)

MATH

97.9%

80.4%

80.0%

78.3%

78.0%

77.9%

Llama 3.3 70B Instruct

77.0%

Nova Pro

76.6%

GPT-4o

76.6%

Gemini 1.0 Pro

32.6%

Current model

Other models

Avg (75.5%)

GPQA

87.7%

56.1%

56.0%

53.6%

53.6%

51.0%

51.0%

Llama 3.1 405B Instruct

50.7%

Llama 3.3 70B Instruct

50.5%

Qwen2 7B Instruct

25.3%

Current model

Other models

Avg (53.5%)

Non categorized

MMLU-Pro

DeepSeek-R1

84.0%

Phi-4

70.4%

Qwen2.5 32B Instruct

69.0%

Llama 3.3 70B Instruct

68.9%

Claude 3 Opus

68.5%

Gemini 1.5 Flash

67.3%

Llama 3.1 70B Instruct

66.4%

Mistral Small 3

66.3%

Claude 3.5 Haiku

65.0%

Qwen2.5-Coder 7B Instruct

40.1%

Current model

Other models

Avg (66.6%)

Natural2Code

92.9%

85.4%

79.8%

75.5%

Current model

Other models

Avg (83.4%)

HiddenMath

63.0%

56.0%

52.0%

47.2%

32.8%

Current model

Other models

Avg (50.2%)

WMT23

75.1%

74.1%

72.6%

71.7%

Current model

Other models

Avg (73.4%)

MRCR

Gemini Pro 2.5 Experimental

83.1%

82.6%

71.9%

69.2%

54.7%

48.8%

36.3%

Current model

Other models

Avg (63.8%)

MMMU

Gemini Pro 2.5 Experimental

81.7%

Gemini 1.5 Pro

65.9%

Pixtral Large

64.0%

Grok-2 mini

63.2%

Mistral Small 3.1 24B

62.8%

Gemini 1.5 Flash

62.3%

Nova Pro

61.7%

Llama 3.2 90B Instruct

60.3%

GPT-4o mini

59.4%

GPT-3.5 Turbo

0.0%

Current model

Other models

Avg (58.1%)

Vibe-Eval

Gemini Pro 2.5 Experimental

69.4%

56.3%

53.9%

48.9%

40.9%

Current model

Other models

Avg (53.9%)

MathVista

Kimi-k1.5

74.9%

Mistral Small 3.1 24B

68.9%

68.1%

68.1%

67.7%

65.8%

63.8%

63.8%

Llama 3.2 90B Instruct

57.3%

GPT-3.5 Turbo

0.0%

Current model

Other models

Avg (59.8%)

FLEURS

Gemini 1.5 Flash 8B

86.4%

Gemini 1.5 Flash

9.6%

Gemini 1.5 Pro

6.7%

Current model

Other models

Avg (34.2%)

Video-MME

Gemini 1.5 Pro

78.6%

Gemini 1.5 Flash

76.1%

Gemini 1.5 Flash 8B

66.2%

Current model

Other models

Avg (73.6%)

XSTest

Gemini 1.5 Pro

98.8%

Gemini 1.5 Flash

97.0%

Gemini 1.5 Flash 8B

92.6%

Current model

Other models

Avg (96.1%)

PhysicsFinals

Gemini 1.5 Pro

63.9%

Gemini 1.5 Flash

57.4%

Current model

Other models

Avg (60.7%)

AMC_2022_23

Gemini 1.5 Pro

46.4%

Gemini 1.5 Flash

34.8%

Current model

Other models

Avg (40.6%)

MGSM

o3-mini

92.0%

GPT-4o mini

87.0%

Llama 3.2 90B Instruct

86.9%

85.6%

83.5%

82.6%

80.6%

75.1%

74.5%

Phi-3.5-mini-instruct

47.9%

Current model

Other models

Avg (79.6%)

Providers Pricing Coming Soon

We're working on gathering comprehensive pricing data from all major providers for Gemini 1.5 Flash. Compare costs across platforms to find the best pricing for your use case.

OpenAI

Anthropic

Google

Mistral AI

Cohere

Share your feedback

Hi, I'm Charlie Palars, the founder of Deepranking.ai. I'm always looking for ways to improve the site and make it more useful for you. You can write me through this form or directly through X at @palarsio.

Your feedback helps us improve our service

Gemini 1.5 Flash

Model Specifications

Core Specifications

Capabilities & License

Resources

Performance Insights

Model Comparison

Detailed Benchmarks

Math

GSM8K

Coding

HumanEval

Reasoning

Hellaswag

Knowledge

MMLU

MATH

GPQA

Non categorized

MMLU-Pro

Natural2Code

HiddenMath

WMT23

MRCR

MMMU

Vibe-Eval

MathVista

FLEURS

Video-MME

XSTest

PhysicsFinals

AMC_2022_23

MGSM

Providers Pricing Coming Soon

Share your feedback

Stay Ahead with AI Updates