Gemma4

8 atoms · 跨 5 天 · 首见 2026-04-16 · 最近 2026-06-11

三色: 🟦 fact 5 · 🟥 take 3 · stance ▲1/▼1/◆2

来源: X 8

时态: fresh:6 · aging:2

标签: 好数字:5 · 好观点:2 · 好思考:1 · 好问题:1

叙事 (narrative) (3)

• 2026-05-05 [老化中] · MTP modification architecture
  _Very nice MTP modification for Gemma4

1. Uses 4 decoder layers with 3 SWA + 1 GA

2. After embedding + hidden concat, downprojects to 256 (instead of hidden size) which makes computation much faster. Before LM head, uprojects back to hidden size.

3. Much more efficient LM head in the MTP by selecting clusters of logits!_

tags: 好观点·好思考 · → daily

• 2026-06-04 · 与V4-Pro的性能差距
  well do you think Gemma4 is within shouting distance of V4-Pro?
  tags: 好问题 · → daily
• 2026-04-16 [老化中] · 面临Qwen3.6-35B-A3B和Qwen3.5-27B两面夹击
  Gemma4 是面临两面夹击
  tags: 好观点 · → daily

事实 (fact) (5)

• 2026-06-11 · 正确事实数
  Gemma4 got 45 facts right
  tags: 好数字 · → daily
  value: qty=45 right
• 2026-06-11 · 错误事实数
  Gemma4 got 5 wrong
  tags: 好数字 · → daily
  value: qty=5 wrong
• 2026-06-11 · 输出速度
  Gemma4 26B A4B: 218 tok/s
  tags: 好数字 · → daily
  value: qty=218 tok/s · date=benchmark
• 2026-06-11 · 总推理时间
  Gemma4 26B A4B: 15.1s total
  tags: 好数字 · → daily
  value: qty=15.1s · date=benchmark
• 2026-05-07 · 本地模型推理速度提升
  Running Gemma4 local model 1.5x faster.
  tags: 好数字 · → daily
  value: qty=1.5x faster

时间轴 (近 20)

• 2026-06-11 · fact · 正确事实数 · → daily
• 2026-06-11 · fact · 错误事实数 · → daily
• 2026-06-11 · fact · 输出速度 · → daily
• 2026-06-11 · fact · 总推理时间 · → daily
• 2026-06-04 · narrative · 与V4-Pro的性能差距 · → daily
• 2026-05-07 · fact · 本地模型推理速度提升 · → daily
• 2026-05-05 · narrative · MTP modification architecture · → daily
• 2026-04-16 · narrative · 面临Qwen3.6-35B-A3B和Qwen3.5-27B两面夹击 · → daily

← 实体目录 · 系统日志