Back
Google's Pathways architecture
webCredibility Rating
4/5
High(4)High quality. Established institution or organization with editorial oversight and accountability.
Rating inherited from publication venue: Google AI
A 2021 blog post by Google's Jeff Dean announcing Pathways, a precursor architecture to models like PaLM and Gemini; relevant to discussions of general-purpose AI capabilities and the trajectory toward more general AI systems.
Metadata
Importance: 55/100blog postprimary source
Summary
Jeff Dean introduces Google's Pathways architecture, a proposed next-generation AI system designed to overcome the limitations of narrow, task-specific models. Pathways aims to handle thousands of tasks simultaneously, learn new tasks quickly with less data, and develop a more unified understanding of the world by routing tasks through sparse, relevant subnetworks rather than activating the entire model.
Key Points
- •Current AI models are over-specialized; Pathways aims to build one model capable of generalizing across many tasks simultaneously.
- •Pathways draws inspiration from the human brain's sparse activation pattern, only engaging relevant neural pathways for each task.
- •The architecture enables multi-modal learning (text, images, video, audio) within a single unified model.
- •Pathways could dramatically reduce the energy and computational cost of training by reusing learned representations across tasks.
- •This represents a shift from training thousands of narrow models to training one adaptable, general-purpose model.
Cited by 1 page
| Page | Type | Quality |
|---|---|---|
| AI-Driven Concentration of Power | Risk | 65.0 |
Cached Content Preview
HTTP 200Fetched Mar 20, 202613 KB
# Introducing Pathways: A next-generation AI architecture
Oct 28, 2021
·
5 min read
Share
[x.com](https://twitter.com/intent/tweet?text=Introducing%20Pathways%3A%20A%20next-generation%20AI%20architecture%20%40google&url=https://blog.google/innovation-and-ai/products/introducing-pathways-next-generation-ai-architecture/) [Facebook](https://www.facebook.com/sharer/sharer.php?caption=Introducing%20Pathways%3A%20A%20next-generation%20AI%20architecture&u=https://blog.google/innovation-and-ai/products/introducing-pathways-next-generation-ai-architecture/) [LinkedIn](https://www.linkedin.com/shareArticle?mini=true&url=https://blog.google/innovation-and-ai/products/introducing-pathways-next-generation-ai-architecture/&title=Introducing%20Pathways%3A%20A%20next-generation%20AI%20architecture) [Mail](mailto:?subject=Introducing%20Pathways%3A%20A%20next-generation%20AI%20architecture&body=Check%20out%20this%20article%20on%20the%20Keyword:%0A%0AIntroducing%20Pathways%3A%20A%20next-generation%20AI%20architecture%0A%0Ahttps://blog.google/innovation-and-ai/products/introducing-pathways-next-generation-ai-architecture/)
Copy link
Too often, machine learning systems overspecialize at individual tasks, when they could excel at many. That’s why we’re building Pathways—a new AI architecture that will handle many tasks at once, learn new tasks quickly and reflect a better understanding of the world.
[\\
\\
Jeff Dean\\
\\
Google Senior Fellow and SVP, Google Research](https://blog.google/authors/jeff-dean/)
Share
[x.com](https://twitter.com/intent/tweet?text=Introducing%20Pathways%3A%20A%20next-generation%20AI%20architecture%20%40google&url=https://blog.google/innovation-and-ai/products/introducing-pathways-next-generation-ai-architecture/) [Facebook](https://www.facebook.com/sharer/sharer.php?caption=Introducing%20Pathways%3A%20A%20next-generation%20AI%20architecture&u=https://blog.google/innovation-and-ai/products/introducing-pathways-next-generation-ai-architecture/) [LinkedIn](https://www.linkedin.com/shareArticle?mini=true&url=https://blog.google/innovation-and-ai/products/introducing-pathways-next-generation-ai-architecture/&title=Introducing%20Pathways%3A%20A%20next-generation%20AI%20architecture) [Mail](mailto:?subject=Introducing%20Pathways%3A%20A%20next-generation%20AI%20architecture&body=Check%20out%20this%20article%20on%20the%20Keyword:%0A%0AIntroducing%20Pathways%3A%20A%20next-generation%20AI%20architecture%0A%0Ahttps://blog.google/innovation-and-ai/products/introducing-pathways-next-generation-ai-architecture/)
Copy link
00:00
When I reflect on the past two decades of computer science research, few things inspire me more than the remarkable progress we’ve seen in the field of artificial intelligence.
In 20
... (truncated, 13 KB total)Resource ID:
6f3d720bc62d3f5b | Stable ID: YzViNWJmNT