GitHub - CredibleAI/heads: This repo contains a preprint which presents a solution to an open problem about expressivity of transformers: whether adding more heads increases expressivity.

Name		Name	Last commit message	Last commit date
h_vs_h_1_heads.pdf		h_vs_h_1_heads.pdf

About

This repo contains a preprint which presents a solution to an open problem about expressivity of transformers: whether adding more heads increases expressivity.

Activity

Custom properties

0 stars

0 watching

0 forks

Report repository

Navigation Menu

About

Releases

Packages

Contributors

Latest commit

History

Folders and files

About

Stars

Watchers

Forks

Releases

Packages

Contributors