Docs/Getting started
Keyboard shortcuts
Search the shortcuts. Change any of them in Settings.
Transformers
Transformers
Sequence models that replace recurrence with attention.
Built on . Introduced in [@vaswani2017].
Self-attention
Every token attends to every other token in one step:
Attention(Q,K,V) = softmax(QK⊤ / √dk) V
See the paper, page 3:
LocalOffline readyMarkdown
60 words · saved
| Do | Press |
|---|---|
| Command palette | Mod+K |
| Open a note | Mod+O |
| Search vault | Mod+Shift+F |
| New page | Mod+Alt+N |
| Graph view | Mod+G |
| Settings | Mod+, |
| Every shortcut | Mod+/ |
Mod is Cmd on a Mac, Ctrl elsewhere. Rebind in Settings → Keyboard shortcuts; clear a field to restore it.