Docs/Publish
Publish
Your notes become a static website, built on your device.
Transformers
Transformers
Sequence models that replace recurrence with attention.
Built on . Introduced in [@vaswani2017].
Self-attention
Every token attends to every other token in one step:
Attention(Q,K,V) = softmax(QK⊤ / √dk) V
See the paper, page 3:
LocalOffline readyMarkdown
60 words · saved
Run Publish vault as a website (ZIP) from Mod+K. Unzip and open index.html, or upload the folder to any static host.
- Homepage: a note called
Home,indexorREADME. - Links become working links. Links to missing notes become text.
- Carried across: headings, tables, code, callouts, equations, images, backlinks.
The whole vault goes in
Every note in the open vault becomes a page. Keep a separate vault for what you share.
This handbook is a Neoma vault, published this way. Both are below.
Download this docs vaultneoma-docs-vault.zip · 16 KB