Docs/Getting started

Your first note

Press Mod+Alt+N and type. Neoma saves as you go, as a .md file.

~/Research/Transformers.md

Transformers

Sequence models that replace recurrence with attention.

Built on . Introduced in [@vaswani2017].

Self-attention

Every token attends to every other token in one step:

Attention(Q,K,V) = softmax(QK⊤ / √dk) V

See the paper, page 3:

LocalOffline readyMarkdown 60 words · saved

Click a note, follow a [[link]], type /. That's most of Neoma.

Do Press
New page Mod+Alt+N
Every command Mod+K
Open a note by name Mod+O
Reading view Mod+Shift+R

Rename a page from its right-click menu in Files. A small ? anywhere in the app opens the matching page here.

Next: Links, Slash menu, Create a vault.

Edit this page on GitHub