Skim the abstract and conclusion first
Highlight the abstract and ask Vezz me for the 3-part structure: Problem, Method, and Quantitative Finding.
Read arXiv preprints, peer-reviewed HTML papers, and literature reviews faster. Highlight abstracts, methodology sections, or statistical tables and question them in place.
Instead of switching tabs and rebuilding context, highlight the exact passage that slowed you down and press your shortcut (default: Ctrl+Shift+X or Cmd+Shift+X on macOS, fully customizable in settings).
We suspect that for large values of d_k, the dot products grow large in magnitude, pushing the softmax function into regions where it has extremely small gradients. To counteract this effect, we scale the dot products by 1 / sqrt(d_k).
1. Softmax saturation: When one logit is much larger than the others, `exp(z)` pushes its probability close to 1.0 and all others close to 0.0. In that flat tail of the curve, the derivative `p * (1 - p)` approaches zero, starving backpropagation.
2. Why `sqrt(d_k)`: If `q` and `k` have independent zero-mean, unit-variance components, their dot product has mean 0 and variance `d_k` (standard deviation `sqrt(d_k)`). Dividing by `sqrt(d_k)` restores unit variance regardless of head dimension.
Copy the system prompt below or download the .json preset file to import it directly into the Vezz me Chrome or Firefox extension.
Prevents sycophantic summaries that repeat a paper's abstract as settled fact.
You are a rigorous academic peer reviewer and research tutor. For the selected passage: 1) State what the authors actually did or claimed in plain English, 2) Identify the underlying mathematical or methodological assumption, and 3) Point out any limitations, confounders, or what needs empirical verification.Highlight the abstract and ask Vezz me for the 3-part structure: Problem, Method, and Quantitative Finding.
When you hit a dense derivation, identification strategy, or ablation table, highlight that specific paragraph and press Ctrl+Shift+X.
Ask follow-up questions to distinguish what the data proved from what the discussion section extrapolated.
Yes. Any paper rendered in the browser with selectable text (including `arxiv.org/abs/`, `arxiv.org/html/`, `ar5iv`, PubMed, Nature, IEEE Xplore, and ACM Digital Library) works seamlessly with Vezz me.
Yes. Highlight the equation or the sentence defining the variables, press Ctrl+Shift+X, and ask Vezz me to define each symbol in the context of the paper.
Install Vezz me free, highlight text on any webpage, and press your customizable shortcut (default: Ctrl+Shift+X or Cmd+Shift+X on Mac) to get an answer right beside the source.