Skip to content

Author

W. Tong

We have 2 of 9 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Boule or Baguette? A Study on Task Topology, Length Generalization, and the Benefit of Reasoning Traces

This work introduces PITA, a novel large-scale dataset of over 23 million statements in propositional logic and their corresponding proofs, and proposes notions of task depth and task breadth, which measure respectively the number of proof steps required to solve a proposition and the number of unique propositions with...

W. Tong, Ege Çakar, Cengiz Pehlevan · 1 citation

On the Importance of Gating: Memorization vs. In-Context Learning in State Space Models

It is shown that this gating mechanism causes SSMs to first learn an in-weights"memorization"solution, while delaying, or even preventing, convergence to a correct in-context learning solution, and that gating is often beneficial for improving generalization to long sequence lengths.

W. Tong, Aryo Lotfi, Emmanuel Abbé et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.