How to tell when the model isn’t the bottleneck
A Transformer and a Mamba model have almost nothing in common. Different math, different inductive biases, different assumptions about what makes a sequence learnable. Train them on the same task…
Read →Beyond Chatbots — implications of Generative AI for product builders
This is a from a 6-page memo I wrote in March 2023 on the disruption potential of Generative AI. I’m “open souring” it here as it still seems relevant to…
Read →