💡Idea: Power-Law-in-LLM-Attention

Explore power laws for attention in transformers. Probably existing idea but need to understand this. If not already present a great experiment to run. See “Power Law in Attention” here

💡Idea: Obsidian Plugins

Some Obsidian Plugins to build/find. A text to speech plugin to listen to my own notes. What if i could talk to my memories via rag’ed ver of my obsidian notes? Even if locally. (ref: https://ollama.com/blog/llms-in-obsidian)

💭 To bet on yourself

Why should you bet on yourself? Carpe diem Betting on Yourself = Seizing Opportunities. Its that simple, because nobody will bet on a person who does not bet on himself. To be honest nobody other than you might ever bet on you, so if somebody is then its a very fortunate and rare opportunity and you should take full advantage of the support and try to get to the “next-level”.

🪵 Log May 1st

Logs Visit new topics/ideas: From Conversations on AI research and such muon jax Neural code synthesis How do matricies and matrix ops behave differently in higher dims? What changes and why? Orthogonality of vectors and how embeddings capture higer dimensions without needing explicit representation? (An embedding of len 2k can capture way more than 2k concepts.) about_diffusion: why can we add 2 gaussians to get a new gaussian ? (read)

💡Idea: Cp Cat Neuro Gum

Desi Re-brand Neuro Gum I see lot more indians (atleast in India1) spending a good amount on nutrition supplements. But something like neuro-gum/mint is promises to woo in audience beyond fitness enthusists and gym goers. My bet is on seeing something like this blow up very soon here in India, especially if it can be priced correctly (even slightly premium segment would work imo). Exploring public opinions with a tweet

💡Idea: Log Search Mcp

Imagine an MCP server to help find logs for dev investigations Yes, MCP being all the fad right now but this is something that would easily double my productivity. If there was a series of links to your logging services or even playbooks, with all the correct keywords, filters and expressions out of the box, you would just need to open them up and look at the exact logs you wish to see based on some recepie!

📝 TIL HUGO For Real.

Hugo is pretty cool, loving the archetypes, layouts and customizablity! This template is really minimal and clean! Noticed it had no support for hosted images, I did not want to dump images onto my git repo, only a matter of time before we run into git lfs limits. Added some minimal changes to support this on my fork here ! But this template also has no tags, hopefully something i can quickly like the url images above 🤞🏻.