Researchers: We have invented giant AI modes to solve the mysteries of the universe... Humanity: Cool, we are gonna use them in apps called "SpicyChat" for roleplay 😂 AI girlfriend apps are the largest category of consumer apps using LLMs.

Big Models Consume Tons Of Power - ChatGPT Requires 10x That Of Google Search These giant LLMs require massive amounts of power to train and infer. We don't discuss this as much as we should. This is one of the reasons why small models are so important. h/t zerohedge

At Scale, Compute Is Everything... LLMs are immensely useful. The big challenge for most AI companies is scaling to meet the high demand In other words, Nvidia gets to play GOD for at least the next 1-2 years.

Please stop with the ridiculous takes calling for pausing or heavily regulating AGI research. Here is why it makes zero sense - impossible to police - US will fall behind if only applied here - will result in an OSS ban - results in concentration of power Dystopia is…

Why Chat With PDF Is Hard And How ChatLLM Gets It Right Chatting on long docs is hard because most LLMs other than Gemini don't have a large context. However, even with Gemini's 1M context length, in-context learning is hard, and if you stuff the doc in the context, it doesn't…