Turbocharging LLMs
TenthMatrix on turbocharging LLMs: PagedAttention paging for KV cache, vLLM serving, Self-Debugging for agents, PowerInfer token rates, and EG-MLA memory cuts — with production trade-offs.
Topic
Machine Learning
Posts tagged Machine Learning
Deep Learning Systems: Technical Brief for Engineers & Agents
Technical TenthMatrix brief on deep learning: gradient-trained deep nets, discriminative vs generative models, task metrics, and Bedrock vs Kubernetes serving.
Large Language Models Explained: How LLMs Work and How to Run Your Own on Kubernetes
What are Large Language Models and how do they work? A clear, non-technical explainer for managers and engineers — tokens, embeddings, transformers, training and inference — plus production Kubernetes YAML to deploy your own LLM with Ollama and vLLM.