Links for August 12th

Here are some links I found interesting this week.

We Are All Animals at Night | Hazlitt

NVIDIA's CUDA Monopoly

Zach Mueller on Twitter: "You may know that @huggingface Accelerate has big-model inference capabilities, but how does that work? With the help of #manim, let's dig in! Step 1: Load an empty model into memory using @PyTorch's `meta` device, so it uses a *

Speeding up the GPT - KV cache | Becoming The Unbeatable

[2308.03296] Studying Large Language Model Generalization with Influence Functions

Leviathan and the Air-Pump - Wikipedia

Michelson–Morley experiment - Wikipedia

Michelin-Starred Ramen in Tokyo for $8 - no reservations - YouTube

From the late 2000s to the mid-2010s, I worked as a molecular biologist for a national security contractor in a program to study Exo-Biospheric-Organisms (EBO). I will share with you a lot of information on this subject. Feel free to ask questions or ask

vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs

Million.js

Moscovium - Wikipedia

/x/ - Paranormal » Thread #34629564

All-domain Anomaly Resolution Office - Wikipedia

AGI Introduction

Database Animals, Financialized

Re: Add ability to lock relationships to never be culled - Answer HQ

Four Notes on Reading Remilia Collective [gp] — Charlotte Fang

"I'm cute I'm punk rock" - by Noah Smith - Noahpinion

The Novice's LLM Training Guide

Current Best Practices for Training LLMs from Scratch