← Open Source

Open Source

596 episodes · Page 2 of 25

#6383: Choosing Class Breaks for Skewed Price Data

In one dimension, k-means clustering avoids random restarts entirely and runs in polynomial time via dynamic programming.

statisticsopen-sourceai-inferencecloud-computing

#6378: Running Speaker Identification Locally on Phones

Exported voice embedding models like CAM++ run offline on mobile devices in packages as small as twenty-eight megabytes.

speech-recognitionlocal-aiai-inferencesmartphonesopen-source

#6370: Why Modern Audio Datasets Ship as Parquet Files

Parquet files store metadata at the end so clients can query durations or transcripts via HTTP range requests without downloading audio bytes.

speech-recognitionopen-sourcedata-storagerag

#6354: What Remote Teams Can Learn from the Linux Kernel

Between 1991 and 1995, over 15,000 contributors submitted code or comments to Linux discussion channels without an office or an HR department.

open-sourceworkplace-culturelinux

#6348: Splitting AI Workflows Between Local and Cloud

A laptop failed a single video sampling step in 80 minutes, while paid cloud endpoints rendered clips in under 90 seconds for 40 cents.

cloud-computinglocal-aigenerative-mediagpusopen-source

#6345: How vLLM Squeezes More Requests into GPU Memory

Early serving engines wasted up to 80% of KV cache memory on unspent reservations; vLLM cut that slack to under 4% using virtual memory paging.

ai-inferencelocal-aigpustransformer-architectureopen-source

#6333: Filtering arXiv in the Age of Generative AI

arXiv submission volume doubled in two years, prompting a new rule capping each submitter at two papers per month.

open-sourceai-evaluationtraining-data

#6331: Backing Up Gmail with Got Your Back

Got Your Back pulls Gmail into individual local EML files using the Gmail API, enabling incremental backups that Google Takeout cannot do.

cloud-computingbackups-and-archivingdigital-privacyopen-sourcedata-storage

#6317: Choosing Model Precision, Quantization, and Format

Quantizing Qwen 2.5 9B to Q4_K_M boosted generation speed 2.7 times over BF16, while prompt processing rates stayed roughly unchanged.

open-sourcelocal-aiai-inferencefine-tuninggpus

#6309: Why DeepMind Systems Live Outside the Gemini API

AlphaEvolve saved 0.7% of Google's compute, but running it requires an enterprise cloud environment to evaluate candidate code.

ai-inferencelocal-aiopen-sourceai-evaluationreasoning-models

#6307: Why Exact Matching Outlasts the Index

Ken Thompson extracted grep from the ed editor in 1973 to search the Federalist Papers without loading entire files into memory.

programming-languagesopen-sourcedatabasesrag

#6306: Training Custom Rerankers for Podcast Search

Expanding a retrieval candidate pool past 300 items yielded less than a single percentage point of recall in legal benchmark evaluations.

ai-evaluationragcontext-and-memorytraining-dataopen-source

#6304: Why Semantic Desktop Search Struggles to See Files

Local vector indexing on macOS and Windows requires hours of idle, plugged-in time to parse drives, often with no progress bar.

raglocal-aiopen-source

#6300: Choosing the Right Audio Annotation Tool

Desktop tool ELAN supports independent timeline tiers to prevent overlapping sounds like car horns from flattening into speech transcripts.

speech-recognitionopen-sourcetraining-datalocal-aiai-evaluation

#6295: When Splitting Serverless Apps Earns Its Keep

Modal apps enforce atomic deployment, meaning all grouped functions redeploy in place together while scaling independently.

cloud-computingcontainers-and-virtualizationdevopsopen-sourceai-inference

#6289: Why Hermes and Pi Top the OpenRouter Coding Table

Hermes Agent and pi logged 1.66 trillion and 1.41 trillion tokens on OpenRouter, topping Claude Code despite fundamentally opposite designs.

open-sourceai-coding-assistantsmodel-context-protocolcontext-and-memoryai-inference

#6287: Why Model Names Conceal Changes Behind the API

One API identifier spanned ten distinct releases over nineteen months without changing the name submitted by the customer.

ai-evaluationopen-sourceai-inferencelocal-ai

#6285: Why Coding Benchmarks Split Across Models

GLM 5.3 claims 88.2 on Terminal Bench 2.1 against Opus 4.8 at 85, but newer evaluations reveal a very different order.

ai-evaluationai-coding-assistantsopen-sourcetraining-datareasoning-models

#6268: Storing Ledgers in Postgres and Ticks in Kdb+

Postgres numeric types support up to 131,072 digits before the decimal, but exact arithmetic carries steep computational costs.

investingdata-storagedatabasesbanking-and-paymentsopen-source

#6245: Why Inference Engines Change Benchmark Scores

A study found a 16.6 percentage point spread on GSM8K across different inference engines running identical weights on the same GPU.

ai-inferencelocal-aiai-evaluationopen-sourcetransformer-architecture

#6243: Inside the Mixture of Experts Router

What actually decides which expert handles your token? A look inside the router, from sigmoid affinities to load balancing.

ai-inferencetransformer-architectureopen-sourcegpus

#6220: Mixture of Experts: Bigger Than It Looks

MoE models store a trillion parameters but only fire a few billion per token. Here's what the active number really measures — and why smaller isn't...

ai-inferencetransformer-architecturelocal-aifine-tuningopen-source

#6219: Dictation Beyond the Keyboard

Pedals, push-to-talk, and Android gesture apps promise keyboard-free dictation — but can any of it become a dependable daily setup?

speech-recognitionopen-sourcesmartphonesaudio-equipmentlocal-ai

#6214: Nobody Trains an Uncensored Model From Scratch

Every "uncensored" model is a renovation, not a new build — and the political lean lives in the agreement layer, not the refusals.

open-sourceai-alignmenttraining-datafine-tuningai-evaluation