Sabtu, 2 Ogos 2025

Show HN: WebGPU enables local LLM in the browser – demo site with AI chat https://ift.tt/3P1DTwH

Show HN: WebGPU enables local LLM in the browser – demo site with AI chat Browser LLM demo working on JavaScript and WebGPU. WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26) and Android. Demo, similar to ChatGPT https://andreinwald.github.io/browser-llm/ Code https://ift.tt/IbnFYD1 - No need to use your OPENAI_API_KEY - its local model that runs on your device - No network requests to any API - No need to install any program - No need to download files on your device (model is cached in browser) - Site will ask before downloading large files (llm model) to browser cache - Hosted on Github Pages from this repo - secure, because you see what you are running https://andreinwald.github.io/browser-llm/ August 2, 2025 at 07:39PM

Tiada ulasan:

Show HN: Fast Elevation API with memory mapped tiles https://ift.tt/suKxOBC

Show HN: Fast Elevation API with memory mapped tiles I recently wrote and launched a high-performance Elevation API, built from the ground u...