Show HN: DDoS Photon Cannon – A Toy DDoS https://ift.tt/QVUJKWP

Show HN: DDoS Photon Cannon – A Toy DDoS Blog Post: https://christopherchmielewski.xyz/blog/2024-11-18-homemade-... https://ift.tt/EUZG37D November 20, 2024 at 09:51AM

Show HN: Browser-based website builder powered by LLMs https://ift.tt/dfJ3QzM

Show HN: Browser-based website builder powered by LLMs I wanted to share what I've been working on - it's a AI site builder that runs in the browser powered by WebGPU and OnnxRuntime-Web. I have got the following all working to varying degrees: - text to code generation - image to code generation - microphone to text to code generation If you are on Mac for instance, it will interface directly with your GPU to power the LLM interface. It only requires downloading the models, and then everything after that is offline. It's not even close to as powerful as Claude or ChatGPT, but I like the idea of having the LLM run directly on your machine. I just did this for fun, but I am looking for a new role if anyone's hiring - https://ift.tt/6apzsqR ! More technical insight: - I also got the Typescript / React app to compile itself in the browser via a service worker https://ift.tt/1cgJ9mt but took it offline due to some oddities with service workers. - A lot of the new speech models are a lot better than anything built into your phone / computer. I wonder when more computers will have them built in. - I added a CSP to the iframe only because I was worried about spamming sites since I update the iframe anytime a new token comes in. So if you have an image on the page it will get reloaded every time the iframe is updated. Otherwise there would be no reason for it. https://ift.tt/gQZ62Xf November 20, 2024 at 01:54AM

Show HN: Serverless code execution, but for AI agents https://ift.tt/U8H35nm

Show HN: Serverless code execution, but for AI agents https://sandboxed.ai November 20, 2024 at 05:06AM

Show HN: Archgw: open-source, intelligent proxy for AI agents, built on Envoy https://ift.tt/GwO0Tlx

Show HN: Archgw: open-source, intelligent proxy for AI agents, built on Envoy Hi HN! This is Adil, Salman, Co and Shuguang and we're excited to introduce archgw [1], an open source intelligent proxy for agents built on Envoy [2]. Arch moves the critical but crufty work around safety, observability, and routing of prompts outside business logic. Arch is a uniquely intelligent infrastructure primitive, engineered with purpose-built fast LLMs [3] for tasks like intent detection over multi-turn, parameter identification and extraction, triggering single/multiple function calls, and offers convenience features to auto dispatch LLM calls for summarization based on data from your APIs via system prompts configured in archgw. Today, the approach to build a smart production-ready agent is weaving together a large set of mono-functional opinionated libraries, adding extra layers like LLM-based preprocessing to determine things like relevance and safety of the user's prompt (e.g. applying governance and guardrails). Once past that stage, developers must extract relevant information from the user prompt to determine intent, extract parameters as necessary, package relevant tools calls to an LLM to trigger a backend API to execute particular domain-specific task. etc. After all that is done then only are developers ready to trigger an LLM call for summarization and must manage upstream error handling and retry logic themselves. Not to mention, if they want to experiment with multiple LLMs or move between LLM versions, they have to write crufty undifferentiated code. This entire experience is slow, error prone, cumbersome, and not specifically unique. Prior to building archgw, the team spent time building Envoy [2] at Lyft, API Gateway at AWS, specialized search and intent models at Microsoft Research and worked on safety at Meta. archgw was born out of the belief that several rules based mono-functional tools should be converged into a multi-functional infrastructure primitive designed for prompts and agents. We built archgw on the highly popular, battle-tested open source proxy Envoy and re-imagined it for prompts and agents. For this we had to build blazing fast LLMs [3] that can handle crufty, ahead-in-the-request-path type of work in handling and processing prompts that are sent to an agent, so that developers can focus on what matters most: building fast personalized agents without the unnecessary prompt engineering and systems integration work needed to get there. Here are some additional details about the open source project. arghw is written in rust, and the request path has three main parts: * Listener subsystem which handles downstream (ingress) and upstream (egress) request processing. * Prompt handler subsystem. This is where archgw makes decisions on the safety of the incoming request via its prompt_guard primitive and identifies where to forward the conversation to via its prompt_target primitive. * Model serving subsystem is the interface that hosts all the lightweight LLMs engineered in archgw and offers a framework for things like hallucination detection of our these models We loved building this open source project, and our belief is that this infra primitive would help developers build faster, safer and more personalized agents without all the manual prompt engineering and systems integration work needed to get there. We hope to invite other developers to use and improve Arch. Please give it a shot and leave feedback here, or at our discord channel [4] Also here is a quick demo of the project in action [5]. You can check out our public docs here at [6]. Our models are also available here [7]. [1] https://ift.tt/8uDVWLg [2] https://ift.tt/ZF9YTDf [3] https://ift.tt/EP4J3Cv... [4] https://ift.tt/DAt4fXM... [5] https://www.youtube.com/watch?v=I4Lbhr-NNXk [6] https://ift.tt/QvAJDPy [7] https://ift.tt/o2ewFMC https://ift.tt/8uDVWLg November 20, 2024 at 12:56AM

Show HN: Tailwind Box Shadow Generator https://ift.tt/J4fcHnu

Show HN: Tailwind Box Shadow Generator https://ift.tt/BV2oLry November 19, 2024 at 02:57AM

Show HN: Nosia – Privacy-Focused AI to Run Models on Your Own Data and Device https://ift.tt/1pdKlfh

Show HN: Nosia – Privacy-Focused AI to Run Models on Your Own Data and Device What happens when you wait months after the official release of ChatGPT, with all the media buzz, before you actually try it for the first time? What happens when your first question to ChatGPT is about its carbon footprint, including Scope 3 emissions, and whether OpenAI complies with the Paris Agreement? What happens when, back in 2013, you almost left tech to become a beekeeper, but then returned to the field driven by passion and a vision for doing things differently? What happens when you believe in extending the life of terminals and servers, recycling, and reusing hardware, instead of succumbing to programmed obsolescence or deleting old emails? What happens when you believe in the power of the French and European tech ecosystem to provide digital solutions that respect GDPR and uphold core values? What happens when you stand for data sovereignty, empowering organizations to protect their data and act independently? What happens when you champion open-source and collective intelligence as key drivers of innovation? What happens when you work with code, systems, networks, and cybersecurity, and approach your work like a craftsman, building something meaningful? Introducing Nosia – a platform that allows you to run an AI model directly on your own data and device, from small models (SLM) to large models (LLM). It's designed to be easy to install and use, empowering you to take control of your AI needs while respecting privacy, sustainability, and autonomy. https://ift.tt/ZToVFsg November 19, 2024 at 04:44AM

Show HN: CSV Table – Proper GUI for View and Edit CSV, JSON https://ift.tt/1fqxDWK

Show HN: CSV Table – Proper GUI for View and Edit CSV, JSON https://csvtable.com November 18, 2024 at 10:04PM

Show HN: Understanding the Bloch Sphere https://ift.tt/dpYhFzr

Show HN: Understanding the Bloch Sphere https://ift.tt/M1u8BkK November 18, 2024 at 01:48AM

Show HN: I made Picle (a.k.a. Catchphrase x Wordle x AI) https://ift.tt/jSbY56R

Show HN: I made Picle (a.k.a. Catchphrase x Wordle x AI) Love to hear what you think! Thank you! https://picle.fi/ November 17, 2024 at 08:38PM

Show HN: Knight's Graph – game based on the Knight's tour problem https://ift.tt/iaWhQgZ

Show HN: Knight's Graph – game based on the Knight's tour problem When I was in high school, my dad showed me how to play Knight Tour on a piece of paper. Many years passed before I decided to create the Knight's Graph app. “Knight's Graph” is an intellectual puzzle game based on the classic knight tour problem, known since the 18th century. Your task is to move the chess knight across the board so that each square is visited exactly once. Test your logical and strategic skills in an exciting game where every game is a new challenge! The app is already available for download on the App Store. Google Play will be available a little later. App Store: https://ift.tt/OLN41aI... Website: https://ift.tt/Z3sH2jp https://ift.tt/WtLfCGp November 13, 2024 at 03:23PM

Show HN: Top Hacker News stories every day over the years https://ift.tt/RZGbLPM

Show HN: Top Hacker News stories every day over the years https://ift.tt/wvXKeWs November 17, 2024 at 09:19AM

Show HN: Next Beats – A Modern, Customizable, Open Source Lofi Music Player https://ift.tt/M5D2BL7

Show HN: Next Beats – A Modern, Customizable, Open Source Lofi Music Player Hey everyone, I've always wanted to build my own lofi player, and I recently added it to one of my projects, You-TLDR. I decided to open-source it so more people can play around with it and make it their own. NextBeats is a modern, customizable lofi music player built with Next.js and TypeScript. It features a retro TV-style interface, YouTube integration for endless lofi streams, sound effect mixing (rain, cafe, etc.), and theme customization. Perfect for coding, studying, or relaxing, it lets you add custom channels, control music and effect volumes independently, and save settings locally. Open-source and mobile-friendly. Appreciate any feedback! https://ift.tt/8wiKHOm November 17, 2024 at 11:01AM

Show HN: I built an app for anyone to design their own kitchen https://ift.tt/0o7n5f2

Show HN: I built an app for anyone to design their own kitchen https://ift.tt/izrQRqZ November 17, 2024 at 04:49AM

Show HN: Scooter – Interactive find and replace in the terminal https://ift.tt/qRAW4xv

Show HN: Scooter – Interactive find and replace in the terminal https://ift.tt/kjRFlCZ November 15, 2024 at 10:15PM

Show HN: Windsurf – Agentic IDE https://ift.tt/ai3U6Dm

Show HN: Windsurf – Agentic IDE At Codeium, we've been building AI-powered extensions for a while (we first launched our VSCode extension with autocomplete a little over 2 years ago!), but we've always thought there would come a day where we would hit the limits of what could be achieved within existing IDEs, so we decided to build our own: Windsurf (yes, it's yet another VSCode fork :) We've stuffed a lot of cool features into Windsurf—a super fast autocomplete model, an inline diff generation experience that feels truly native, but we're most proud of Cascade, which is an evolution of the sidebar chat experience that many other extensions have. Cascade can perform deep reasoning on your existing codebase, access a vast array of tools that allow it to run terminal commands and find relevant files, and it's omniscient of all the actions that the user has taken independent of invoking the AI. (You can for example, start implementing a change manually and just ask Cascade to "continue"). We've been using Cascade internally at Codeium on our actual production codebase, and we're getting actual value from it. We hope everyone here does too! You can find a bunch of demos of Cascade on our website but I want to show one that I made myself using Cascade to solve an interesting cryptography challenge: https://youtu.be/LbYepFmVB20 Cascade was able to explain the problem to me, install some libraries needed to interact with the challenge, give me some pointers towards a solution, and implement an attack that I described to it all by itself. https://ift.tt/ZoFMJ6U November 13, 2024 at 10:39PM

Show HN: The Billy Bass I put on the Internet https://ift.tt/GuqNkjC

Show HN: The Billy Bass I put on the Internet This one is just for fun. A couple years back I put together this tool to help me make synced up open/close mouth animations. End goal was always to "put it on the internet" like so many other things I remember when I was a bit younger. You can't drop this into a livestream these days without getting banned because people can't play nice, so I made it to record and distribute videos privately. I only code like this as a hobby, so it is a bit rough (I am a hardware guy), but these days you can get pretty far without knowing a lot. Enjoy https://ift.tt/xcaylDt November 14, 2024 at 06:17PM

Show HN: Memoripy – AI Memory Layer with Short- & Long-Term Memory, Clustering https://ift.tt/rq1nQIw

Show HN: Memoripy – AI Memory Layer with Short- & Long-Term Memory, Clustering Hey HN! I built Memoripy, a memory layer for AI that adds short-term, long-term, and semantic memory capabilities to enhance LLM applications. It helps AI systems retain and prioritize past interactions, adapt over time, and respond with greater context and personalization. Memoripy uses semantic clustering to retrieve relevant memories, along with adaptive memory decay and reinforcement, so interactions stay fresh and context-aware. It’s designed for easy integration with OpenAI, Ollama, and other platforms—giving your AI applications dynamic memory management with minimal setup. Would love to hear your thoughts and feedback! https://ift.tt/evaRfZ1 November 15, 2024 at 02:12AM

Show HN: Email marketing as code (open source Customer.io alternative) https://ift.tt/nvwirQB

Show HN: Email marketing as code (open source Customer.io alternative) After getting frustrated with Customer.io's limitations, I built an open-source alternative that lets you write marketing automation in pure code. Define user segments in SQL, write email flows in TypeScript, and template emails in React+Tailwind. Support for campaigns, segments, events, users, and transactions. SMS support planned. https://segflow.io November 14, 2024 at 03:40AM

Show HN: I Built Tinder, but for Entrepreneurs and Investors https://ift.tt/F19nbUH

Show HN: I Built Tinder, but for Entrepreneurs and Investors AloAngels, helps you connect to more than 2200 investors by your startup's profile https://ift.tt/ue3VwUl November 14, 2024 at 02:13AM

Show HN: Humbo Visited – create a visited countries map https://ift.tt/zZLE7I0

Show HN: Humbo Visited – create a visited countries map Share where you have been with your own interactive world map. A complete view of your travels showing both visited countries and places. https://ift.tt/gjqQkE7 November 13, 2024 at 11:50PM