4 News Express

Tuesday, March 19, 2024

Show HN: Real-time voice chat with AI, no transcription https://ift.tt/ZAvqbwz

Show HN: Real-time voice chat with AI, no transcription Hi HN -- voice chat with AI is very popular these days, especially with YC startups ( https://twitter.com/k7agar/status/1769078697661804795 ). The current approaches all do a cascaded approach, with audio -> transcription -> language model -> text synthesis. This approach is easy to get started with, but requires lots of complexity and has a few glaring limitations. Most notably, transcription is slow, is lossy and any error propagates to the rest of the system, cannot capture emotional affect, is often not robust to code-switching/accents, and more. Instead, what if we fed audio directly to the LLM - LLM's are really smart, can they figure it out? This approach is faster (we skip transcription decoding) and less lossy/more robust because the big language model should be smarter than a smaller transcription decoder. I've trained a model in just that fashion. For more architectural information and some training details, see this first post: https://tincans.ai/slm . For details about this model and some ideas for how to prompt it, see this post: https://tincans.ai/slm3 . We trained this on a very limited budget but the model is able to do some things that even GPT-4, Gemini, and Claude cannot, eg reasoning about long-context audio directly, without transcription. We also believe that this is the first model in the world to conduct adversarial attacks and apply preference modeling in the speech domain. The demo is unoptimized (unquantized bf16 weights, default Huggingface inference, serverless speed bumps) but achieves 120ms time to first token with audio. You can basically think of it as Mistral 7B, so it'll be very fast and can also run basically anywhere. I am especially optimistic about embedded usage -- not needing the transcription step means that the resulting model is smaller and cheaper to use on the edge. Would love to hear your thoughts and how you would use it! Weights are Apache-2 and on Hugging Face: https://ift.tt/wsCt1b9... https://ift.tt/Mdi3NFt March 20, 2024 at 12:37AM

Show HN: Krata Maps – open-source Figma like GeoJSON Editor https://ift.tt/6YhyZaR

Show HN: Krata Maps – open-source Figma like GeoJSON Editor https://krata.app March 19, 2024 at 11:58PM

Show HN: Principal — Modern Wealth Tracking https://ift.tt/Fms9uxI

Show HN: Principal — Modern Wealth Tracking https://ift.tt/yPBiS5Z March 19, 2024 at 10:50PM

Monday, March 18, 2024

Show HN: Arthas.ai – An open-source alternative to character.ai https://ift.tt/wNZD731

Show HN: Arthas.ai – An open-source alternative to character.ai https://ift.tt/2lM1yeA March 19, 2024 at 07:29AM

Show HN: Extend Zigbee sensor range with LoRaWAN https://ift.tt/jFkbs0A

Show HN: Extend Zigbee sensor range with LoRaWAN https://ift.tt/CzTtfx5 March 18, 2024 at 02:36PM

Show HN: Next-Gen AI Training: LLM-RLHF-Tuning with PPO and DPO https://ift.tt/iezIWBa

Show HN: Next-Gen AI Training: LLM-RLHF-Tuning with PPO and DPO https://ift.tt/FqNDrWR March 19, 2024 at 12:40AM

Show HN: Pipedream now has 2000+ API integrations https://ift.tt/OuLyxQz

Show HN: Pipedream now has 2000+ API integrations https://ift.tt/SDwcnOr March 18, 2024 at 11:42PM

Sunday, March 17, 2024

Show HN: Native implementation of with checkboxes https://ift.tt/LhyKgU0

Show HN: Native implementation of

Show HN: Website for creating self-signed certificates https://ift.tt/cNHbewg

Show HN: Website for creating self-signed certificates If you're developing locally and need to use HTTPS for whatever, then this tool is hopefully useful to you. I made it because there's a lot of bad info online about generating self-signed certificates. For instance, a lot of guides don't use the SAN list extension or show you how to create a proper certificate chain. Firefox doesn't allow a CA certificate to be used as an end certificate. Getting a working certificate can get pretty confusing, especially for newcomers to certificates or webdev. Having a website for this also means the process of getting a certificate is the same, no matter if you're on a Unix-like OS or Windows. A WebAssembly module built with C++ and Mbed TLS is used to create the keys and certificates. TypeScript and Preact is used for the UI. https://ift.tt/pLetjPq March 18, 2024 at 12:54AM

Show HN: Interactive Smartlog VSCode Extension – An Interactive Git GUI https://ift.tt/7dJaq5w

Show HN: Interactive Smartlog VSCode Extension – An Interactive Git GUI Interactive Smartlog is a graphical VSCode extension that presents a simplified view of the Git log, directly highlighting the branches and commits that are most relevant to your current work. And it's not just a visual tool — it's fully interactive, allowing you to add/switch/remove branches, stage/unstage files, and manage commits directly from the GUI. This tool draws inspiration from Meta's Interactive Smartlog built for the Sapling source control system, and I've adapted it to work with Git. Transitioning the functionality from Sapling to Git wasn't just about a one-to-one feature transfer; it involved changing how data is queried & presented, as well as introducing UI interactions for several Git concepts (like branches, staging/unstaging changes, etc) which are not present in the Sapling source control system. Originally a personal project to enhance my own workflow, I've published the extension on the VSCode marketplace for anyone who would like to use it. I'm keen to hear your feedback and suggestions, as community input is invaluable in shaping its future updates. https://ift.tt/niRlZ0Y March 17, 2024 at 06:28AM

Show HN: Parikar, Read long form articles or blogs in a better, measurable way https://ift.tt/10tL4yA

Show HN: Parikar, Read long form articles or blogs in a better, measurable way https://ift.tt/W7tcGoq March 15, 2024 at 06:10PM

Saturday, March 16, 2024

Show HN: Htmx with ManTL Templates https://ift.tt/FxwCMqk

Show HN: Htmx with ManTL Templates HTMX revitalizes server-side rendering via templates. ManTL is a Java-centric, 100% type-safe templating language with comprehensive IntelliJ integration. It was designed with HTMX (formerly intercooler) in mind. Authors include both Manifold creator and HTMX creator. https://ift.tt/CXlj5ZN March 17, 2024 at 12:01AM

Show HN: SatCat5, the open-source FPGA Ethernet switch https://ift.tt/M7CGwFL

Show HN: SatCat5, the open-source FPGA Ethernet switch We've just launched v2.5 of SatCat5, the open-source FPGA Ethernet switch [1]. SatCat5 contains various FPGA building blocks that let you build a custom mixed-media Ethernet switch. It was originally intended for cubesats [2] but has many other potential applications. The headline feature for this release is support for the IEEE-1588 Precision Time Protocol (PTP). SatCat5 has demonstrated end-to-end synchronization to within 50 ps-rms, which is approaching the world-leading performance of CERN's White Rabbit Project [3]. Except we're doing time-transfer over regular, non-synchronous Ethernet. The key breakthrough is a new technology for digital timestamps that we've published in IEEE Access [4]. This project was featured on HN back in 2023 [5]. Since then, we've changed to the CERN-OHL-W v2.0 license, which has much better legal clarity for FPGA projects. [1] https://ift.tt/gj6EozN [2] https://ift.tt/stAOM4D [3] https://ift.tt/yO0xrH8... [4] https://ift.tt/N2jWEJZ [5] https://ift.tt/hmOuZ5w https://ift.tt/KRCGQBf March 17, 2024 at 05:17AM

Friday, March 15, 2024

Show HN: Kaldo – Cross Shell Aliases https://ift.tt/6nt9RNA

Show HN: Kaldo – Cross Shell Aliases I made this so that I don't have to maintain my aliases across my $profile, .bashrc, and .zshrc when I swap shells. Let me know what you think about it! https://ift.tt/VM4voG2 March 15, 2024 at 10:37PM

Show HN: TinyApps – Upwork but for tiny software development tasks https://ift.tt/m0Dn2LV

Show HN: TinyApps – Upwork but for tiny software development tasks https://tinyapps.to March 15, 2024 at 09:25PM

Wednesday, March 13, 2024

Show HN: Small Scale Pen Plotting https://ift.tt/qhH4Mza

Show HN: Small Scale Pen Plotting https://ift.tt/oYDJIFB March 14, 2024 at 02:21AM

Show HN: ImageNix Get a Docker image for any Nix service https://ift.tt/QcwKlYU

Show HN: ImageNix Get a Docker image for any Nix service https://imagenix.org/ March 13, 2024 at 09:21PM