Show HN: Marqo – Vectorless Vector Search https://ift.tt/KElYeRn

Show HN: Marqo – Vectorless Vector Search Marqo is an end-to-end vector search engine. It contains everything required to integrate vector search into an application in a single API. Here is a code snippet for a minimal example of vector search with Marqo: mq = marqo.Client() mq.create_index("my-first-index") mq.index("my-first-index").add_documents([{"title": "The Travels of Marco Polo"}]) results = mq.index("my-first-index").search(q="Marqo Polo") Why Marqo? Vector similarity alone is not enough for vector search. Vector search requires more than a vector database - it also requires machine learning (ML) deployment and management, preprocessing and transformations of inputs as well as the ability to modify search behavior without retraining a model. Marqo contains all these pieces, enabling developers to build vector search into their application with minimal effort. Why not X, Y, Z vector database? Vector databases are specialized components for vector similarity. They are “vectors in - vectors out”. They still require the production of vectors, management of the ML models, associated orchestration and processing of the inputs. Marqo makes this easy by being “documents in, documents out”. Preprocessing of text and images, embedding the content, storing meta-data and deployment of inference and storage is all taken care of by Marqo. We have been running Marqo for production workloads with both low-latency and large index requirements. Marqo features: - Low-latency (10’s ms - configuration dependent), large scale (10’s - 100’s M vectors). - Easily integrates with LLM’s and other generative AI - augmented generation using a knowledge base. - Pre-configured open source embedding models - SBERT, Huggingface, CLIP/OpenCLIP. - Pre-filtering and lexical search. - Multimodal model support - search text and/or images. - Custom models - load models fine tuned from your own data. - Ranking with document meta data - bias the similarity with properties like popularity. - Multi-term multi-modal queries - allows per query personalization and topic avoidance. - Multi-modal representations - search over documents that have both text and images. - GPU/CPU/ONNX/PyTorch inference support. See some examples here: Multimodal search: [1] https://ift.tt/kW23Eb4... Refining image quality and identifying unwanted content: [2] https://ift.tt/YNfGxM7... Question answering over transcripts of speech: [3] https://ift.tt/7UmAtTY Question and answering over technical documents and augmenting NPC's with a backstory: [4] https://ift.tt/YWq6yQL... https://ift.tt/it82kNa August 16, 2023 at 07:31PM

Show HN: Prompt-Compose.js Use Axioms and Compositions to Build Modular Prompts https://ift.tt/aeFS05G

Show HN: Prompt-Compose.js Use Axioms and Compositions to Build Modular Prompts This JS library provides basic axioms for building and managing GPT prompts. It helps you build small and reusable prompt components and then let you compose them together to build larger ones. https://ift.tt/45swZMu August 16, 2023 at 05:49PM

Show HN: List of public sites blocking ChatGPT Bot https://ift.tt/3xKt5Sf

Show HN: List of public sites blocking ChatGPT Bot Following on from this post ( https://ift.tt/MO0jHRn ), I was intrigued to find which big sites would follow suit, so I started collating a list of them. Interestingly, it's also now being included in codebases by default (like Mastodon). https://ift.tt/sS0gZwR August 16, 2023 at 12:40PM

Show HN: PotterScript – Wizarding world programming language https://ift.tt/jwyLDEh

Show HN: PotterScript – Wizarding world programming language hey everyone, I've build a simple language for learning purposes and I thought it was a funny idea to make it with a Harry Potter theme, hope you like it! https://ift.tt/4jc1nlp August 15, 2023 at 12:46AM

Show HN: Watermelon – Source-available passive documentation search engine https://ift.tt/pqdbsiN

Show HN: Watermelon – Source-available passive documentation search engine Hey there HN! We're a pair of devs and we are looking to get feedback for our source-available passive documentation search engine. Passive documentation is the code context devs are generating as they talk about code in systems such as GitHub, Slack, Notion and Jira. Our search engine serves both our IDE extension (for individuals) and GitHub app (for teams). As devs we know that there are certain PRs that stay unmerged for weeks or even months, not because of the technical complexity, but because of the debate that they produce around changes in the business logic: "Will this change really improve our metrics?" We know that non-technical stakeholders (managers and designers) can bring a more holistic view to these debates but code review is too technical for them. So we decided to build this with the premise of "let's contextualize devs with business logic". We’re starting with a GitHub app that contextualizes Pull Requests with pieces of related passive documentation. Our big vision is to build a copilot for engineering leaders, starting by automating code review. If we're already indexing passive documentation tied to a new PR, we suspect that we can provide a "first health check" to a PR and say whether or not it's meeting the business requirements. Here's the repo if you want to check it out: https://ift.tt/f53AqtT And here's a blog post explaining why we made our search engine source-available: https://ift.tt/rHKGt1I... Please give us your feedback! Thanks. https://ift.tt/f53AqtT August 14, 2023 at 08:17PM

Show HN: Code-vault, Developers handbook – recipes for BASH, Docker and more https://ift.tt/HiT7sLS

Show HN: Code-vault, Developers handbook – recipes for BASH, Docker and more https://ift.tt/yGRzkoK August 16, 2023 at 03:10AM

Show HN: Lottielab – create and edit animations in the browser https://ift.tt/pFe7L6i

Show HN: Lottielab – create and edit animations in the browser Hello, HN! Today we released Lottielab, a web-based animation tool, to the public as an open beta. Lottielab is a good fit for product animations - small, loopable animations that live in your product or website and typically use the JSON-based Lottie vector animation format. Today, the dominant tool for editing and exporting Lottie animations is Adobe After Effects. AE is a 30-year-old visual effects tool that’s not fit for this purpose, with a steep learning curve and a patchwork of error-prone Lottie export plugins. With Lottielab, we are aiming to reduce the friction of creating and editing product animations by providing an easy-to-use editor with out-of-the-box support for import and export of the Lottie format and many others (GIF/MP4 rendering included, so you're not limited to just Lottie). Feel free to play around with the tool and let me know what you think - I'm here to answer your questions. Happy animating! https://ift.tt/B1otbzl August 16, 2023 at 02:36AM

Show HN: Lottielab – Create product animations in the browser easily https://ift.tt/xY7gdhL

Show HN: Lottielab – Create product animations in the browser easily Hi HN! Today we are releasing Lottielab, a web-based animation tool, to the public as an open beta. The main tool for editing and exporting Lottie animations today is Adobe After Effects, a 30-year-old visual effects tool that’s not fit for this purpose, has a steep learning curve, and requires a patchwork of error-prone plugins. With Lottielab, we are aiming to reduce the friction of creating and editing product animations by providing an easy-to-use editor with out-of-the-box support for import and export of the Lottie format and many others. Feel free to play around with the tool and let me know what you think - I'm here to answer your questions. Happy animating! https://ift.tt/B1otbzl August 15, 2023 at 05:58PM

Show HN: Exploring the design space of binary search trees https://ift.tt/LMpZG9N

Show HN: Exploring the design space of binary search trees https://ift.tt/B2gmlYv August 15, 2023 at 08:04PM

Show HN: Make Any Video Searchable https://ift.tt/kD4Vr6n

Show HN: Make Any Video Searchable Hey HN friends! Yuval here, I'm the maker of Conversational Demos: https://ift.tt/tZSd65r This is a product with a bit of an interesting history: it evolved from my fascination with what we can do with LLMs and video. My original (engineering) thinking was "how cool would it be if we let someone search through video with natural language"? I built the original proof of concept for this over the weekend, taped together with passion, code glue, and sheer will to look away from the really shitty code I originally wrote :) When I showed it to users, I discovered that nobody was really willing to pay for video search - everyone thought it was cool, but there was no hook from a commercial standpoint. And so, as these things happen, I ended up turning it a marketing / sales tool. That's all I'll say about the commercial aspect of it, though I'm happy to expand on it if interesting to the community here. Technical stuff: --- Behind the scenes, when you upload a video (or record one - it's integrated with the not-yet-officially-released Loom SDK), it sends the video to AWS Transcribe, which works with nearly 40 languages, and at the same time converts it to an MP4 format that's tiny and viewable across devices (I do this with AWS Media Transcoder). Next up, I break the transcription down into chunks of around 30 seconds and then send it to OpenAI's embedding database. Through TONS of trial and error, I learned that to get good latency on this thing, you can't really use a (cheap) vector database, and so I'm doing something pretty hacky, and storing the index on a always-on Docker (deployed to fly.io) as opposed to a serverless function, which I was really trying to use until I realized it's not fit-for-purpose. Next up, I upload the embedding index to S3 for later use, as well as store it locally on the machine. That's because the machine has ephemeral memory, and when I re-deploy, the index goes away, and so I just re-download it from S3 if it's not there. I have no idea if this project will commercially succeed. It's live on Product Hunt now, and we'll see how people respond. To be honest, I find building the most fun, and marketing the least fun. So on that front, I did learn several important things about LLMs and building chat-bots along the way: 1. Use the simplest solution if you're optimizing for latency 2. You can't just feed a VTT transcript into an LLM and expect it to figure out the context - you have to do your own chunking 3. There are lots of open source projects out there for using LLMs (langchain, llamaindex, auto-gpt, etc), but just using OpenAI's APIs directly yielded the best results at lowest latency, and least complexity. I'm curious to get the feedback of the HN community - less so commercially, and moreso on the technical front, UX, etc. What suggestions do you have, and what would love to see? Thanks! Yuval August 15, 2023 at 04:23AM

Show HN: LLM Connected with REST APIs https://ift.tt/IxEjLRH

Show HN: LLM Connected with REST APIs Hey, folks here is a peek into Jujutsu. We at Poozle are working with hundreds of APIs and it has been always frustrating to 1. Search the API in the documentation or ask ChatGPT 2. Then copy it to the postman and understand/test the API 3. Generate code to integrate into the codebase We thought how about having all of this at one place. We currently fine-tuned LLM on public REST APIs to reduce hallucination and then combined it with ChatGPT and Postman. I look forward to feedback, feature requests and discussions! https://ift.tt/qNKmxzy August 15, 2023 at 04:02AM

Show HN: Command palette-style Git client https://ift.tt/BfPdqJo

Show HN: Command palette-style Git client https://ift.tt/vrGtuCK August 15, 2023 at 03:31AM

Show HN: Display a chess position in Anki without any addon https://ift.tt/0RJHXMS

Show HN: Display a chess position in Anki without any addon There are quite a few libraries to display a chess position in a web page, but I couldn't find one without dependencies so that I could make an Anki card template with it. There are Anki addons for that purpose but I found them too complicated. I wanted something short that would fit in one page. https://ift.tt/4lmt5jJ August 15, 2023 at 01:30AM

Show HN: Revision History – Show the History of Edits in Google Docs https://ift.tt/OZKSPc4

Show HN: Revision History – Show the History of Edits in Google Docs https://ift.tt/nCfQsih August 15, 2023 at 01:24AM

Show HN: I resurrected one of the top dead Show HNs https://ift.tt/uCKi0lc

Show HN: I resurrected one of the top dead Show HNs OneView was first posted to HN in 2017, but died sometime around late 2019. Using the web archive I cobbled together something that works. Open to hearing people's thoughts on whether this is ethical or not... https://ift.tt/pGdRCPt August 14, 2023 at 11:54PM

Show HN: A website chatbot that also uses APIs https://ift.tt/3ufhDVk

Show HN: A website chatbot that also uses APIs Hi! "Another chatbot for your content" you may ask? Not really! Let me explain. I have realized that there's an untapped potential for ChatGPT plugins: why leave them locked up in the OpenAI store? Let's embed them on websites or share using links! Let's make chatbots ~ do stuff ~, not just talk about what they know. That's how Chatwith was born. It is a chat widget, it scrapes your website, knowledge page, notion etc - but more importantly, it also understands your API. It can interact with that API on your or your visitors' behalf. Some use cases & ideas: - Shopify bot - ask it for order status and invoice - Realtor - ask for budget, provide listings - Survey - ask questions, collect answers, submit to Typeform - Airline service - get your boarding pass - Mixpanel - talk to your analytics In other words: - Talk to APIs & hot data - ChatGPT plugin on every website - Your SaaS can be a chatbot - APIs made accessible (they were reserved for devs until now) - Create an API, use chat as the interface - skip the frontend I am trying to envision a future where website visitors are empowered to just say what they want from the business - instead of navigating endless dashboards and documentation. I'm looking for some feedback about my product! lmk Rafal https://chatwith.tools August 14, 2023 at 05:38PM

Show HN: I made a tool that turns images into videos to boost our Twitter reach https://ift.tt/4mCLnWt

Show HN: I made a tool that turns images into videos to boost our Twitter reach Recently there were some changes to the Twitter algorithm and one of the most important ones was boosting video content even more in the feed, which got me thinking: "Why shouldn't we benefit from the algo changes and get a boost every time we are sharing some visuals?" So I spent the weekend building a tool that: - Turns your images into videos - Has 30 beautiful animated gradients that we can pick from - Is completely FREE I'd love to know your thoughts about it! https://ift.tt/IsgJBwM August 14, 2023 at 04:49PM

Show HN: A free course on how to write a good Midjourney/ChatGPT prompt https://ift.tt/k810uqT

Show HN: A free course on how to write a good Midjourney/ChatGPT prompt https://ift.tt/qXftQ9V August 14, 2023 at 03:07PM

Show HN: Zero-dependency minimal Java web framework https://ift.tt/aFSDkjm

Show HN: Zero-dependency minimal Java web framework I have written a from-scratch minimalist Java web framework, called Minum. I'd like to get your thoughts. The driving goal has been achieving characterics of plainness, frugality, performance, maintainability, testability, and ease of use. It has zero dependencies other than Java's SDK, yet provides a web server, routing, authentication, testing, logging, templating, HTML parsing, and a database, in 3800 lines of code, compiling to a 150k binary. It currently supports a web application in production. There are also example projects demonstrating its use, linked in the documentation. As the framework itself has no dependencies, it is built using GNU Make. The example applications that depend on it, however, use Maven as their build tool. Because Minum is still in beta, it is not yet published to Maven - but there are instructions for a workaround. The framework and example apps require Java 20. https://ift.tt/1gD0vlC August 14, 2023 at 02:45AM

Show HN: PitchPower – AI powered proposal generation for consultants https://ift.tt/XydVo06

Show HN: PitchPower – AI powered proposal generation for consultants Hey HN! I'm an indie hacker who builds SAAS products in my free time. I've got a friend who runs a small consulting firm and said this would be a useful tool for them so i thought why not release it as a standalone online tool for everyone. Basically the premise is, you enter some information about your services (or we just scrape your website and figure it out). Then you enter a description of the client brief, tweak the outline, and out comes a unique tailored proposal that you can tweak with AI. That's pretty much it! Would love to hear your thoughts. Thank you. https://ift.tt/LOWFTD5 August 14, 2023 at 01:02AM