Hacker News
How to Tame Evil Dependencies
Article URL: https://www.thoughtworks.com/insights/articles/how-to-tame-evil-dependencies
Comments URL: https://news.ycombinator.com/item?id=41482232
Points: 2
# Comments: 0
Russia throttles YouTube, popular with kids, celebrities and dissidents
Article URL: https://www.washingtonpost.com/world/2024/09/08/russia-youtube-google-ukraine/
Comments URL: https://news.ycombinator.com/item?id=41482222
Points: 4
# Comments: 0
Therapy Sessions Exposed by Mental Health Care Firm's Unsecured Database
Article URL: https://www.wired.com/story/confidant-health-therapy-records-database-exposure/
Comments URL: https://news.ycombinator.com/item?id=41482198
Points: 1
# Comments: 0
How Natural Are We?
Article URL: https://www.newyorker.com/culture/open-questions/how-natural-are-we
Comments URL: https://news.ycombinator.com/item?id=41482197
Points: 1
# Comments: 0
AI should not become another 'fire'
Article URL: https://lutino.substack.com/p/navigating-the-ai-transition-a-good
Comments URL: https://news.ycombinator.com/item?id=41481983
Points: 1
# Comments: 0
CS students in the US substantially outperform those in China, India, and Russa
Article URL: https://www.pnas.org/doi/10.1073/pnas.1814646116
Comments URL: https://news.ycombinator.com/item?id=41481980
Points: 2
# Comments: 0
MidrasAI: Simple API for text and image retrieval
Article URL: https://github.com/ajac-zero/midrasai
Comments URL: https://news.ycombinator.com/item?id=41481973
Points: 1
# Comments: 0
Show HN: Nexa SDK – Build powerful and efficient AI apps on edge devices
Hey HN! Alex and Zack here from Nexa AI. We're excited to share something we've been working on.
Our journey began with the Octopus series --- action models for mobile AI agents [https://huggingface.co/NexaAIDev/Octopus-v2]. We focused on making sub-billion parameter models excel at function calling, making high accurate and fast function-calling possible on mobile and edge devices. But as we delved into developing full-fledged on-device applications, we hit a roadblock.
We realized that optimizing for function calling (tool-use) alone wasn't enough. Building powerful on-device AI apps requires a diverse set of tools: language models with domain expertise, speech processing, image generation, embedding models and more. That's when we decided to create Nexa SDK --- a comprehensive toolkit that brings together everything developers need to build powerful and efficient AI applications that run entirely on-device.
Here's what Nexa SDK offers:
- Support for both ONNX and GGML models. - An integrated conversion engine for making custom GGML Quantized Models for different device hardware requirements. - An inference engine that supports language models, image generation models, TTS, audio generation models, and Vision-Language Models. - An OpenAI-compatible API server with optimization in function calling. - A Streamlit UI for rapid prototyping. - An intuitive CLI for easy model management. - Backend optimizations for latency and power consumption on edge devices. We've designed Nexa SDK to be the go-to solution for developers pushing the boundaries of what's possible with on-device AI applications and AI on edge devices.
To showcase its capabilities, we've built several demo apps running entirely on your device:
- AI soulmate with uncensored model and audio-in/audio-out interaction. [https://github.com/NexaAI/nexa-sdk/tree/main/examples/ai_soulmate] - A quick interface for uploading and chatting with PDFs like your personal finance documents.[https://github.com/NexaAI/nexa-sdk/tree/main/examples/financial-advisor] - A meeting transcription app supporting multiple languages and real-time translation. [https://github.com/NexaAI/nexa-sdk/tree/main/examples/voice_transcription] We're proud to share that the winner of yesterday's (Sep 7) House AGI "AI PC/ GenAI Goes Local" hackathon used Nexa SDK to build a local semantic image search. [GitHub - asl3/deja-view: Semantic Image Search]
But we're just getting started! There are lots of exciting developments in our pipeline, and we can't wait to share them with you soon!
Check it out: https://github.com/NexaAI/nexa-sdk Docs: https://docs.nexaai.com/
If you're excited about the future of on-device AI, we'd really appreciate your support. A star on our GitHub repo goes a long way in helping us reach more developers!
Cheers, Alex & Zack
Comments URL: https://news.ycombinator.com/item?id=41481949
Points: 1
# Comments: 0
Package manager package manager package manager
Article URL: https://blog.phor.net/package-manager-package-manager-package-manager
Comments URL: https://news.ycombinator.com/item?id=41481924
Points: 2
# Comments: 1
Show HN: Evolution of "who is hiring" vs. "who wants to be hired" over the years
Article URL: https://i.imgur.com/UO7mS0X.png
Comments URL: https://news.ycombinator.com/item?id=41481920
Points: 1
# Comments: 0
Why don't we know our neighbors?
Article URL: https://newpublic.substack.com/p/why-dont-we-know-our-neighbors
Comments URL: https://news.ycombinator.com/item?id=41481891
Points: 1
# Comments: 0
The Story Behind Fenster
Article URL: https://zserge.com/posts/fenster/
Comments URL: https://news.ycombinator.com/item?id=41481882
Points: 1
# Comments: 0
Tailscale SSH
Article URL: https://tailscale.com/kb/1193/tailscale-ssh
Comments URL: https://news.ycombinator.com/item?id=41481876
Points: 3
# Comments: 0
The sociality of sleep in animal groups
Article URL: https://www.cell.com/trends/ecology-evolution/fulltext/S0169-5347(24)00176-9
Comments URL: https://news.ycombinator.com/item?id=41481861
Points: 2
# Comments: 0
Serving AI from the Basement – 192GB of VRAM Setup
Article URL: https://ahmadosman.com/blog/serving-ai-from-basement/
Comments URL: https://news.ycombinator.com/item?id=41481852
Points: 4
# Comments: 1
Fast free Domain name generator
Article URL: https://refined.so/tools/free-domain-name-generator
Comments URL: https://news.ycombinator.com/item?id=41481830
Points: 1
# Comments: 0
The muscular imagination of Iain M. Banks: a future you might want to l
Article URL: https://www.robinsloan.com/moonbound/muscular-imagination/
Comments URL: https://news.ycombinator.com/item?id=41481821
Points: 4
# Comments: 0
El Paquete Semanal ("The Weekly Package")
Article URL: https://en.wikipedia.org/wiki/El_Paquete_Semanal
Comments URL: https://news.ycombinator.com/item?id=41481818
Points: 3
# Comments: 0
A game theory behind the dark forest strategy?
Article URL: https://en.wikipedia.org/wiki/The_Dark_Forest
Comments URL: https://news.ycombinator.com/item?id=41481775
Points: 1
# Comments: 1