Hacker News

Article URL: https://www.thoughtworks.com/insights/articles/how-to-tame-evil-dependencies

Comments URL: https://news.ycombinator.com/item?id=41482232

Points: 2

# Comments: 0

Article URL: https://www.washingtonpost.com/world/2024/09/08/russia-youtube-google-ukraine/

Comments URL: https://news.ycombinator.com/item?id=41482222

Points: 4

# Comments: 0

Article URL: https://www.wired.com/story/confidant-health-therapy-records-database-exposure/

Comments URL: https://news.ycombinator.com/item?id=41482198

Points: 1

# Comments: 0

Article URL: https://www.newyorker.com/culture/open-questions/how-natural-are-we

Comments URL: https://news.ycombinator.com/item?id=41482197

Points: 1

# Comments: 0

Article URL: https://lutino.substack.com/p/navigating-the-ai-transition-a-good

Comments URL: https://news.ycombinator.com/item?id=41481983

Points: 1

# Comments: 0

Article URL: https://www.pnas.org/doi/10.1073/pnas.1814646116

Comments URL: https://news.ycombinator.com/item?id=41481980

Points: 2

# Comments: 0

Article URL: https://github.com/ajac-zero/midrasai

Comments URL: https://news.ycombinator.com/item?id=41481973

Points: 1

# Comments: 0

Hey HN! Alex and Zack here from Nexa AI. We're excited to share something we've been working on.

Our journey began with the Octopus series --- action models for mobile AI agents [https://huggingface.co/NexaAIDev/Octopus-v2]. We focused on making sub-billion parameter models excel at function calling, making high accurate and fast function-calling possible on mobile and edge devices. But as we delved into developing full-fledged on-device applications, we hit a roadblock.

We realized that optimizing for function calling (tool-use) alone wasn't enough. Building powerful on-device AI apps requires a diverse set of tools: language models with domain expertise, speech processing, image generation, embedding models and more. That's when we decided to create Nexa SDK --- a comprehensive toolkit that brings together everything developers need to build powerful and efficient AI applications that run entirely on-device.

Here's what Nexa SDK offers:

- Support for both ONNX and GGML models. - An integrated conversion engine for making custom GGML Quantized Models for different device hardware requirements. - An inference engine that supports language models, image generation models, TTS, audio generation models, and Vision-Language Models. - An OpenAI-compatible API server with optimization in function calling. - A Streamlit UI for rapid prototyping. - An intuitive CLI for easy model management. - Backend optimizations for latency and power consumption on edge devices. We've designed Nexa SDK to be the go-to solution for developers pushing the boundaries of what's possible with on-device AI applications and AI on edge devices.

To showcase its capabilities, we've built several demo apps running entirely on your device:

- AI soulmate with uncensored model and audio-in/audio-out interaction. [https://github.com/NexaAI/nexa-sdk/tree/main/examples/ai_soulmate] - A quick interface for uploading and chatting with PDFs like your personal finance documents.[https://github.com/NexaAI/nexa-sdk/tree/main/examples/financial-advisor] - A meeting transcription app supporting multiple languages and real-time translation. [https://github.com/NexaAI/nexa-sdk/tree/main/examples/voice_transcription] We're proud to share that the winner of yesterday's (Sep 7) House AGI "AI PC/ GenAI Goes Local" hackathon used Nexa SDK to build a local semantic image search. [GitHub - asl3/deja-view: Semantic Image Search]

But we're just getting started! There are lots of exciting developments in our pipeline, and we can't wait to share them with you soon!

Check it out: https://github.com/NexaAI/nexa-sdk Docs: https://docs.nexaai.com/

If you're excited about the future of on-device AI, we'd really appreciate your support. A star on our GitHub repo goes a long way in helping us reach more developers!

Cheers, Alex & Zack

Comments URL: https://news.ycombinator.com/item?id=41481949

Points: 1

# Comments: 0

Article URL: https://blog.phor.net/package-manager-package-manager-package-manager

Comments URL: https://news.ycombinator.com/item?id=41481924

Points: 2

# Comments: 1

Article URL: https://i.imgur.com/UO7mS0X.png

Comments URL: https://news.ycombinator.com/item?id=41481920

Points: 1

# Comments: 0

Article URL: https://newpublic.substack.com/p/why-dont-we-know-our-neighbors

Comments URL: https://news.ycombinator.com/item?id=41481891

Points: 1

# Comments: 0

Article URL: https://zserge.com/posts/fenster/

Comments URL: https://news.ycombinator.com/item?id=41481882

Points: 1

# Comments: 0

Article URL: https://tailscale.com/kb/1193/tailscale-ssh

Comments URL: https://news.ycombinator.com/item?id=41481876

Points: 3

# Comments: 0

Article URL: https://www.cell.com/trends/ecology-evolution/fulltext/S0169-5347(24)00176-9

Comments URL: https://news.ycombinator.com/item?id=41481861

Points: 2

# Comments: 0

Article URL: https://ahmadosman.com/blog/serving-ai-from-basement/

Comments URL: https://news.ycombinator.com/item?id=41481852

Points: 4

# Comments: 1

Comments URL: https://news.ycombinator.com/item?id=41481834

Points: 4

# Comments: 0

Article URL: https://refined.so/tools/free-domain-name-generator

Comments URL: https://news.ycombinator.com/item?id=41481830

Points: 1

# Comments: 0

Article URL: https://www.robinsloan.com/moonbound/muscular-imagination/

Comments URL: https://news.ycombinator.com/item?id=41481821

Points: 4

# Comments: 0

Article URL: https://en.wikipedia.org/wiki/El_Paquete_Semanal

Comments URL: https://news.ycombinator.com/item?id=41481818

Points: 3

# Comments: 0

Article URL: https://en.wikipedia.org/wiki/The_Dark_Forest

Comments URL: https://news.ycombinator.com/item?id=41481775

Points: 1

# Comments: 1