Hacker News

Article URL: https://www.npmjs.com/package/@phun-ky/speccer

Comments URL: https://news.ycombinator.com/item?id=42187312

Points: 1

# Comments: 1

Article URL: https://www.rockpapershotgun.com/how-microsoft-flight-simulator-2024-uses-machine-learning-ai-and-how-much-of-your-data-it-might-need

Comments URL: https://news.ycombinator.com/item?id=42187308

Points: 1

# Comments: 0

Article URL: https://www.microsoft.com/en-us/microsoft-365/blog/2024/11/19/introducing-copilot-actions-new-agents-and-tools-to-empower-it-teams/

Comments URL: https://news.ycombinator.com/item?id=42187298

Points: 1

# Comments: 0

Article URL: https://github.com/zaataylor/writing/blob/main/harvesting-memories.md

Comments URL: https://news.ycombinator.com/item?id=42187293

Points: 1

# Comments: 0

I see this warning periodically and it blocks me from posting the comment I wrote. This is very frustrating. This feature should give a warning BEFORE you write a long comment reply right?

Comments URL: https://news.ycombinator.com/item?id=42187283

Points: 3

# Comments: 3

Article URL: https://github.com/marketplace/actions/diffguard-ai-pr-review

Comments URL: https://news.ycombinator.com/item?id=42187278

Points: 1

# Comments: 1

Article URL: https://github.com/midzer/tobii

Comments URL: https://news.ycombinator.com/item?id=42187275

Points: 2

# Comments: 0

Looking for free microblogging. So far I found these:

https://public.me/ (you need to have: iMessage)

https://vagabundo.co (you need to have: Telegram)

Create a Telegram public channel and add a "S" to the URL: https://t.me/s/rugbyphotos/434

Comments URL: https://news.ycombinator.com/item?id=42187246

Points: 1

# Comments: 0

Article URL: https://www.centauri-dreams.org/2024/11/19/star-harvest-civilizations-in-search-of-energy/

Comments URL: https://news.ycombinator.com/item?id=42187201

Points: 1

# Comments: 0

Article URL: https://www.theguardian.com/science/2024/nov/13/tomatoes-gene-editing-sweeter-fruit

Comments URL: https://news.ycombinator.com/item?id=42187166

Points: 1

# Comments: 1

With all these endless debates about Rust and Go, it seems that a lot of software engineers really want a programming language that is as expressive as Rust with its sum types and matching, but also easier in that there is garbage collection, a rich standard library, like in Go.

There are OCaml and F#, but I still see those are very much niche languages with pretty small communities.

Comments URL: https://news.ycombinator.com/item?id=42187165

Points: 3

# Comments: 2

Article URL: https://www.nytimes.com/2024/11/19/business/finland-germany-cable-baltic-sea.html

Comments URL: https://news.ycombinator.com/item?id=42187147

Points: 4

# Comments: 1

Hi HN! This is Adil, Salman, Co and Shuguang and we're excited to introduce archgw [1], an open source intelligent proxy for agents built on Envoy [2]. Arch moves the critical but crufty work around safety, observability, and routing of prompts outside business logic. Arch is a uniquely intelligent infrastructure primitive, engineered with purpose-built fast LLMs [3] for tasks like intent detection over multi-turn, parameter identification and extraction, triggering single/multiple function calls, and offers convenience features to auto dispatch LLM calls for summarization based on data from your APIs via system prompts configured in archgw.

Today, the approach to build a smart production-ready agent is weaving together a large set of mono-functional opinionated libraries, adding extra layers like LLM-based preprocessing to determine things like relevance and safety of the user's prompt (e.g. applying governance and guardrails). Once past that stage, developers must extract relevant information from the user prompt to determine intent, extract parameters as necessary, package relevant tools calls to an LLM to trigger a backend API to execute particular domain-specific task. etc. After all that is done then only are developers ready to trigger an LLM call for summarization and must manage upstream error handling and retry logic themselves. Not to mention, if they want to experiment with multiple LLMs or move between LLM versions, they have to write crufty undifferentiated code. This entire experience is slow, error prone, cumbersome, and not specifically unique.

Prior to building archgw, the team spent time building Envoy [2] at Lyft, API Gateway at AWS, specialized search and intent models at Microsoft Research and worked on safety at Meta. archgw was born out of the belief that several rules based mono-functional tools should be converged into a multi-functional infrastructure primitive designed for prompts and agents. We built archgw on the highly popular, battle-tested open source proxy Envoy and re-imagined it for prompts and agents. For this we had to build blazing fast LLMs [3] that can handle crufty, ahead-in-the-request-path type of work in handling and processing prompts that are sent to an agent, so that developers can focus on what matters most: building fast personalized agents without the unnecessary prompt engineering and systems integration work needed to get there.

Here are some additional details about the open source project. arghw is written in rust, and the request path has three main parts:

* Listener subsystem which handles downstream (ingress) and upstream (egress) request processing.

* Prompt handler subsystem. This is where archgw makes decisions on the safety of the incoming request via its prompt_guard primitive and identifies where to forward the conversation to via its prompt_target primitive.

* Model serving subsystem is the interface that hosts all the lightweight LLMs engineered in archgw and offers a framework for things like hallucination detection of our these models

We loved building this open source project, and our belief is that this infra primitive would help developers build faster, safer and more personalized agents without all the manual prompt engineering and systems integration work needed to get there. We hope to invite other developers to use and improve Arch. Please give it a shot and leave feedback here, or at our discord channel [4]

Also here is a quick demo of the project in action [5]. You can check out our public docs here at [6]. Our models are also available here [7].

[1] https://github.com/katanemo/archgw

[2] https://www.envoyproxy.io/

[3] https://huggingface.co/collections/katanemo/arch-function-66...

[4] https://discord.com/channels/1292630766827737088/12926307682...

[5] https://www.youtube.com/watch?v=I4Lbhr-NNXk

[6] https://docs.archgw.com/

[7] https://huggingface.co/katanemo

Comments URL: https://news.ycombinator.com/item?id=42187132

Points: 8

# Comments: 3

Article URL: https://venturebeat.com/ai/microsoft-quietly-assembles-the-largest-ai-agent-ecosystem-and-no-one-else-is-close/

Comments URL: https://news.ycombinator.com/item?id=42186837

Points: 1

# Comments: 0

Article URL: https://www.wsj.com/tech/ai/ai-college-costs-higher-education-9a8f875d

Comments URL: https://news.ycombinator.com/item?id=42186833

Points: 1

# Comments: 0

Article URL: https://storage.googleapis.com/deepmind-media/gemini/gemini_1_report.pdf

Comments URL: https://news.ycombinator.com/item?id=42186819

Points: 1

# Comments: 0

Article URL: https://www.bloomberg.com/opinion/articles/2024-11-19/insider-trading-at-the-fed

Comments URL: https://news.ycombinator.com/item?id=42186811

Points: 1

# Comments: 0

Article URL: https://arstechnica.com/tech-policy/2024/11/cable-companies-and-trumps-fcc-chair-agree-data-caps-are-good-for-you/

Comments URL: https://news.ycombinator.com/item?id=42186802

Points: 1

# Comments: 0

Article URL: https://www.microsoft.com/en-us/windows-365/link

Comments URL: https://news.ycombinator.com/item?id=42186796

Points: 2

# Comments: 0

Article URL: https://twitter.com/cyrilzakka/status/1858937683487412704

Comments URL: https://news.ycombinator.com/item?id=42186794

Points: 1

# Comments: 0