Hacker News

Subscribe to Hacker News feed
Hacker News RSS
Updated: 4 min 56 sec ago

JVM Anatomy Quarks

Sun, 11/10/2024 - 11:09am
Categories: Hacker News

Magic Paper (A Retrospective)

Sun, 11/10/2024 - 10:59am
Categories: Hacker News

Show HN: Chonkie – A Fast, Lightweight Text Chunking Library for RAG

Sun, 11/10/2024 - 10:58am

I built Chonkie because I was tired of rewriting chunking code for RAG applications. Existing libraries were either too bloated (80MB+) or too basic, with no middle ground.

Core features:

- 21MB default install vs 80-171MB alternatives

- 33x faster token chunking than popular alternatives

- Supports multiple chunking strategies: token, word, sentence, and semantic

- Works with all major tokenizers (transformers, tokenizers, tiktoken)

- Zero external dependencies for basic functionality

Technical optimizations:

- Uses tiktoken with multi-threading for faster tokenization

- Implements aggressive caching and precomputation

- Running mean pooling for efficient semantic chunking

- Modular dependency system (install only what you need)

Benchmarks and code: https://github.com/bhavnicksm/chonkie

Looking for feedback on the architecture and performance optimizations. What other chunking strategies would be useful for RAG applications?

Comments URL: https://news.ycombinator.com/item?id=42100819

Points: 3

# Comments: 0

Categories: Hacker News

Ask HN: How to stop constant DDoS on CS 1.6 server?

Sun, 11/10/2024 - 10:53am

1.6 is still played regularly in India, especially the 32/32 slot servers. Now I do not have proof of this but bad actor(s), always from one server, keep DDoSing the other, usually more popular and full, server so that players are forced to switch. And as soon as their own server gets filled, the DDoSing stops.

This DDoS problem has been a plague on 1.6 in India for the last 5-7 years. From what I've gathered, none has been able to solve for it, and even though I don't have skin in the game (other than being a frequent player), it fundamentally feels wrong being bullied.

Does anyone have experience with solving this?

P.S. If you do give a response, please consider that I do not have an IT background. Thank you.

Comments URL: https://news.ycombinator.com/item?id=42100795

Points: 1

# Comments: 0

Categories: Hacker News

Show HN: ScratchMap real-time collaborative map annotation

Sun, 11/10/2024 - 10:49am

Article URL: https://scratchmap.app/

Comments URL: https://news.ycombinator.com/item?id=42100772

Points: 2

# Comments: 0

Categories: Hacker News

Pages