Hacker News

Show HN: Advanced Chunking in JavaScript/TypeScript with Chonkie

Hacker News - Fri, 05/23/2025 - 4:03pm

Hi HN,

We’re Shreyash and Bhavnick. We built Chonkie, an open-source library for advanced chunking and embedding of text and code. It was previously Python-only, but we just released a TypeScript version: https://github.com/chonkie-inc/chonkie-ts

Many AI projects in JS/TS (like those using Vercel's AI SDK or Mastra) rely on basic text splitters. But better chunking = better retrieval = better performance. That’s what Chonkie is built for.

Current native chunkers (in TS):

- Code Chunker – handles Python, TypeScript, etc.

- Recursive Chunker – rule-based, hierarchical splitting

- Token Chunker – split by token count (fully customizable)

- Sentence Chunker – split on sentence boundaries. Delimiters are customizable, so it works for multiple languages.

All chunkers support custom tokenizers, chunk overlap, delimiters, and more.

Coming soon in native TS (already available via the API client):

- Semantic Chunker – splits texts wherever it detects a shift in meaning.

- SDPM Chunker – merges semantically similar disjoint chunks

- Late Chunker – generates context-aware embeddings for each chunk

- Slumber Chunker – LLM-refined recursive chunks. Significantly reduces token usage (and thus cost) while maximizing chunk quality.

- Embeddings Refinery - Embed chunks with any embedding model

- Overlap Refinery – Create overlaps between consecutive chunks for better context preservation.

Chonkie is free, open-source, and MIT licensed. GitHub: https://github.com/chonkie-inc/chonkie-ts

We’d love your feedback, ideas, or contributions. Thanks!

Comments URL: https://news.ycombinator.com/item?id=44076134

Points: 3

# Comments: 0

Categories: Hacker News

Ask HN: Is anyone working on a ROS/ROS2 successor?

Hacker News - Fri, 05/23/2025 - 3:57pm

Comments URL: https://news.ycombinator.com/item?id=44076083

Points: 2

# Comments: 0

Categories: Hacker News

GNU Emacs Configuration

Hacker News - Fri, 05/23/2025 - 3:57pm
Categories: Hacker News

Ask HN: How to start selling my Restaurant AI automation software?

Hacker News - Fri, 05/23/2025 - 3:57pm

In today’s hyper competitive environment, traditional restaurant operations are no longer sustainable without digitization. A lack of integrated systems, limited digital marketing and zero automation result in operational inefficiencies and lost revenue opportunities. So i have built a complete end to end Automation package for Restaurant or Food business insdutry.

I am a tech person don't have any experience on sales what should be my ideal approach to kick start my sales process.

Looking forward to learn from some experts

Comments URL: https://news.ycombinator.com/item?id=44076072

Points: 1

# Comments: 2

Categories: Hacker News

The Transwedge Product

Hacker News - Fri, 05/23/2025 - 3:56pm
Categories: Hacker News

Genetic Boids Web Simulation

Hacker News - Fri, 05/23/2025 - 3:40pm
Categories: Hacker News

Pages