Hacker News

Not by AI

Hacker News - Sun, 09/08/2024 - 11:31pm

Article URL: https://notbyai.fyi

Comments URL: https://news.ycombinator.com/item?id=41485201

Points: 1

# Comments: 2

Categories: Hacker News

Earthly: Like Docker for Builds

Hacker News - Sun, 09/08/2024 - 10:59pm

Article URL: https://github.com/earthly/earthly

Comments URL: https://news.ycombinator.com/item?id=41485095

Points: 1

# Comments: 0

Categories: Hacker News

Ask HN: Can tokenizers go from fixed length tokens to varying length?

Hacker News - Sun, 09/08/2024 - 10:46pm

I am going through a workshop on building LLM grounds up. While I am studying tokenizers like BPE - I was curious why not use ideas from encoding techniques like huffman and make better optimized encoders. So a token like '.' also has same sie token as the word 'Algorithm'. Their frequency of occurence and their size could save us some GPUs?

Comments URL: https://news.ycombinator.com/item?id=41485028

Points: 1

# Comments: 0

Categories: Hacker News

Bitten by Unicode

Hacker News - Sun, 09/08/2024 - 10:38pm
Categories: Hacker News

The Fair Play Policy Institute

Hacker News - Sun, 09/08/2024 - 10:37pm

Article URL: https://www.fairplaypolicy.org/

Comments URL: https://news.ycombinator.com/item?id=41484997

Points: 1

# Comments: 0

Categories: Hacker News

Pages