gigatoken-rb is an open-source Ruby binding for marcelroed/gigatoken. It exposes the underlying tokenization functionality to Ruby applications while using zero-copy bindings for more efficient data handling.
gigatoken-rb sits in PulseGate's Frameworks & SDKs category. It focuses on using the gigatoken tokenization library from Ruby without unnecessary data copying. gigatoken-rb is an open-source project aimed at ruby developers. gigatoken-rb is open source under the Open Source license. gigatoken-rb is available on the web and the command line, and it can be self-hosted.
jetpks builds and maintains gigatoken-rb. Among its 4 catalogued features are ruby bindings, zero-copy data handling, and tokenization support.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Same category — not a similarity match