Skip to content
Navigation Menu
Toggle navigation
Sign in
Appearance settings
Platform
GitHub Copilot
Write better code with AI
GitHub Spark
New
Build and deploy intelligent apps
GitHub Models
New
Manage and compare prompts
GitHub Advanced Security
Find and fix vulnerabilities
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Discussions
Collaborate outside of code
Code Search
Find more, search less
Explore
Why GitHub
Documentation
GitHub Skills
Blog
Integrations
GitHub Marketplace
MCP Registry
View all features
Solutions
By company size
Enterprises
Small and medium teams
Startups
Nonprofits
By use case
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
By industry
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
Topics
AI
DevOps
Security
Software Development
View all
Explore
Learning Pathways
Events & Webinars
Ebooks & Whitepapers
Customer Stories
Partners
Executive Insights
Open Source
GitHub Sponsors
Fund open source developers
The ReadME Project
GitHub community articles
Repositories
Topics
Trending
Collections
Enterprise
Enterprise platform
AI-powered developer platform
Available add-ons
GitHub Advanced Security
Enterprise-grade security features
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search or jump to...
Search code, repositories, users, issues, pull requests...
Search syntax tips
Provide feedback
Saved searches
Use saved searches to filter your results more quickly
Sign in
Sign up
Appearance settings
Resetting focus
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
google
/
sentencepiece
Public
Notifications
You must be signed in to change notification settings
Fork
1.3k
Star
11.4k
Code
Issues
24
Pull requests
4
Actions
Projects
0
Security
Uh oh!
There was an error while loading.
Please reload this page
.
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security
Insights
Commits
Branch selector
master
User selector
All users
Datepicker
All time
Commit History
Commits on Oct 4, 2025
Merge pull request #1154 from BLKSerene/master
Show description for 606c55e
taku910
authored
606c55e
Copy full SHA for 606c55e
Commits on Oct 2, 2025
Add support for macOS >= 10.13
BLKSerene
committed
6710c80
Copy full SHA for 6710c80
Merge pull request #1152 from google/dependabot/github_actions/github-actions-50cec89d4d
Show description for b29de7d
taku910
authored
b29de7d
Copy full SHA for b29de7d
Commits on Oct 1, 2025
Bump actions/setup-python in the github-actions group
Show description for f91c639
dependabot[bot]
authored
f91c639
Copy full SHA for f91c639
Commits on Sep 30, 2025
Fixed build error on riscv64
taku910
committed
835932f
Copy full SHA for 835932f
Enables abseil-module build on cross-build
taku910
committed
6a1c3a2
Copy full SHA for 6a1c3a2
Commits on Sep 29, 2025
Enables abseil-module build on windows
taku910
committed
2b99b08
Copy full SHA for 2b99b08
Only runs abseil internal mode on windows
taku910
committed
5c6fec6
Copy full SHA for 5c6fec6
Runs abseil module mode on actions
taku910
committed
fe6bcb5
Copy full SHA for fe6bcb5
Update README.md
Show description for 6ca8935
taku910
authored
6ca8935
Copy full SHA for 6ca8935
Commits on Sep 28, 2025
Fixed the error "use of designated initializers requires"
taku910
committed
bef4edd
Copy full SHA for bef4edd
Uses absl::log for logging. deperecates --minloglevel flag, but introduced --quiet.
taku910
committed
7d25ca7
Copy full SHA for 7d25ca7
Commits on Sep 23, 2025
Remove EXPECT_DEATH as the preparation of public absl
taku910
committed
0d8dfe2
Copy full SHA for 0d8dfe2
Avoid using raw pointer in BaseName func
taku910
committed
468d83d
Copy full SHA for 468d83d
Deprecates SPM_NO_THREADLOCAL mode
taku910
committed
86cfacc
Copy full SHA for 86cfacc
Commits on Sep 22, 2025
Fixed typo BIGENDIAN -> BIG_ENDIAN
taku910
committed
575326a
Copy full SHA for 575326a
changes the return value of IsValidNormalizerData
taku910
committed
58ee8f5
Copy full SHA for 58ee8f5
adds the implementation of Swap32 for MSVC
taku910
committed
1baeb2c
Copy full SHA for 1baeb2c
cleanup the code on arraysize and endian handling
taku910
committed
3c1e2c2
Copy full SHA for 3c1e2c2
Downgrade the C++ version to C++17 as the builtin protobuf-lite + MSVC have less support.
taku910
committed
71de2ab
Copy full SHA for 71de2ab
Commits on Sep 21, 2025
suppress the build error on msvc with C++20
taku910
committed
4632778
Copy full SHA for 4632778
suppress the build error on msvc with C++20
taku910
committed
72f53a8
Copy full SHA for 72f53a8
Update the C++ version from 17 to 20.
taku910
committed
8334026
Copy full SHA for 8334026
fixed test error when using external absl. uses add_compile_definitions in cmake
taku910
committed
6dadda5
Copy full SHA for 6dadda5
Commits on Sep 15, 2025
fixed the error when loading directory
taku910
committed
ed7600b
Copy full SHA for ed7600b
Commits on Sep 10, 2025
Merge pull request #1146 from google/revert-1143-dependabot/pip/dot-github/workflows/requirements/build-time-deps-528a9f8897
Show description for cb76f56
taku910
authored
cb76f56
Copy full SHA for cb76f56
Revert "Bump cibuildwheel from 3.1.2 to 3.1.4 in /.github/workflows/requirements in the build-time-deps group"
taku910
authored
174494b
Copy full SHA for 174494b
Merge pull request #1144 from sanderland/patch-1
Show description for b312793
taku910
authored
b312793
Copy full SHA for b312793
Commits on Sep 3, 2025
Merge pull request #1142 from google/dependabot/github_actions/github-actions-55c41d5e0f
Show description for d36cc77
taku910
authored
d36cc77
Copy full SHA for d36cc77
Merge pull request #1143 from google/dependabot/pip/dot-github/workflows/requirements/build-time-deps-528a9f8897
Show description for 3c41a0a
taku910
authored
3c41a0a
Copy full SHA for 3c41a0a
Commits on Sep 2, 2025
Add missing freq factor
sanderland
authored
5cea6d8
Copy full SHA for 5cea6d8
Bump cibuildwheel
Show description for 541cde4
dependabot[bot]
authored
541cde4
Copy full SHA for 541cde4
Bump the github-actions group with 2 updates
Show description for 867b3df
dependabot[bot]
authored
867b3df
Copy full SHA for 867b3df
Commits on Aug 21, 2025
Update README.md
taku910
authored
2ff5315
Copy full SHA for 2ff5315
Commits on Aug 19, 2025
bump the base version from 0.2.1 to 0.2.2
taku910
committed
7bfbccb
Copy full SHA for 7bfbccb
Pagination
Previous
Next
You can’t perform that action at this time.