intent(ci-fix): the Memory Test job on CI started failing with "error TS5107: Option 'moduleResolution=node10' is deprecated" after the typescript v6 bump on main (b5bdda8f) — align scripts/memory/tsconfig.json with the root project's NodeNext settings so the subproject builds on TS6
decision(module-setting): NodeNext over Bundler to match the repo's existing main/server tsconfigs; source files already use explicit .js import extensions, so the switch is a no-op at runtime
Update all documentation, build configuration, and source comments
to reflect the completed migration from tiktoken to gpt-tokenizer.
- Update tokenCount.encoding description to say "OpenAI-compatible
tokenization" with gpt-tokenizer link (README + 15 language docs)
- Remove tiktoken from bundling external deps list since
gpt-tokenizer is pure JS (README + 15 language docs)
- Remove tiktoken COPY from Dockerfile and external from bundle.mjs
- Simplify source code comments removing migration artifacts
- Regenerate scripts/memory/package-lock.json
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Relocated memory testing tools from benchmarks/memory/ to scripts/memory/
to better align with project structure conventions. Updated GitHub Actions
workflow paths accordingly to maintain CI functionality.
renovate[bot]
Kazuki Yamada