Skip to content

[REFACTOR] Remove picojson dependency, replace with tvm::ffi::json API#18759

Merged
tqchen merged 1 commit into
apache:mainfrom
MasterJH5574:tvm-dev/2026-02-11-json-refactor
Feb 12, 2026
Merged

[REFACTOR] Remove picojson dependency, replace with tvm::ffi::json API#18759
tqchen merged 1 commit into
apache:mainfrom
MasterJH5574:tvm-dev/2026-02-11-json-refactor

Conversation

@MasterJH5574

Copy link
Copy Markdown
Contributor

Migrate all picojson usages to the new tvm::ffi::json API built on the FFI type system, and remove the 3rdparty/picojson directory entirely.

  • Migrate src/runtime/vm/tensor_cache_support.cc
  • Migrate src/runtime/disco/loader.cc
  • Migrate src/runtime/contrib/nvshmem/init.cc
  • Remove PICOJSON_PATH from CMakeLists.txt, LibInfo.cmake, libinfo.cc
  • Remove picojson include path from web/Makefile
  • Remove picojson entry from LICENSE
  • Delete 3rdparty/picojson/ and licenses/LICENSE.picojson.txt

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Summary of Changes

Hello @MasterJH5574, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request refactors the codebase by eliminating the external picojson dependency. It replaces all instances of picojson usage with the internal tvm::ffi::json API, streamlining the project's dependencies and promoting a more unified approach to JSON handling within the system. This change simplifies the build process and reduces the overall footprint of third-party libraries.

Highlights

  • Picojson Dependency Removal: The external picojson library and all its related files (headers, README, test, license) have been completely removed from the codebase.
  • Migration to Internal JSON API: All previous usages of picojson for JSON parsing and manipulation have been migrated to the new tvm::ffi::json API, which is built on the FFI type system.
  • Build System and License Updates: The build configuration (CMakeLists.txt, LibInfo.cmake, web/Makefile) and the project's LICENSE file have been updated to reflect the removal of picojson.

🧠 New Feature in Public Preview: You can now enable Memory to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console.

Changelog
  • 3rdparty/picojson/README.md
    • Removed file.
  • 3rdparty/picojson/picojson.h
    • Removed file.
  • 3rdparty/picojson/test_picojson.cpp
    • Removed file.
  • CMakeLists.txt
    • Removed PICOJSON_PATH option.
    • Removed picojson from system include directories.
  • LICENSE
    • Removed entry for 3rdparty/picojson.
  • cmake/modules/LibInfo.cmake
    • Removed TVM_INFO_PICOJSON_PATH variable.
  • licenses/LICENSE.picojson.txt
    • Removed file.
  • src/runtime/contrib/nvshmem/init.cc
    • Updated include from picojson.h to tvm/ffi/extra/json.h.
    • Refactored JSON parsing logic to use tvm::ffi::json API.
  • src/runtime/disco/loader.cc
    • Removed PICOJSON_USE_INT64 and __STDC_FORMAT_MACROS preprocessor definitions.
    • Updated include from picojson.h to tvm/ffi/extra/json.h.
    • Refactored JSON parsing logic to use tvm::ffi::json API, including json::Parse, json::Object, json::Array, and ffi::Any casts.
  • src/runtime/vm/tensor_cache_support.cc
    • Removed PICOJSON_USE_INT64 and __STDC_FORMAT_MACROS preprocessor definitions.
    • Updated include from picojson.h to tvm/ffi/extra/json.h.
    • Refactored JSON parsing logic to use tvm::ffi::json API, including json::Parse, json::Object, json::Array, and ffi::Any casts.
  • src/support/libinfo.cc
    • Removed PICOJSON_PATH from the GetLibInfo map.
  • web/Makefile
    • Removed 3rdparty/picojson from INCLUDE_FLAGS.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

@tqchen tqchen changed the title refactor: Remove picojson dependency, replace with tvm::ffi::json API [REFACTOR] Remove picojson dependency, replace with tvm::ffi::json API Feb 11, 2026

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request successfully refactors the codebase to remove the picojson dependency and replace its usage with the tvm::ffi::json API. The changes span across several C++ source files, build configurations, and license files, effectively removing all traces of picojson. The migration to the new JSON API has been implemented correctly. I've suggested one minor performance improvement to pre-allocate memory for a vector, consistent with patterns in other parts of the modified code. Overall, this is a solid refactoring that improves dependency management.

Comment thread src/runtime/contrib/nvshmem/init.cc
@MasterJH5574 MasterJH5574 force-pushed the tvm-dev/2026-02-11-json-refactor branch from fb2d1f5 to 576b306 Compare February 11, 2026 21:59
@tqchen

tqchen commented Feb 11, 2026

Copy link
Copy Markdown
Member

cc @Ubospica

@Ubospica Ubospica left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Just some minor comments.

Comment thread src/runtime/disco/loader.cc Outdated
Comment thread src/runtime/vm/tensor_cache_support.cc Outdated
@MasterJH5574 MasterJH5574 force-pushed the tvm-dev/2026-02-11-json-refactor branch from 576b306 to 5c8d6da Compare February 12, 2026 02:13
@MasterJH5574

Copy link
Copy Markdown
Contributor Author

/gemini review

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request is a refactoring that removes the picojson dependency and replaces all its usages with the new tvm::ffi::json API. This change affects several files, mainly in the runtime, where JSON parsing was used for configuration and metadata loading. The migration is done cleanly, using the new FFI-based JSON API, which is more integrated with the TVM type system. The changes also include cleanups in build files (CMakeLists.txt, Makefile) and license files to completely remove any trace of picojson. The refactoring is well-executed and improves the codebase by reducing an external dependency.

Migrate all picojson usages to the new tvm::ffi::json API built on the
FFI type system, and remove the 3rdparty/picojson directory entirely.

- Migrate src/runtime/vm/tensor_cache_support.cc
- Migrate src/runtime/disco/loader.cc
- Migrate src/runtime/contrib/nvshmem/init.cc
- Remove PICOJSON_PATH from CMakeLists.txt, LibInfo.cmake, libinfo.cc
- Remove picojson include path from web/Makefile
- Remove picojson entry from LICENSE
- Delete 3rdparty/picojson/ and licenses/LICENSE.picojson.txt
@MasterJH5574 MasterJH5574 force-pushed the tvm-dev/2026-02-11-json-refactor branch from 5c8d6da to db324f7 Compare February 12, 2026 02:16
@tqchen tqchen merged commit 00a88b1 into apache:main Feb 12, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants