Skip to content

Make Comet even friendlier to agentic development #5178

Description

@andygrove

What is the problem the feature request solves?

This is an item that I am currently working on, but wanted an issue to link to from PRs, and also to share the thinking behind this work.

Comet already has some skills in the repo for implementing and auditing expressions, and reviewing PRs. The PR review skill is quite specific to expressions.

I would like to improve the skills, and the contributor guide, to cover more areas so that we can improve the quality of reviews.

Some examples:

  • Look for code duplicating existing arrow/datafusion kernels
  • Review code from a performance point-of-view i.e. are we using arrow as efficiently as possible and avoiding per-row/per-element builder loops
  • Have specialist knowledge of more areas of the code base, such as shuffle implementation, and memory management

I plan on creating PRs to enhance the contributor guide and will then create PRs to add/update skills to leverage that information during reviews

Describe the potential solution

No response

Additional context

No response

Activity

  1. self-assigned this
    on Jul 31, 2026
  2. changed the title [-]Make Comet even friendlier to Agent development[/-] [+]Make Comet even friendlier to agentic development[/+] on Jul 31, 2026
  3. andygrove commented on Sep 28, 2026

    @andygrove
    MemberAuthor

    The contributor guide now has a memory management page (#5933, #6014) and corrected FFI and shuffle pages. #6018 split review-comet-pr into area skills for expressions, FFI, memory and shuffle, and #6149 added one for Iceberg writes. The expression review skill also flags row-by-row loops where an Arrow kernel exists and kernels that duplicate DataFusion or datafusion-spark, so I think this is done and can be closed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions