Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Recently there are many improvements and bug fixes in arrow-datafusion, especially the object store interface refactoring apache/datafusion#2677. It's better for us to upgrade this dependency. By the commit d0d5564b8f689a01e542b8c1df829d74d0fab2b0, the arrow will be upgraded to 18.0.0
Describe the solution you'd like
Describe alternatives you've considered
Additional context
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Recently there are many improvements and bug fixes in arrow-datafusion, especially the object store interface refactoring apache/datafusion#2677. It's better for us to upgrade this dependency. By the commit d0d5564b8f689a01e542b8c1df829d74d0fab2b0, the arrow will be upgraded to 18.0.0
Describe the solution you'd like
Describe alternatives you've considered
Additional context