Use latest DataFusion

[yahoNanJing]

Which issue does this PR close?

Closes #84.

Rationale for this change

What changes are included in this PR?

Are there any user-facing changes?

[yahoNanJing]

Hi @alamb and @andygrove, could you help review this PR?

[andygrove]

I tried running the integration tests from this branch, by running ./dev/integration-tests.sh, and they failed with:

error: failed to select a version for the requirement `parquet = "^18.0.0"`
candidate versions found which didn't match: 15.0.0, 14.0.0, 13.0.0, ...

[yahoNanJing]

Thanks @andygrove. I didn't run the test. I'll fix it.

[andygrove]

LGTM. I had to update the ballista-base dockerfile to use a newer Rust version and then the integration tests ran:

FROM rust:1.62.0-buster AS builder

I don't really understand why this helped though.

[yahoNanJing]

The rust version on my Mac is also 1.62.0. Maybe we need to update the rust version in the toml as well later. By the way, really appreciate the docker-based integration tests.

[andygrove]

I will merge in the next couple days if there is no more feedback.

@thinkharderdev @Ted-Jiang - do you want to review?

[thinkharderdev]

LGTM

[alamb]

epic work @yahoNanJing ❤️ It is cool to see the net deletion of code

[Ted-Jiang]

👍👍👍