Remove extra top-level libraries

[natebosch]

The modern pattern for most packages is to use a single top-level import library and put the implementation libraries in lib/src. We don't typically ship fine-grained libraries unless there is a specific use case like supporting platform specific imports.

[lrhn]

Would be reasonable if we ever make a 3.0 release. We likely won't.