Implement vacuum command about delta-rs HOT 5 CLOSED

@fvaleye I think this is actually done right? I'm not clear what work we have left to do

Yes, it is already implemented! Hum, we need to improve the tests suite: #227

from delta-rs.

Как насчет поправить документацию?
Наверное стоит подновить с вот этого

на вот это?

from delta-rs.

@fvaleye I think this is actually done right? I'm not clear what work we have left to do

from delta-rs.

@rtyler @fvaleye It looks like there are still two serious issues with vacuum implementation:

• vacuum lists all files in dataset using StorageBackend.list_objs. The problem is this function returns all files (including these in subdirectories) on s3 backend and gcs backend (althrough I'm not sure about gcs). On file and azure backends this function lists only first-level files (without recursing to subdirectories).
• vacuum ignores files not referenced by delta log at all (so not included on DeltaTableState.files() and DeltaTableState.all_tombstones() lists).

from delta-rs.

Resolved by #669.

from delta-rs.