[Request] Update to Apache Beam 2.52.0, enable Beam 2.46.0 compatibility about tfx HOT 5 CLOSED

@masonkirchner,

I tried loosening the apache-beam[gcp] dependency from 2.47.0 to 2.46.0 and tried installing TFX but looks like other packages also have dependency on apache-beam[gcp]==2.47.0. Below is the error I got while installing TFX with apache-beam 2.46: error: apache-beam 2.46.0 is installed but apache-beam[gcp]<3,>=2.47 is required by {'tensorflow-transform', 'tensorflow-data-validation', 'tensorflow-model-analysis', 'tfx-bsl'}

Once beam 2.52.0 get released, we will try to update the dependency in upcoming release. Meanwhile, the workaround to avoid memory leak issue is to use TFX 1.13.0 release which support apache-beam[gcp]>=2.40,<3. Thank you!

from tfx.

@singhniraj08 Thanks for trying to loosen the requirements to allow 2.46.0. It's too bad that it wasn't compatible with other dependencies. I've been using TFX 1.13.0 as a workaround.

Good news: Beam 2.52.0 published a release candidate if you want to get a jump start on testing compatibility: https://pypi.org/project/apache-beam/2.52.0rc2/

from tfx.

@masonkirchner,

We have already loosen the apache-beam version requirements in TFX 1.14.0 release. So apache-beam 2.52.0rc2 should work with TFX 1.14 release without any issues. I tried the same and am able to run an example notebook without any issues. Ref: notebook with TFX and beam 2.52.0rc2

Please try using apache-beam 2.52.0rc2 with TFX 1.14.0 release and let us know if you face any issues. Thank you.

from tfx.

This issue has been marked stale because it has no recent activity since 7 days. It will be closed if no further activity occurs. Thank you.

from tfx.

This issue was closed due to lack of activity after being marked stale for past 7 days.

from tfx.