httplib patcher: AttributeError: 'HTTPResponse' object has no attribute '_xray_prop' about aws-xray-sdk-python HOT 8 CLOSED

We will look at this issue as soon as possible. It looks like you patched botocore or boto3 and httplib at the same time correct? If you could share the caller code that will help a lot with the debugging.

from aws-xray-sdk-python.

I'm using patch_all() which patches

[INFO]	2018-04-06T00:25:02.442Z	870efd48-3930-11e8-a425-f7be7f28044b	successfully patched module httplib
[INFO]	2018-04-06T00:25:02.443Z	870efd48-3930-11e8-a425-f7be7f28044b	successfully patched module pynamodb
[INFO]	2018-04-06T00:25:02.443Z	870efd48-3930-11e8-a425-f7be7f28044b	successfully patched module requests
[INFO]	2018-04-06T00:25:02.443Z	870efd48-3930-11e8-a425-f7be7f28044b	successfully patched module sqlite3

The caller code is actually not mine, using pandas.read_csv() (https://github.com/pandas-dev/pandas/blob/v0.22.0/pandas/io/parsers.py#L557-L709)

from aws-xray-sdk-python.

I see. From the stack trace pandas is depending on botocore to call AWS S3 APIs to retrieve files. botocore has some certain part that depends on httplib. The httplib patcher failed because botocore use it in an unexpected way.

We will release a bug fix. With the fix you will not get this error. But you won't see the http roundtrip time since botocore has custom logic to actually send the http request.

from aws-xray-sdk-python.

Thank you @haotianw465, I can reproduce the error quite easily so let me know if you want a patch tested.

from aws-xray-sdk-python.

Though I don't know how you are using pandas in your application but I'm fairly confident that if you change this line https://github.com/aws/aws-xray-sdk-python/blob/master/aws_xray_sdk/ext/httplib/patch.py#L106 to the following:

    xray_data = getattr(instance, _XRAY_PROP, None)
    if not xray_data:
        return wrapped(*args, **kwargs)

it should work, assuming you have write access to change this file in place.

from aws-xray-sdk-python.

Confirmed that this patch works.

I see that httplib still gets patched:

successfully patched module httplib

But instead of crashing I get the expected warning:

cannot find the current segment/subsegment, please make sure you have a segment open

from aws-xray-sdk-python.

Cool. We will roll out this fix in the next release as soon as possible, though we cannot provide an exact date.

In the meantime if your application doesn't have direct dependency on httplib and you don't need to trace those http calls, we would recommend to use patch((my_lib_1, my_lib_2)) to explicit capture the libraries you care about.

from aws-xray-sdk-python.

This issue has been fixed in the latest v1.0 release.

from aws-xray-sdk-python.