Comments (22)
Is there any news on this ? we're also looking to anonymize or have an option to remove network details altogether.
from browser-sdk.
Hi @tchock thanks a lot for raising this. Apologies for the delay! Here is the situation for now:
RUM
It is possible to keep the geoip data (country, city, etc) while getting rid of the IP address. A configuration option will be available in a settings page in the UI in Q1. For now, these requests will need to go through [email protected].
Browser Logs
The workaround suggested above is the right one if you want to remove all geoip information and will be documented appropriately. We will also document an alternate version of this workaround in order to keep all geoip information without storing the IP address. Our support will also be able to help configure it.
The vast majority of users actually need the IP address and geoIP data, which is why it is enabled by default. On logs specifically, we are stuck with how integrations pipelines work: there's no simpler way to customize them. Once again thank you for the patience here. I will answer with the appropriate documentation links once it's live.
from browser-sdk.
We would also love to have this feature.
@hdelaby is there any update regarding this?
What we did to make it work right now is:
- We cloned the browser logs pipeline (to be able to manipulate it)
- We disabled the geoip process
- We added a new string builder process on the
network.client.ip
attribute path and replaced it with[removed]
Hope this will be helpful for the others.
But we would need a proper solution for this. This is basically making this feature not usable for companies in the EU.
from browser-sdk.
Any updates on this? :D
from browser-sdk.
Hello,
Here is the current state:
RUM
You can choose whether or not you want to include IP or geolocation data from the Datadog UI, more details in the doc.
Logs
You can remove geolocation data by:
- cloning the browser logs pipeline (to be able to manipulate it)
- disabling the geoip processor
You can anonymise the IP by:
- creating a new pipeline after the browser logs pipeline
- adding a string builder processor to replace
network.client.ip
attribute value with[removed]
from browser-sdk.
Hi @rolebi
This feature is coming very soon. The choice between all these options will be available in Datadog's interface.
from browser-sdk.
Update?
from browser-sdk.
This feature is coming very soon. The choice between all these options will be available in Datadog's interface.
Hi, @hdelaby Any updates on the feature?
from browser-sdk.
Hello,
The situation is still the same, to remove IP addresses from RUM data, you need to go through [email protected].
We still want to build something in the UI and have planned work around that but no ETA to share yet.
We'll let you know here if we have any update on the topic.
from browser-sdk.
Great : )
from browser-sdk.
Very interested by this as well. We would love to use RUM and Logs, but because we can't anonymise IPs to be GDPR compliant we are not using it.
Great that you are working on it :)
from browser-sdk.
+1 for updates. There's mention of the workaround above being documented. Did this ever happen? Many thanks
from browser-sdk.
any news ?
from browser-sdk.
@bcaudan , we don't use RUM, but we still want to avoid logging IP/geo in the regular browser intake. We've contacted support, and they've only linked us to beforeSend
etc, which ofc does not work. AFAIK, the network
part is added to the logs not in the SDK here, but on the ingestion level (or similar, outside of our control).
Any recommendation? Is that something support is able to solve similar to for RUM?
from browser-sdk.
@johnkors for browser logs, did you tried the mentioned workaround?
from browser-sdk.
@bcaudan Not sure how that would work for browser logs. We're never sending anything related to network. It's appended at datadog servers.
from browser-sdk.
@bcaudan , we don't use RUM, but we still want to avoid logging IP/geo in the regular browser intake. We've contacted support, and they've only linked us to
beforeSend
etc, which ofc does not work. AFAIK, thenetwork
part is added to the logs not in the SDK here, but on the ingestion level (or similar, outside of our control).Any recommendation? Is that something support is able to solve similar to for RUM?
One workaround to ensure that the IP/Geo information is never forwarded from the clients to Datadog regardless of whether it's stored or not (would still show up in access logs etc) is to setup a simple HTTP proxy between your clients and Datadog.
from browser-sdk.
@henningms Hi ;) Yeah, that's our last resort.
from browser-sdk.
@henningms Hi ;) Yeah, that's our last resort.
Hi! 😂
It's quickly becoming my default in the projects 😅 Allows us to control what is sent and eases the minds of the legal/GDPR team
from browser-sdk.
@johnkors for browser logs, did you tried the mentioned workaround?
@bcaudan Not sure how that would work for browser logs. We're never sending anything related to network. It's appended at datadog servers.
The mentionned workaround allow you to customize what is done by datadog servers.
from browser-sdk.
The mentionned workaround allow you to customize what is done by datadog servers.
Sorry, I misread "cloning" as a code change in this repo (as in a fork). My fault. I'll try out the pipeline mods. Thanks.
from browser-sdk.
Any update on this request? Seems like a feature that many would find useful. The workaround mentioned above might not be viable for everyone.
from browser-sdk.
Related Issues (20)
- `beforeSend` not firing HOT 3
- 💡 Discard identical logs HOT 2
- Rollup warning: "this" has been rewritten to "undefined" HOT 3
- 💡 Log traceId at start of request HOT 1
- 🐛 Wrong city name HOT 1
- 🙏 Error thrown as console instead of source HOT 2
- 🙏🏻 Understanding Performance Implications of the NPM Installation Method HOT 2
- 🙏 Inject trace_id and span_id from OpenTelemetry into browser logs HOT 2
- outdated type definitions for `LogsInitConfiguration`
- 💡 Support Soft Navigation HOT 2
- only one between datadogRum and datadogLogs is available at a time HOT 5
- stack trace/source mapping for custom action HOT 7
- Datadog Trace Headers Not Added for Angular HttpClient Requests HOT 2
- Large number of Uncaught "Object Not Found Matching" errors HOT 1
- 💡 More attribution data for event timings and core web vitals HOT 3
- 🙏🏻 Does the sampleRate of native and webview affect each other? HOT 10
- 💡 Improvements to console forwarding HOT 1
- getSelectorFromElement scales poorly with a large DOM and ids with numbers are not used HOT 6
- 🙏 Document how action target name is computed HOT 3
- Nuxtjs application not loading Datadog RUM properly and no data is reported to Datadog HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from browser-sdk.