anudeepnd / whitelist Goto Github PK
View Code? Open in Web Editor NEWA simple tool to add commonly white listed domains to your Pi-Hole setup.
License: MIT License
A simple tool to add commonly white listed domains to your Pi-Hole setup.
License: MIT License
The tests we perform as individuals with out knowing what lists a Pi-hole user has on a blocklist or whitelist and weather they want to make it Public?
I test my lists locally first with what I have been able to find and run a Yacy Search Engine to crawl a site to depth of 6.
I had a Google blackout. see https://discourse.pi-hole.net/t/do-we-need-a-developer-blocklist-for-individuals-who-maintain-lists/5381
The ripple effect like a bolt of lightning.
I have Whitelisted and published back to github in a record of 11 mins of me knowing about it.
#I used most of @WaLLy3K lists on my first list attempt. I have a second list.
Hello,
I noticed today that one of my podcasts has not been updated in some time. Looking into it more it seems that it was unable to contact the server. After whitelisting feeds.feedburner.com
, the podcast was able to update again. Perhaps this is a false positive?
Match found in https://hosts-file.net/emd.txt:
openload.co
www.openload.co
the following domains are needed for netflix to working correctly
can you please add this to optional-list.txt
api-global.netflix.com
ichnaea.netflix.com
appboot.netflix.com
secure.netflix.com
Hello, requesting addition:
ota-downloads.nvidia.com
Without it, nvidia shield tv (and probably other nvidia devices) can't download updates.
click.linksynergy.com is used for some ebates sites.
https://www.reddit.com/r/pihole/comments/9fmudp/getting_prime_video_to_work_with_samsung_smart_tv/
According to that Reddit post, the following URL needs to be whitelisted for Samsung TV's Amazon Prime Video app.
time.samsungcloudsolution.com
Found in https://reddestdream.github.io/Projects/MinimalHosts/etc/MinimalHostsBlocker/minimalhosts (on first block of v.firebog.net)
This is not tracking, but https://en.wikipedia.org/wiki/Online_Certificate_Status_Protocol server
I had to whitelist dev.virtualearth.net in order to select a store location on costco.com. It appears to be related to Bing maps. I found it blocked in the WIndowsSpyBlocker list along with a few other Virtual Earth domains that may need to be unblocked as well.
dev.virtualearth.net
ecn.dev.virtualearth.net
t0.ssl.ak.dynamic.tiles.virtualearth.net
t0.ssl.ak.tiles.virtualearth.net
tradetracker.net
is used by the referal site https://www.cashbackxl.nl/
Ran through the referrals.txt whitelist and some are still blocked. Found out that I needed to add www. in front of the domain that was blocked. In addition, found that cj.dotomi.com was another domain that Slickdeals linked to. Forked the text file and added changes. Let me know if you can't see them.
need to whitelist npr-news.streaming.adswizz.com
if you want to listen to the morning news podcast
fyi this will play sponsor clip before your news
Match found in https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts:
npr-news.streaming.adswizz.com
cf-st.sc-cdn.net
should be whitelisted, since it is required for Snapchat stories and picture embeds to load.
$ pihole -q hosts-file.net
Match found in list.18.adblock.mahakala.is.domains:
hosts-file.net
The above domain is responsible for all the images on aliexpress.com. Before whitelisting it, I couldn't see any image, after that all image appeared.
do i have to update the list to download the git every time or is it enough to just run the whitelist.sh?
This domain interferes with the facebook messenger app, at least on the iPhone.
archive.org and web.archive.org are both blocked by the tspprs list. So it would be nice to have on the whitelist script
I've come across a few referral domains that I thought you might want. These are mainly from using Pricerunner and Google:
#Pricerunner redirect
clk.tradedoubler.com
tc.tradetracker.com
track.adform.net
track.webgains.com
#CDON redirect (don't remember, either from marketing email or one of the two other categories)
solutions.tradedoubler.com
#Google shopping redirect
ad.atdmt.com
clickserve.dartsearch.net
In optional-list.txt you add the site company and that give a much better overview then in referral-sites.txt & whitelist.txt.
It would be nice if you can create the lists in the better format so we know which sites are for that domain
Hi there!
I've used your whitelist as a starting point to be customized, thanks for it!
I've found those additions as quite useful in my environment (generic services, MS Office 365 related domains, plugins and cdns used by many websites), maybe they are useful also to others.
Thanks!
Nicolò
google.com
yahoo.com
microsoft.com
skype.com
uservoice.com
linkedin.com
reddit.com
vimeo.com
youtube.com
pinterest.com
facebook.com
wordpress.com
wp.com
github.io
github.com
bing.com
wikipedia.org
facebook.net
fbcdn.net
t.co
twimg.com
gstatic.com
google-analytics.com
googletagmanager.com
googlesyndication.com
googleadservices.com
office.com
office.net
microsoftonline.com
onedrive.com
outlook.com
sharepoint.com
live.com
onmicrosoft.com
onestore.ms
gfx.ms
sfx.ms
aspnetcdn.com
s-microsoft.com
office365.com
microsoftonline-p.com
msocdn.com
akamaihd.net
akamaized.net
jquery.com
crisp.chat
tawk.to
drift.com
driftt.com
intercom.io
leadchampion.com
trialfire.com
amazonaws.com
imgix.net
sumome.com
sumo.com
bufferapp.com
filament.io
sharethis.com
addthis.com
unsplash.com
cloudfront.net
criteo.net
criteo.com
hotjar.com
onesignal.com
getsitecontrol.com
jsdelivr.net
openx.net
Hello,
Would you consider adding pro.fontawesome.com
and use.fontawesome.com
to your whitelist? I have issues with them being blocked at https://github.com/jawz101/MobileAdTrackers/issues/5
When typing into YouTube, search suggestions usually pop up as you're typing. Unfortunately, a lot of block lists (two of them from Wally's site actually) has
clients1.google.com
In the list. While I'm sure there is more to this domain, one of its functions is search suggestions. Feel free to add this one to the optional lists (or global ones) if you wish.
unable to login to the web client of groupme (https://web.groupme.com/signin) without first whitlisting: d2wy8f7a9ursnm.cloudfront.net
-- | --
Adding partners.webmasterplan.com to the whitelist fixed mydealz.de for me.
Maybe this could be an addition ?
Thanks !
I had to whitelist the following domain in order to watch videos on the Amazon Firestick Adult Swim app:
amd.cdn.turner.com
It is blocked in one of the default pi-hole lists:
https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
Theses hosts are in https://hosts-file.net/ad_servers.txt, but they need to be accessed to watch something on amazon prime video.
Could you add them ? (fls-eu.amazon.com and fls-na.amazon.com )
HI
To see video's on news site www.nos.nl we need static.chartbeat.com as whitelisted.
Thanks for the good work!
Jack
"cdn.samsungcloudsolution.com" is on the pi hole's default blocking list.
Recent Samsung TVs stop network if this domain is unaccesible.
This domain is for the Akamai CDN.
Hi!
Adf.ly and www.adf.ly are listed in the whitelist. Shouldn't these two be listed in the optional-list.txt instead?
Thank you!
Hi, please can you add www.synology.com to the whitelist - needed for Synology NAS
Match found in https://v.firebog.net/hosts/Airelle-trc.txt:
www.synology.com
Thanks
Matt
PS Love your work - appreciated
Blocking this domain seems to be crashing GTAOnline on PC since March, unblocking the domain fixed it for people at GTAForums and my mates plus myself.
prod.telemetry.ros.rockstargames.com
It is in NoTrack from https://firebog.net/.
The site res.cloudinary.com is used for image distribution. It is blocked by the following on my PiHole
Exact matches for res.cloudinary.com found in:
https://adblock.mahakala.is
https://hostsfile.mine.nu/hosts0.txt
https://tspprs.com/dl/cl1
https://tspprs.com/dl/phishing
White-listing it allowed for the images on (in my case) bookings.gatwickairport.com to be shown correctly. Please can you confirm and white-list if appropriate?
Thanks
Matt
First off thanks for giving me the idea to store my White List for Pihole on GitHub.
I copy pasted your curl command into my GitHub page and it did not work as I expected. I expected it to overwrite my old whitelist.txt file
What it actually did was append the list to my old list and doubled the size with the same info I had before.
In your curl command at the end is " >> /etc/pihole/whitelist.txt " # this appends the text to the end
I had to change mine to " > /etc/pihole/whitelist.txt " # this overwrites the whole file
your's >>
mine >
Your whitelist will get huge if you do this often.
Found in some android tracking blocklists, it's also google allo/hangouts endpoint: https://github.com/avaidyam/Parrot/wiki/Allo-Endpoints
bethesda.net is incorrectly blocked on this list
Match found in https://raw.githubusercontent.com/CHEF-KOCH/Canvas-fingerprinting-pages/master/Canvas.txt:
Bethesda is a legit gaming company - https://en.wikipedia.org/wiki/Bethesda_Softworks
I think that bethseda.net is the domain that should be blocked instead (s and e transposed)?
Thanks
Matt
Can edge-mqtt.facebook.com be added to the whitelist? If this domain is blocked, Messenger will act up, and refuse to connect.
In the whitelist, there is a non-breaking space at the end of line 154 for s2.youtube.com
s2.youtube.com
This causes issues when using Teleporter to import a backup with this line in its whitelist.
I just tried running your script on a fresh CentOS 7 OS. This fails (or does not run de deduplication part of the script) because gawk is an old version on CentOS (and is not updated yet in the repositories). this means that gawk -i inplace '!a[$0]++' /etc/pihole/whitelist.txt
will not run or work.
I have figured out that running awk '!seen[$0]++' /etc/pihole/whitelist.txt
does work however. Maybe you can use this in the script for all distributions or add an if/switch for CentOs?
In commit 6f2a16c you moved some domains to another list, but the current bash-script doesn't remove these domains from Pi-hole.
I know this is hard to implement but I think this is something to take into account when adding/removing domains ;)
Kind regards.
Hello.
I'm not using your list. I googled for known pihole whitelists and reddit with your link came on top.
I've been running pihole for about 6 months now, with lots of black lists. We have about 100 people everyday on workstations using pihole's dns.
Time to time I need to whitelist something.
I noticed my whitelist file is getting rather large, thus went googling for some trusted whitelist that everybody can benefit from.
All this to say: here! have my whitelist, it may help you!
I have no structure, no comments, no optional. It was built as needed. Every time a needed site is not displaying correctly, there I go, open F12, see what links are being blocked and whitelist one by one until it works. (normally external js are the problem)
I had to whitelist this domain in order to download a pdf attachment from Facebook messenger.
cdn.fbsbx.com
Initial Googling of the domain screams "virus," but I'm not so sure that's the case.
Hi @anudeepND
https://www.ucas.com/ is the UK University application website, and track.ucas.com is the section for students to follow their application.
It matches the regex.list entry ^track(ers?|ing)?[0-9]*[-.] by https://github.com/mmotti/pihole-regex that I've implemented.
Thanks
Matt
pihole -q secure.avangate.com
Match found in Whitelist (Added it manually now because needed to do payment)
secure.avangate.com
Match found in list.49.tspprs.com.domains:
secure.avangate.com
I think i got this block list from
https://github.com/StevenBlack/hosts
xkms.xbolive.com should be xkms.xboxlive.com
Airthings Dashboard for the Wave Radon detector appears to require https://cdn.ravenjs.com, it was blocked by some common lists.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.