Code Monkey home page Code Monkey logo

censortracker_backend's Introduction

Build Netlify CodeFactor Chrome Web Store Mozilla Add-on

Censor Tracker is a censorship circumvention extension for Google Chrome and Mozilla Firefox.

English | Russian

Features

Censor Tracker provides a lot of useful features, here are the most important:

  • Configurable proxy
  • Country-specific proxying
  • Custom proxying list
  • Censorship-resistant itself
  • Warns about websites that transfer data to third parties

Permissions

Censor Tracker requires the following permissions:

  • alarms to support periodic tasks
  • activeTab to detect IDO websites
  • management to be able to detect permission conflicts
  • notifications to show notifications
  • proxy to configure and use Censor Tracker proxy servers
  • scripting to inject content scripts into websites
  • storage to save preferences
  • unlimitedStorage to save the database of blocked websites
  • webNavigation for handling requests
  • http://*/* and https://*/* to proxy any website, retrieve the list of proxy servers, and detect the user's country

Requirements

Censor Tracker works with following versions of browsers:

  • Mozilla Firefox 98 or higher
  • Chromium (Google Chrome, Brave, Edge, Opera etc.) 94 or higher

Development

Prerequisites

Make sure you have required versions of node and npm, which are:

  • node v17.4.0 or higher
  • npm 8.3.1 or higher

Optionally, you may like:

The build was tested only on the following operating systems:

  • Ubuntu 19.10
  • macOS Catalina v10.15.7

We don't guarantee that Censor Tracker will work on outdated versions of browsers, so make sure you're using the latest ones.

We've tested Censor Tracker on the following versions:

  • Mozilla Firefox 98 or higher
  • Google Chrome 94 or higher

Installation

Firstly, you will need to install dependencies:

~ npm install

Now you can build an extension for Chrome like this:

~ npm run build:chrome
~ cd dist/chrome

and for Firefox, like this:

~ npm run build:firefox
~ cd dist/firefox

Troubleshooting: If you're getting error on building an extension using npm, please make sure that your shell supports per-command environment variables (i.e something like this NODE_ENV=production npm run build:firefox:prod)

Going to production

You can build a production version of the extension for Chrome like this:

~ npm run build:chrome:prod
~ npm run release:chrome
~ cd release/chrome

and for Firefox like this:

~ npm run build:firefox:prod
~ npm run release:firefox
~ cd release/firefox

License

Censor Tracker is licensed under the MIT License. See LICENSE for more information.

censortracker_backend's People

Contributors

dependabot[bot] avatar lk-geimfari avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar avatar avatar

Forkers

hellsyeah efojs totoro2205 suren73

censortracker_backend's Issues

Don't store user IP at all

There is no need to store user IP at all, even temporally. You could utilize https://github.com/hadiasghari/pyasn for offline transforming IP to AS number on-the-fly, and store AS number in db. It has the same benefits as your current solution (as I understand, you save full client ip addr to db, and every 3 hours convert ip addr to client hash, region and ISP info by http (this for sure is to be fixed) request to separate proprietary SaaS service, correct me if I wrong).

pyasn include scripts to download raw data from http://archive.routeviews.org. An alternative could be parsing http://thyme.apnic.net data. So strore ASN in db. To get info about ASN, pyasn include script to parse http://www.cidr-report.org/as2.0/autnums.html Also there is maxmind's db https://dev.maxmind.com/geoip/geoip2/geolite2-asn-csv-database/ and relevant python lib. Also you could whois (or event rdap with https://rdap.arin.net/registry/autnum/<ASN>).

Anyway, having ASN is more useful in tracking censorship events, and this conversion could be done entirely offline and on-the-fly, protecting user privacy better.

Notifications not working 

[2021-07-27 03:59:00,053: INFO/MainProcess] Received task: Update IP data[620bbda5-4b20-4911-aa22-4143b3ee6684]
[2021-07-27 03:59:00,215: ERROR/ForkPoolWorker-2] Task Update IP data[620bbda5-4b20-4911-aa22-4143b3ee6684] raised unexpected: DataError('value too long for type character varying(64)\n')
Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/django/db/backends/utils.py", line 86, in _execute
    return self.cursor.execute(sql, params)
psycopg2.errors.StringDataRightTruncation: value too long for type character varying(64)


The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/celery/app/trace.py", line 412, in trace_task
    R = retval = fun(*args, **kwargs)
  File "/usr/lib/python3.9/site-packages/celery/app/trace.py", line 704, in __protected_call__
    return self.run(*args, **kwargs)
  File "/app/server/apps/api/tasks.py", line 17, in run
    call_command("update_ip_data")
  File "/usr/lib/python3.9/site-packages/django/core/management/__init__.py", line 168, in call_command
    return command.execute(*args, **defaults)
  File "/usr/lib/python3.9/site-packages/django/core/management/base.py", line 369, in execute
    output = self.handle(*args, **options)
  File "/app/server/apps/api/management/commands/update_ip_data.py", line 21, in handle
    update_ip_data()
  File "/app/server/apps/api/management/commands/update_ip_data.py", line 98, in update_ip_data
    case.save()
  File "/usr/lib/python3.9/site-packages/django/db/models/base.py", line 745, in save
    self.save_base(using=using, force_insert=force_insert,
  File "/usr/lib/python3.9/site-packages/django/db/models/base.py", line 782, in save_base
    updated = self._save_table(
  File "/usr/lib/python3.9/site-packages/django/db/models/base.py", line 864, in _save_table
    updated = self._do_update(base_qs, using, pk_val, values, update_fields,
  File "/usr/lib/python3.9/site-packages/django/db/models/base.py", line 917, in _do_update
    return filtered._update(values) > 0
  File "/usr/lib/python3.9/site-packages/django/db/models/query.py", line 771, in _update
    return query.get_compiler(self.db).execute_sql(CURSOR)
  File "/usr/lib/python3.9/site-packages/django/db/models/sql/compiler.py", line 1499, in execute_sql
    cursor = super().execute_sql(result_type)
  File "/usr/lib/python3.9/site-packages/django/db/models/sql/compiler.py", line 1151, in execute_sql
    cursor.execute(sql, params)
  File "/usr/lib/python3.9/site-packages/django/db/backends/utils.py", line 100, in execute
    return super().execute(sql, params)
  File "/usr/lib/python3.9/site-packages/sentry_sdk/integrations/django/__init__.py", line 469, in execute
    return real_execute(self, sql, params)
  File "/usr/lib/python3.9/site-packages/django/db/backends/utils.py", line 68, in execute
    return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)
  File "/usr/lib/python3.9/site-packages/django/db/backends/utils.py", line 77, in _execute_with_wrappers
    return executor(sql, params, many, context)
  File "/usr/lib/python3.9/site-packages/django/db/backends/utils.py", line 86, in _execute
    return self.cursor.execute(sql, params)
  File "/usr/lib/python3.9/site-packages/django/db/utils.py", line 90, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/lib/python3.9/site-packages/django/db/backends/utils.py", line 86, in _execute
    return self.cursor.execute(sql, params)
django.db.utils.DataError: value too long for type character varying(64)

Configuring the deployment process

Since we working on Censor Tracker in Github, but our CI/CD is Gitlab we need to configure our deployment process somehow. Maybe we can create a mirror of this repository on Gitlab or something.

@HellsYeah @msva What do you think?

Reduce domain duplication

Create a CensorshipCase model with m2o link to Domain. In CensorshipCase, we will store specific information on locks and the client (hash, region, etc.), for which the lock was detected, and in Domain only domains.

CensorshipCase can have any other much appropriate name.

Example:

class Domain(models.Model):
    domain = models.CharField(..., unique=True)
    ...


class CensorshipCase(models.Model):
    domain = models.ForeignKey(Domain, related_name='domains', ...)
    ...

Make API endpoint return less useless data.

This is what it (/api/domains/) returns right now:

[
   {
      "domain":"s5.slivup.ch"
   },
   {
      "domain":"all-audio.pro"
   },
   {
      "domain":"https://example.com"
   },
]

It's better to return just a list of domains:

[
   "s5.slivup.ch",
   "all-audio.pro",
   "https://example.com"
]

The API is not in use yet, so we can change it easily.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.