We need to start versioning the app such that people who have it hosted have a better idea of how far behind they are without peering into the source code.

Suggestions:

• Semantic versioning
• use git tags for release versions
• use bumpversion to automate the version incrementing
• maintain a setup.py that contains the versioning info as well as the packaging details to generate a distributable tarball
• changelogs for every version

I exported my bookmarks from chrome. They appear to be in the right format. Nothing happens when I try to import. I get redirected to the search screen and nothing happens. No bookmarks imported.

Having another archive provider that is a local "service" to somehow (wget maybe) save a web page archive locally would be a great addition, I think.

Not sure best format... MAFF is good, although I've had issues finding non-Firefox support for it.

After executing command "fab vagrant_init" there's a long log of what's happening, but in the middle of everything there's this:

[127.0.0.1:2222] sudo: git clone https://[email protected]/dhamaniasad/crestify_xyz123123123123.git crestify [127.0.0.1:2222] out: Cloning into 'crestify'... [127.0.0.1:2222] out: Password for 'https://[email protected]':

And trying password "crestify"

[127.0.0.1:2222] out: remote: Invalid username or password. If you log in via a third party service you must ensure you have an account password set in your account profile.
[127.0.0.1:2222] out: fatal: Authentication failed for 'https://[email protected]/dhamaniasad/crestify_xyz123123123123.git/'
[127.0.0.1:2222] out:

Fatal error: sudo() received nonzero return code 128 while executing!

Requested: git clone https://[email protected]/dhamaniasad/crestify_xyz123123123123.git crestify
Executed: sudo -S -p 'sudo password:' -u "crestify" /bin/bash -c "cd /home/crestify >/dev/null && git clone https://[email protected]/dhamaniasad/crestify_xyz123123123123.git crestify"

Aborting.
Disconnecting from 127.0.0.1:2222... done.

So it would be perfect if there's any way to clone this repo without your password.

Am I correct (from a quick read through the archiving code) that there isn't a way to have the archive local, but rather relies on outside sources?

Sorry if I misunderstood.

Not sure if I missed a step or what but just FYI. Looks like a great project and would love to try it out.

Failed to load resource: the server responded with a status of 500 (INTERNAL SERVER ERROR)

is there one?

also, the firefox extension looks like it could use a few reviews

Hey Asad,

Text highlight is something that I would love to see. As some content needs to be re-read where highlight part can come in handy. Sometimes you have to close a tab urgently and might want to repeat reading after that, so this feature might help a few people.

Thanks!.

It seems that when Crestify was published publicly, the Tag model had some VCS issues and we ended up with two different versions of the Tag model in different parts of the code.

We use a M2M relationship, and used an array of strings earlier. We need to add the M2M model back in with a migration, else imports, among other things, will be broken. Issue #33 is also because of this.

Crestify is doing very well but I have a few suggestion or feature request.

1. To have an option to save just text from a website and not the entire page as an image. Or even some selected data to be bookmarked on a website or highlighted.

2. The title or heading or articles have tags and those tags should be saved in crestify's tag list as it would get easier to find the article and the website. Powerful search may save a lot of time for a lot of people. It still works fine but this might help a little bit more.

Thanks.

The public version here has deviated from the hosted version at crestify.com
The source code has some secrets in it, and the architecture is a little complicated - basically there's iframely, there's a node service, there's redis, and there's elasticsearch.

I am no longer actively working on this project apart from bug fixes. Creating this issue to remind myself to upload the updated source code so interested people can self hosted Crestify.

Well... And now something is wrong later in the process.

[127.0.0.1:2222] out: building 'lxml.etree' extension
[127.0.0.1:2222] out:
[127.0.0.1:2222] out: creating build/temp.linux-x86_64-2.7
[127.0.0.1:2222] out:
[127.0.0.1:2222] out: creating build/temp.linux-x86_64-2.7/src
[127.0.0.1:2222] out:
[127.0.0.1:2222] out: creating build/temp.linux-x86_64-2.7/src/lxml
[127.0.0.1:2222] out:
[127.0.0.1:2222] out: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -I/home/crestify/crestifyenv/build/lxml/src/lxml/includes -I/usr/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -w
[127.0.0.1:2222] out:
[127.0.0.1:2222] out: x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -lxslt -lexslt -lxml2 -lz -lm -o build/lib.linux-x86_64-2.7/lxml/etree.so
[127.0.0.1:2222] out:
[127.0.0.1:2222] out: /usr/bin/ld: cannot find -lz
[127.0.0.1:2222] out:
[127.0.0.1:2222] out: collect2: error: ld returned 1 exit status
[127.0.0.1:2222] out:
[127.0.0.1:2222] out: error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
[127.0.0.1:2222] out:
[127.0.0.1:2222] out: ----------------------------------------
[127.0.0.1:2222] out: Cleaning up...
[127.0.0.1:2222] out: Command /home/crestify/crestifyenv/bin/python -c "import setuptools, tokenize;file='/home/crestify/crestifyenv/build/lxml/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-JeXaHG-record/install-record.txt --single-version-externally-managed --compile --install-headers /home/crestify/crestifyenv/include/site/python2.7 failed with error code 1 in /home/crestify/crestifyenv/build/lxml
[127.0.0.1:2222] out: Traceback (most recent call last):
[127.0.0.1:2222] out: File "/home/crestify/crestifyenv/bin/pip", line 11, in
[127.0.0.1:2222] out: sys.exit(main())
[127.0.0.1:2222] out: File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/pip/init.py", line 185, in main
[127.0.0.1:2222] out: return command.main(cmd_args)
[127.0.0.1:2222] out: File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/pip/basecommand.py", line 163, in main
[127.0.0.1:2222] out: log_file_fp = open_logfile(log_file_fn, 'w')
[127.0.0.1:2222] out: File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/pip/basecommand.py", line 194, in open_logfile
[127.0.0.1:2222] out: os.makedirs(dirname)
[127.0.0.1:2222] out: File "/home/crestify/crestifyenv/lib/python2.7/os.py", line 157, in makedirs
[127.0.0.1:2222] out: mkdir(name, mode)
[127.0.0.1:2222] out: OSError: [Errno 13] Permission denied: '/home/vagrant/.pip'
[127.0.0.1:2222] out:

Fatal error: sudo() received nonzero return code 1 while executing!

Requested: pip install -r crestify/requirements.txt
Executed: sudo -S -p 'sudo password:' -u "crestify" /bin/bash -c "cd /home/crestify >/dev/null && source crestifyenv/bin/activate && pip install -r crestify/requirements.txt"

Aborting.
Disconnecting from 127.0.0.1:2222... done.

When setting up the database I get this error:

honcho run python main.py db upgrade

Raven is not configured (logging is disabled). Please see the documentation for more information.
Traceback (most recent call last):
  File "main.py", line 4, in <module>
    from crestify.views.manager import *
  File "/Users/kaneru/crestify/crestify/views/manager.py", line 8, in <module>
    from crestify.services import bookmark, tab
  File "/Users/kaneru/crestify/crestify/services/bookmark.py", line 4, in <module>
    from crestify.services import archive
  File "/Users/kaneru/crestify/crestify/services/archive.py", line 6, in <module>
    from crestify.tasks import celery
  File "/Users/kaneru/crestify/crestify/tasks/__init__.py", line 3, in <module>
    from celery import Celery
  File "/Users/kaneru/crestify/venv/lib/python2.7/site-packages/celery/__init__.py", line 130, in <module>
    from celery import five
  File "/Users/kaneru/crestify/venv/lib/python2.7/site-packages/celery/five.py", line 149, in <module>
    from kombu.utils.compat import OrderedDict  # noqa
  File "/Users/kaneru/crestify/venv/lib/python2.7/site-packages/kombu/utils/__init__.py", line 19, in <module>
    from uuid import UUID, uuid4 as _uuid4, _uuid_generate_random
ImportError: cannot import name _uuid_generate_random

Please update documentation to contain that at least vagrant 1.5.x or higher is needed.

Selected bookmark in context view isn't getting highlighted

Well, i'm really struggling with getting crestify (within vagrant) running. I managed to get over the mail-sending-error by editing the override.py and inserting a working smtp-server. But now it seems like the database was not set up correctly? Is there something wrong with the fabfile? The error occurs when trying to register a new user.

ERROR:crestify:Exception on /register [POST] Traceback (most recent call last): File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask/app.py", line 1817, in wsgi_app response = self.full_dispatch_request() File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask/app.py", line 1477, in full_dispatch_request rv = self.handle_user_exception(e) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask_cors.py", line 272, in wrapped_function return cors_after_request(app.make_response(f(*args, **kwargs))) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask_restful/__init__.py", line 263, in error_router return original_handler(e) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask/app.py", line 1381, in handle_user_exception reraise(exc_type, exc_value, tb) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask/app.py", line 1475, in full_dispatch_request rv = self.dispatch_request() File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask/app.py", line 1461, in dispatch_request return self.view_functions[rule.endpoint](**req.view_args) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask_security/decorators.py", line 225, in wrapper return f(*args, **kwargs) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask_security/views.py", line 116, in register if form.validate_on_submit(): File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask_wtf/form.py", line 166, in validate_on_submit return self.is_submitted() and self.validate() File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/wtforms/form.py", line 310, in validate return super(Form, self).validate(extra) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/wtforms/form.py", line 152, in validate if not field.validate(self, extra): File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/wtforms/fields/core.py", line 200, in validate stop_validation = self._run_validation_chain(form, chain) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/wtforms/fields/core.py", line 220, in _run_validation_chain validator(form, self) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask_security/forms.py", line 78, in unique_user_email if _datastore.get_user(field.data) is not None: File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/flask_security/datastore.py", line 191, in get_user rv = self.user_model.query.filter(query).first() File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2367, in first ret = list(self[0:1]) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2228, in __getitem__ return list(res) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2438, in __iter__ return self._execute_and_instances(context) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2453, in _execute_and_instances result = conn.execute(querycontext.statement, self._params) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 729, in execute return meth(self, multiparams, params) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/sql/elements.py", line 322, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 826, in _execute_clauseelement compiled_sql, distilled_params File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 958, in _execute_context context) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1159, in _handle_dbapi_exception exc_info File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/util/compat.py", line 199, in raise_from_cause reraise(type(exception), exception, tb=exc_tb) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 951, in _execute_context context) File "/home/crestify/crestifyenv/local/lib/python2.7/site-packages/sqlalchemy/engine/default.py", line 436, in do_execute cursor.execute(statement, parameters) ProgrammingError: (ProgrammingError) relation "User" does not exist LINE 2: FROM "User" ^ 'SELECT "User".id AS "User_id", "User".email AS "User_email", "User".password AS "User_password", "User".first_name AS "User_first_name", "User".last_name AS "User_last_name", "User".active AS "User_active", "User".confirmed_at AS "User_confirmed_at", "User".bookmarks_per_page AS "User_bookmarks_per_page", "User".api_key AS "User_api_key" \nFROM "User" \nWHERE "User".email ILIKE %(email_1)s \n LIMIT %(param_1)s' {'email...

Description: Ubuntu 14.04.5 LTS
Release: 14.04
Codename: trusty

No handlers could be found for logger "paramiko.transport"
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/fabric/main.py", line 757, in main
    *args, **kwargs
  File "/usr/local/lib/python2.7/dist-packages/fabric/tasks.py", line 426, in execute
    results['<local-only>'] = task.run(*args, **new_kwargs)
  File "/usr/local/lib/python2.7/dist-packages/fabric/tasks.py", line 173, in run
    return self.wrapped(*args, **kwargs)
  File "/opt/crestify/fabfile.py", line 18, in vagrant_init
    execute(install_python_reqs)
  File "/usr/local/lib/python2.7/dist-packages/fabric/tasks.py", line 386, in execute
    multiprocessing
  File "/usr/local/lib/python2.7/dist-packages/fabric/tasks.py", line 276, in _execute
    return task.run(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/fabric/tasks.py", line 173, in run
    return self.wrapped(*args, **kwargs)
  File "/opt/crestify/fabfile.py", line 31, in install_python_reqs
    sudo('apt-get update --fix-missing')
  File "/usr/local/lib/python2.7/dist-packages/fabric/network.py", line 687, in host_prompting_wrapper
    return func(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/fabric/operations.py", line 1148, in sudo
    capture_buffer_size=capture_buffer_size,
  File "/usr/local/lib/python2.7/dist-packages/fabric/operations.py", line 930, in _run_command
    channel=default_channel(), command=wrapped_command, pty=pty,
  File "/usr/local/lib/python2.7/dist-packages/fabric/state.py", line 424, in default_channel
    chan = _open_session()
  File "/usr/local/lib/python2.7/dist-packages/fabric/state.py", line 416, in _open_session
    return connections[env.host_string].get_transport().open_session()
  File "/usr/local/lib/python2.7/dist-packages/fabric/network.py", line 159, in __getitem__
    self.connect(key)
  File "/usr/local/lib/python2.7/dist-packages/fabric/network.py", line 151, in connect
    user, host, port, cache=self, seek_gateway=seek_gateway)
  File "/usr/local/lib/python2.7/dist-packages/fabric/network.py", line 481, in connect
    client.connect(**kwargs)
  File "/usr/local/lib/python2.7/dist-packages/paramiko/client.py", line 338, in connect
    t.start_client(timeout=timeout)
  File "/usr/local/lib/python2.7/dist-packages/paramiko/transport.py", line 500, in start_client
    raise e
AttributeError: _init_cffi_1_0_external_module

Any ideas?

Say I decide to self host crestify, I should be able to reuse the existing fab files.
The current fabfile has a direct dependency on vagrant.
We need a way to specify the deployment target dynamically, be it a Vagrant box or a real server.

>fab vagrant_init
[localhost] local: vagrant up
Bringing machine 'default' up with 'virtualbox' provider...
==> default: Checking if box 'ubuntu/trusty64' version '20190429.0.1' is up to date...
==> default: Machine already provisioned. Run `vagrant provision` or use the `--provision`
==> default: flag to force provisioning. Provisioners marked to run always will still run.
[localhost] local: vagrant ssh-config
:2222] Executing task 'install_python_reqs'
:2222] sudo: apt-get update --fix-missing

Fatal error: Name lookup failed for 127.0.0.1

Underlying exception:
    getaddrinfo failed

Aborting.

I'm sure this has to do with configuration, but I'm not sure what to do. I'm using Windows 10, I'd appreciate some help! From what I can discern, the i issue is in fabfile.py, at the command sudo('apt-get update --fix-missing'). I'm not sure what it's doing, but if I open python and run

>>> from fabric.api import sudo
>>> sudo('apt-get update --fix-missing')

I get "No hosts found. Please specify (single) host string for connection:" When I enter 127.0.0.1:2222, which is what _get_vagrant_connection() pulls, it works and it then prompts me to enter the passphrase for the private key. So, the issue in that command is that it's not receiving the right argument. Not sure what to do about that.

So after installing crestify manually, when I start the server: honcho start, this happens:

{17:34}[2.3.1]~/crestify:master ✗ ➭ honcho start
17:34:28 system    | celery2.1 started (pid=20935)
17:34:28 system    | wsgi.1 started (pid=20936)
17:34:28 system    | celery.1 started (pid=20934)
17:34:28 wsgi.1    | [2017-04-17 17:34:28 +0900] [20936] [INFO] Starting gunicorn 19.1.1
17:34:28 wsgi.1    | [2017-04-17 17:34:28 +0900] [20936] [INFO] Listening at: http://0.0.0.0:8000 (20936)
17:34:28 wsgi.1    | [2017-04-17 17:34:28 +0900] [20936] [INFO] Using worker: sync
17:34:28 wsgi.1    | [2017-04-17 17:34:28 +0900] [20943] [INFO] Booting worker with pid: 20943
17:34:30 celery2.1 | [2017-04-17 17:34:30,739: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 61] Connection refused.
17:34:30 celery2.1 | Trying again in 2.00 seconds...
17:34:30 celery2.1 |
17:34:30 celery.1  | [2017-04-17 17:34:30,790: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 61] Connection refused.
17:34:30 celery.1  | Trying again in 2.00 seconds...
17:34:30 celery.1  |
17:34:32 celery2.1 | [2017-04-17 17:34:32,763: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 61] Connection refused.
17:34:32 celery2.1 | Trying again in 4.00 seconds...
17:34:32 celery2.1 |
17:34:32 celery.1  | [2017-04-17 17:34:32,812: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 61] Connection refused.
17:34:32 celery.1  | Trying again in 4.00 seconds...
17:34:32 celery.1  |
17:34:36 celery2.1 | [2017-04-17 17:34:36,783: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 61] Connection refused.
17:34:36 celery2.1 | Trying again in 6.00 seconds...
17:34:36 celery2.1 |
17:34:36 celery.1  | [2017-04-17 17:34:36,840: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 61] Connection refused.
17:34:36 celery.1  | Trying again in 6.00 seconds...
17:34:36 celery.1  |
17:34:42 celery2.1 | [2017-04-17 17:34:42,814: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 61] Connection refused.
17:34:42 celery2.1 | Trying again in 8.00 seconds...
17:34:42 celery2.1 |
17:34:42 celery.1  | [2017-04-17 17:34:42,872: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 61] Connection refused.
17:34:42 celery.1  | Trying again in 8.00 seconds...
17:34:42 celery.1  |
17:34:50 celery2.1 | [2017-04-17 17:34:50,851: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 61] Connection refused.
17:34:50 celery2.1 | Trying again in 10.00 seconds...
17:34:50 celery2.1 |
17:34:50 celery.1  | [2017-04-17 17:34:50,905: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 61] Connection refused.
17:34:50 celery.1  | Trying again in 10.00 seconds...
17:34:50 celery.1  |
17:35:00 celery2.1 | [2017-04-17 17:35:00,890: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 61] Connection refused.
17:35:00 celery2.1 | Trying again in 12.00 seconds...

Still I am able to open http://localhost:8000, the app seems to be running, but when I try to click on login or register a page simply refreshes. Also this behaviour occurs after installing the app with fabric and vagrant.

Thanks in advance.

According to repository this project is quite young, so why it’s not compatible with Python 3 since beginning?

Do you think you could maybe create a live demo in which I could click around? (It doesn't even need to allow me to add links.) I'd like to try it out, but haven't been able to get it running myself.

I am able to open http://localhost:8000, the app seems to be running, but when I try to click on login or register a page simply refreshes.

GIF with the issue, posted on imgur

Thanks in advance.

This is referencing #4.
See celery/kombu#543. Will need to see the changelog and verify there are no breaking changes before bumping up the version in the README.