liuwenchao / ajax-seo Goto Github PK

View Code? Open in Web Editor NEW

19.0 4.0 5.0 7 KB

Use phantomjs to build a simple server to provide rendered html to crawlers, for ajax sites.

License: MIT License

JavaScript 100.00%

ajax-seo's Introduction

AJAX-SEO

A simple server to provide rendered html to crawlers, for ajax sites.

How to use

prepare the web app

make sure it's "AJAX crawlable.", which means it adopts hashbang url schema. Read the google doc again if you don't understand.

prepare the server side

Install PhantomJS, on Mac, you can: $ brew install phantomjs
```
$ sudo apt-get install phantomjs  
```
Start SEO Server
```
$ phantomjs seo.js
```

Setup nginx, add codes below into site configuration:

if ($args ~ _escaped_fragment_) {
  rewrite ^ /snapshot$uri;
}

location ~ ^/snapshot(.*) {
  rewrite ^/snapshot(.*)$ $1 break;
  proxy_pass http://localhost:8888;
  proxy_set_header Host $scheme://$host;
  proxy_connect_timeout 60s;
}

How to verify

$ curl http://yoursite.domain/page#!/id/12
$ ## verify it's fully rendered HTML

How to test your local app w/o nginx

$ ## if your app is running at http://localhost:3000
$ curl http://localhost:8888/page#!/id/12 --header Host:localhost:3000
$ ## verify it's fully rendered HTML

Notes

For index page of your site, you need to add this in HTML if you haven't:

<meta name="fragment" content="!" />

if you have trouble for https URLs, try this:

$ # phantomjs --ssl-protocol=any seo.js

see phantomjs options documentation

ajax-seo's People

Contributors

Stargazers

Watchers

Forkers

net900621 gabrieldelepine maufrco jon-s fairhopeweb

ajax-seo's Issues

Getting response: <html><head></head><body></body></html>

Hello, Your solution looks damn good to solve SEO problem. I am trying to implement it to serve the angular app but getting the following response

<html><head></head><body></body></html>

The seo.js file is placed along with the index.html. The following curl command is used to get the html content.

curl localhost:8888/?_escaped_fragment_=/index.html

I have edited the index.html file for the meta tag. Did everything as you explained but not getting the actual response.

Example does not work?

First up, thanks for this! It gives me a much better idea of the right way to use phantomjs

First issue I encountered is the example command $ curl http://localhost:8888/page#!/id/12 --header Host:localhost:3000 - the ! is interperted by bash as part of history - this is fixed by running $ curl http://localhost:8888/page#\!/id/12 --header Host:localhost:3000 - note \!

after that - it still seems not to work, but has given me enough pointers, I should be able to fix it up for my situation!

setTimeout 10000 ?

Hi @liuwenchao and thanks for your nice job,

I feel curious about the setTimeout 10000.

page.onInitialized = function() {
       page.evaluate(function() {
            setTimeout(function() {
                window.callPhantom();
            }, 10000);
        });
    };

is-it for testing purpose ?

Thanks

504 Gateway Time-out

I made everything from the readme file , but when i try to access www.mywebsite.com/?_escaped_fragment_= it take some time and then i get a 504 gateway time-out

liuwenchao / ajax-seo Goto Github PK

ajax-seo's Introduction

AJAX-SEO

How to use

How to verify

How to test your local app w/o nginx

Notes

ajax-seo's People

Contributors

Stargazers

Watchers

Forkers

ajax-seo's Issues

Getting response: <html><head></head><body></body></html>

Example does not work?

setTimeout 10000 ?

504 Gateway Time-out

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent