time slice

frequency

• 0256 2 min
• 56110 6 min
• 51yunli 2 min
• 8glw 6 min
• chinawutong 6 min
• fala56 6 min
• 56888 3 min

三星手机在电池待机状态时，计数器失灵，不能进行后台推送。

1.之前完成到在“找货”中添加小红点
2.添加了振动的效果

提供更新并回到最上

• problem 某网站大量更新数据，上一个爬虫为结束，下一个爬虫启动，后一个爬虫会重复爬前一个爬虫的数据
• solution 写入之前检测

可以通过拿到最新的
http://www.51yunli.com/truck/details4148395.html
来倒序枚举最后的id

Logging HOWTO!

数据量太大，需要压缩

The current version is only sort by _id, when a new web is crawling (cold start), we will get mass items in a period which will interference the query result.
To solve it, we should first sort by date (publish date) and then by datetime or _id (insert time).

Problem the site refresh when crawling the site, the crawler will miss some item.

Fixup use a window to check the duplicate item, the current version roughly only one item. I think if there exists a continuous sequence, we should stop, and the length of the sequence is 5 or ...

密码提问?

• http://www.chinawutong.com/203/a-1b-1k-1l-1m-1n-1j-1/p1 货源
• http://www.chinawutong.com/102.html?pid=4 车源

感觉车源还会变！

• LogisticsPlatform/Server/tornado/nginx_tornado.conf
• LogisticsPlatform/Server/tornado/supervisor_tornado.conf

是否可以更简洁一些

the current version simply plus 3 days on the publishing day

• 2 min
• 3 min
• 5 min
• 15 min
• 30 min
• 60 min

爬虫的时区问题，涉及以下3个字段

• date
• deadline
• datetime

1.退出按钮触发之后，不需再次登陆
2.tab排列的优化

1.服务重启后，ES无法正常启动

• 0256
• 51yunli
• chinawutong
• 56888

we only know the deadline

we need a logfile mentioned in #2

confusing