blacksmith-capital / oliya Goto Github PK
View Code? Open in Web Editor NEWFinancial data collection and API server - Backend for Likhtar
Home Page: https://blacksmith-capital.github.io/likhtar/
oliya's People
Stargazers
Watchers
oliya's Issues
Difficulties switching to tectonic DB
Hi; swapping out backends to tectonic DB causes strange issues with the reader timing out when it makes larger queries (a few hours of data). I think there is a corner case that isnt tested for this, since retrieve test seems to only retrieve 2 entries, which will avoid this issue. the most troubling thing is that starting an interactive shell with ex_tectonicdb and querying for the same range will actually return a result quickly (much quicker than the default 5 second timeout). Digging even further into whats happening with the erlang observer, I can see that the data associated with the query is being returned in its entirety.
08:41:46:274745 (<11775.465.0>) << {'$gen_call',{<11775.657.0>,
#Ref<11775.2723601667.508035073.86449>},
{message,<<"USE bitmex_xbtusd">>}}
08:41:46:274758 (<11775.465.0>) << {inet_reply,#Port<11775.11>,ok}
08:41:46:275748 (<11775.465.0>) << {tcp,#Port<11775.11>,
[1,0,0,0,0,0,0,0,38,83,87,73,84,67,72,69,68,32,84,79,32,
111,114,100,101,114,98,111,111,107,32,96,98,105,116,109,
101,120,95,120,98,116,117,115,100,96,46]}
08:41:46:275770 (<11775.465.0>) <11775.657.0> ! {#Ref<11775.2723601667.508035073.86449>,
{ok,
<<"SWITCHED TO orderbook `bitmex_xbtusd`.">>}}
08:41:46:275796 (<11775.465.0>) << {'$gen_call',
{<11775.657.0>,#Ref<11775.2723601667.508035073.86450>},
{message,
<<"GET ALL FROM 1610185241217 TO 1610271641217 AS CSV">>}}
08:41:46:275838 (<11775.465.0>) << {inet_reply,#Port<11775.11>,ok}
08:41:48:531400 (<11775.465.0>) << {tcp,#Port<11775.11>,
[1,0,0,0,0,3,116,162,76,49,54,49,48,50,49,54,52,50,52,53,
48,49,46,57,56,50,44,48,44,102,44,116,44,52,48,55,54,55,
46,53,44,56,49,53,48,48,10,49,54,49,48,50,49,54,52,50,52,
53,48,49,46,57,56,50,44,49,44,102,44,116,44,52,48,55,54,
56,46,53,44,49,53,48,48,48,48,10,49,54,49,48,50,49,54,52,
50,52,53,48,49,46,57,56,50,44,50,44,102,44,116,44,52,48,
55,55,48,46,53,44,51,55,57,56,57,48,10,49,54,49,48,50,49,
54,52,50,52,53,48,49,46,57,56,50,44,51,44,102,44,116,44,
52,48,55,55,49,44,51,48,50,57,56,55,10,49,54,49,48,50,49,
54,52,50,52,53,48,49,46,57,56,50,44,52,44,102,44,116,44,
52,48,55,55,50,46,53,44,49,48,48,48,48,10,49,54,49,48,50,
49,54,52,50,52,53,48,49,46,57,56,50,44,53,44,102,44,116,
44,52,48,55,55,51,44,49,48,55,49,53,10,49,54,49,48,50,49,
54,52,50,52,53,48,49,46,57,56,50,44,54,44,102,44,116,44,
52,48,55,55,52,44,54,48,48,48,10,49,54,49,48,50,49,54,52,
50,52,53,48,49,46,57,56,50,44,55,44,102,44,116,44,52,48,
55,55,52,46,53,44,53,56,55,48,48,10,49,54,49,48,50,49,54,
52,50,52,53,48,49,46,57,56,50,44,56,44,102,44,116,44,52,
48,55,55,53,44,52,50,57,10,49,54,49,48,50,49,54,52,50,52,
53,48,49,46,57,56,50,44,57,44,102,44,116,44,52,48,55,55,
53,46,53,44,49,48,50,56,48,48,10,49,54,49,48,50,49,54,52,
50,52,53,48,49,46,57,56,50,44,49,48,44,102,44,116,44,52,
48,55,55,54,44,49,51,50,49,48,48,10,49,54,49,48,50,49,54,
52,50,52,53,48,49,46,57,56,50,44,49,49,44,102,44,116,44,
52,48,55,55,54,46,53,44,50,48,49,49,51,10,49,54,49,48,50,
49,54,52,50,52,53,48,49,46,57,56,50,44,49,50,44,102,44,
116,44,52,48,55,55,56,46,53,44,49,54,53,56,56,10,49,54,
49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,49,51,44,
102,44,116,44,52,48,55,56,48,44,53,49,57,54,10,49,54,49,
48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,49,52,44,
102,44,116,44,52,48,55,56,49,44,55,53,48,48,48,10,49,54,
49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,49,53,44,
102,44,116,44,52,48,55,56,49,46,53,44,55,53,48,48,48,10,
49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,49,
54,44,102,44,116,44,52,48,55,56,50,44,49,55,52,10,49,54,
49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,49,55,44,
102,44,116,44,52,48,55,56,51,46,53,44,50,48,48,48,48,10,
49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,49,
56,44,102,44,116,44,52,48,55,56,52,44,49,57,57,49,55,10,
49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,49,
57,44,102,44,116,44,52,48,55,56,53,46,53,44,49,48,10,49,
54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,50,48,
44,102,44,116,44,52,48,55,56,56,44,50,50,53,48,48,48,10,
49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,50,
49,44,102,44,116,44,52,48,55,56,57,44,55,53,51,54,49,10,
49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,50,
50,44,102,44,116,44,52,48,55,57,48,44,49,56,53,50,53,56,
10,49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,
50,51,44,102,44,116,44,52,48,55,57,51,44,49,48,48,10,49,
54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,50,52,
44,102,44,116,44,52,48,55,57,52,46,53,44,49,55,51,48,53,
54,10,49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,
44,50,53,44,102,44,102,44,52,48,55,57,53,44,52,57,49,48,
56,53,10,49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,
50,44,50,54,44,102,44,102,44,52,48,55,57,53,46,53,44,55,
54,51,10,49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,
50,44,50,55,44,102,44,102,44,52,48,55,57,54,44,51,54,49,
10,49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,
50,56,44,102,44,102,44,52,48,55,57,55,44,54,56,48,48,10,
49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,50,
57,44,102,44,102,44,52,48,55,57,56,44,49,48,48,48,10,49,
54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,51,48,
44,102,44,102,44,52,48,56,48,48,44,51,56,50,52,55,51,10,
49,54,49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,51,
49,44,102,44,102,44,52,48,56,48,48,46,53,44,53,10,49,54,
49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,51,50,44,
102,44,102,44,52,48,56,48,49,44,56,49,55,49,52,10,49,54,
49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,51,51,44,
102,44,102,44,52,48,56,48,50,44,56,49,54,49,48,10,49,54,
49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,51,52,44,
102,44,102,44,52,48,56,48,50,46,53,44,52,48,52,10,49,54,
49,48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,51,53,44,
102,44,102,44,52,48,56,48,52,44,56,10,49,54,49,48,50,49,
54,52,50,52,53,48,49,46,57,56,50,44,51,54,44,102,44,102,
44,52,48,56,48,52,46,53,44,56,48,50,49,56,10,49,54,49,48,
50,49,54,52,50,52,53,48,49,46,57,56,50,44,51,55,44,102,
44,102,44,52,48,56,48,53,44,50,48,52,52,57,10,49,54,49,
48,50,49,54,52,50,52,53,48,49,46,57,56,50,44,51,56,44,
102,44,102,44,52,48,56,48,55,44,50,48,55,50,57,10,49,54,
49]}
08:41:48:531471 (<11775.465.0>) << {tcp,#Port<11775.11>,
"0216424501.982,39,f,f,40808,8000\n1610216424501.982,40,f,f,40808.5,76073\n1610216424501.982,41,f,f,40809.5,2984\n1610216424501.982,42,f,f,40810,2914\n1610216424501.982,43,f,f,40810.5,10000\n1610216424501.982,44,f,f,40811.5,109414\n1610216424501.982,45,f,f,40812,180113\n1610216424501.982,46,f,f,40812.5,30365\n1610216424501.982,47,f,f,40814.5,61060\n1610216424501.982,48,f,f,40815,16\n1610216424501.982,49,f,f,40816,1000\n1610216424523.575,0,f,f,40795,490562\n1610216424715.827,0,f,f,40795,492562\n1610216425022.127,0,f,f,40795,502062\n1610216425022.127,1,f,t,40790,184258\n1610216425517.885,0,f,f,40816,0\n1610216425517.885,1,f,t,40776,0\n1610216425520.523,0,f,f,40809,1\n1610216425520.523,1,f,t,40773.5,1\n1610216425617.326,0,f,f,40815,0\n1610216425617.326,1,f,t,40775.5,0\n1610216425619.302,0,f,f,40795,504002\n1610216425619.302,1,f,t,40794.5,147401\n1610216425622.611,0,f,f,40806,1940\n1610216425622.611,1,f,t,40767,81500\n1610216425715.98,0,f,t,40790,0\n1610216425715.98,1,f,t,40780,0\n1610216425715.98,2,f,t,40770.5,0\n1610216425717.992,0,f,f,40795,508002\n1610216425717.992,1,f,t,40794.5,127401\n1610216425721.149,0,f,t,40765,81500\n1610216425721.149,1,f,t,40764.5,163000\n1610216425721.149,2,f,t,40764,1200\n1610216425816.528,0,f,t,40788,0\n1610216425816.528,1,f,t,40782,0\n1610216425816.528,2,f,t,40781.5,0\n1610216425816.528,3,f,t,40781,0\n1610216425820.926,0,f,f,40797,1800\n1610216425820.926,1,f,f,40795.5,5763\n1610216425820.926,2,f,f,40795,609978\n1610216425820.926,3,f,t,40794.5,43576\n"}
08:41:48:531637 (<11775.465.0>) << {tcp,#Port<11775.11>,
"1610216425820.926,4,f,t,40789,361\n1610216425820.926,5,f,t,40765,110035\n1610216425824.157,0,f,t,40763.5,1200\n1610216425824.157,1,f,t,40763,1200\n1610216425824.157,2,f,t,40762.5,2989\n1610216425824.157,3,f,t,40761.5,81500\n1610216425919.794,0,f,f,40795,609898\n1610216425919.794,1,f,t,40778.5,28646\n1610216426019.628,0,f,f,40795,613424\n1610216426019.628,1,f,t,40775,731\n1610216426417.344,0,f,t,40761.5,0\n1610216426421.962,0,f,t,40774,5000\n1610216426427.193,0,f,t,40766.5,1000\n1610216427111,0,t,f,40794.5,2039\n1610216427111,0,t,f,40794.5,82\n1610216427111,0,t,f,40794.5,1711\n1610216427111,0,t,f,40793,100\n1610216427116,0,t,t,40795,10\n1610216426517.019,0,f,t,40794.5,0\n1610216426517.019,1,f,t,40793,0\n1610216426517.019,2,f,t,40784,0\n1610216426519.775,0,f,f,40808.5,241773\n1610216426519.775,1,f,f,40807,180129\n1610216426519.775,2,f,f,40795,799376\n1610216426527.3,0,f,t,40779,214884\n1610216426527.3,1,f,t,40761.5,81500\n1610216426527.3,2,f,t,40760.5,22972\n1610216427122,0,t,t,40794,11\n1610216427135,0,t,t,40794,12\n1610216427138,0,t,f,40789,361\n1610216427148,0,t,t,40789.5,11\n1610216427154,0,t,t,40789.5,500\n1610216427193,0,t,f,40789,1000\n1610216427193,0,t,f,40785.5,10\n1610216427193,0,t,f,40783.5,8990\n1610216426616.536,0,f,f,40814.5,0\n1610216426616.536,1,f,f,40812.5,0\n1610216426616.536,2,f,f,40812,0\n1610216426616.536,3,f,f,40811.5,0\n1610216426616.536,4,f,f,40810.5,0\n1610216426616.536,5,f,f,40810,0\n1610216426616.536,6,f,f,40809.5,0\n1610216426616.536,7,f,t,40789,0\n1610"}
....
08:41:48:539740 (<11775.465.0>) << {tcp,#Port<11775.11>,
",f,t,40775.5,188358\n1610216477924.731,3,f,t,40774.5,8000\n1610216477924.731,4,f,t,40766,90235\n1610216477927.247,0,f,f,40797,1400\n1610216477927.247,1,f,f,40790,15815\n1610216478018.125,0,f,f,40776,661304\n1610216478018.125,1,f,t,40775.5,160493\n1610216478115.347,0,f,t,40760.5,0\n1610216478115.347,1,f,t,40760,0\n1610216478115.347,2,f,t,40759.5,0\n1610216478121.49,0,f,f,40787.5,228287\n1610216478121.49,1,f,f,40776,864964\n1610216478121.49,2,f,t,40775.5,5493\n1610216478127.561,0,f,t,40774,30000\n1610216478127.561,1,f,t,40746,10000\n1610216478127.561,2,f,t,40"}
could you please release or double check whether the tectonicDB backend implementation? any advice would be helpful
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.