broderickhyman / albiondata-client Goto Github PK

See Issue 94 in parent repo. We need to make sure that offline testing does not push to the main server as this would create bad data.

Hi, even after 3 restarts (including game and client) I'm still getting this error:
The player name or id has not been set. Please restart the game and make sure the client is running.

I'm using the data to identify best trades and also equilize prices among cities. Now I'm interested in identify best craft possibilities. Can u contact me plz?

When the sql project inserts/updates rows in the expired table it seems to always affect more rows than were just soft deleted. Need to look into this.

since Viper has been added to this project, we should also enable to set all other settings via Viper and not only via flag.
This should make the PR #4 obsolete

This one would be a bit tricky, but it would be nice to see how many people are using the tool and/or how much data individuals upload. Could be used later for bragging purposes, or a requirement check for api access that someone is uploading data (would probably be a pain to control).

Timestamp:
�[36mINFO�[0m[2018-01-09T00:31:38-05:00]

Hi,

Since the last albion upgrade, I'm getting bluescreen when using albion data client + the client don't get the orders when browsing the auction house. it was working perfectly for me before the last update.

Does anyone have the same problem ?

Thanks guys

Save off the photon packets into a file in the order they are received. Then have the ability to read them back in for testing during development.

Notes from Lun Jiang:
In the section "installing Dep"

1. It's probably better to clarify that this is the folder where the work folder is for the src code.
2. New users have to run dep init before dep ensure
3. It's dep version, not dep --version

In the section "MingGW-64"

1. The new entry should be: C:\Program Files\mingw-w64\x86_64-8.1.0-posix-seh-rt_v6-rev0\mingw64\bin with the newest version
   In the section "Build the Client", it should be
   go build albiondata-client.go

using go generate, its possible improve verbosity on DEBUG adding event or operation name:

overwrite line with
log.Debugf("EventDataType: [%v]%v - %v", params[252].(int16), EventType(params[252].(int16)), params)

the result:

I've been running the data client and scanning to update various 4.x resources. The console reports that it's uploading the market orders but Albion2d DB doesn't show the prices.

Example:
https://www.albiononline2d.com/en/item/id/T4_HIDE_LEVEL1

This is not an issue but a suggestion:

You can update all prices by iterating over the item names and pasting them into the search field of the market window in the native game client. This heavily brings down the median price age of the data set.

Many people have expressed concern with working with golang, and it is confirmed by StackOverflow that it is a lower percentage of the developer population that know how to code it.
Also, making it .Net would allow us to decompile pieces of the game client and copy into the project as we need, increasing productivity.

As of today there are 3 new auction houses in the Blackzone.
Can they be added?

So I checked out the project and I wanted to ask if there is something I could find online related to this. I didn't know where to ask since nobody is into albion online stuff and I just start to search stuff.
I was wondering if there is somewhere info list of all players online in the albion world with probably their guild name info too. Like Having two columns with character name and his guild name or maybe even more stuff.

Is this even possible? Since I have understanded that the game doesn't share much information.

Every city expect for Caerleon in API has as name: "Unknown"

Example:
https://www.albion-online-data.com/api/v1/stats/prices/T3_FURNITUREITEM_TROPHY_GENERAL

Add to ao-id-extractor the ability to export all item values

Why market prices don't update?

I remember old versions that showed a message when open any market, i think may be related

This issue was talked about in discord and I figured I'd add it to the list of issues in case someone wanted to tackle it. The problem is that the program can't tell the difference when a player loads their marketplace and has their price sorting from High to Low. If a player has their sorting from High to Low when updating the database it will take the highest price on that page and think it's actually the sell_price_min. Making the database wrong and relaying the Highest price as the Lowest price.

For instance the current Price as I write this for itemID="T1_FACTION_FOREST_TOKEN_1" with location "Caerleon" returns with sell_price_min="52999999" while in game the actual sell_price_min should = 74995. When you set the marketplace to sort high to low you see it's picking up that first number as the low price.

Either some sort of filter needs to be added to filter those out, or some sort of check to make sure the number doesn't end up being more than 2x the price or there abouts.

I would like to know how u get the operation lists

Log requests in order to see what kind of usage the tool is getting. Would like to use ip address for tracking purposes but GDPR has some issues with that.

I can not connect to the API.

504 Gateway Time-out

any interest in working on a front-end client? I'm a react dev, and I started building a mirror API of AO REST Endpoints using GraphQL and then searched GitHub and found your project.

https://graphqlbin.com/v2/9Q04SR

hello, can i know how to create the nats server for sending albion data locally? i have install nats server and edit the albiondata client to send data to my nats server but when i dump to sql i dont see anything. thank you.

Is it possible?
Any hints on how I should go about it?

The albion client is in a position to know that a player experienced a "notable" event..

Player died, got a player kill, got a very valuable loot item, etc....

It would be awesome to be able to use these events to automatically trigger NVidia shadowplay and/or OBS to save their instant replay buffer.

While this may seem outside the core goal of data collection.. this would be a really awesome feature that would drive many users to want the client.. which would in turn mean more users are collecting and uploading data.

While attempting to pull prices, I found that I could not get results for T5 Relics, T7 Souls, T8 Relics, and T8 Souls no matter how many times I browse the market for those specific items with the client running. A few other items also appear to not be working, I will attempt to compile a list if necessary.

Example API request: https://www.albion-online-data.com/api/v1/stats/prices/T8_RELIC?locations=Caerleon%20Market

Returns: []

After installing and running Albion Data Client my friend have this error in console:

ERRO[2019-07-30T16:37:07+02:00] Error while sending ingest to nats with data: nats: invalid connection

Any ideas how this may be fixed?
Thanks.

I had to change the property name several times e.g.
[JsonProperty (PropertyName = "buy_price_max_date")]
[JsonProperty (PropertyName = "buyPriceMaxDate")]
Is buy_price_max_date correct now?

Ever since the Queen Patch 11 hit 05.05.20 the client does not identify the zone anymore making it unable to update market data.

Console output when trying to update market data:

INFO[2020-05-05T15:09:10+02:00] Starting Albion Data Client, version: 0.0.27
INFO[2020-05-05T15:09:10+02:00] This is a third-party application and is in no way affiliated with Sandbox Interactive or Albion Online.
INFO[2020-05-05T15:09:10+02:00] Additional parameters can listed by calling this file with the -h parameter.
INFO[2020-05-05T15:12:50+02:00] Watching Albion process with PID "14972"...
ERRO[2020-05-05T15:22:10+02:00] The players location has not yet been set. Please transition zones so the location can be identified.
ERRO[2020-05-05T15:24:51+02:00] The players location has not yet been set. Please transition zones so the location can be identified.
ERRO[2020-05-05T15:24:57+02:00] The players location has not yet been set. Please transition zones so the location can be identified.

MarketStatChartResponsev2 is not pulling the overloaded Data property, it is using the base property from MarketStatChartResponse

Talk to me for details

The game now has historical charts and data that we should pull and store, potentially instead of the process that is used now that looks at the uploaded data.

INFO[2019-10-07T15:54:55-07:00] Starting Albion Data Client, version: 0.0.22
INFO[2019-10-07T15:54:55-07:00] This is a thERROR systray: systray_windows.go:598 Unable to init instance: Unspecified error [error=Unable to init instance: %v error_location=github.com/broderickhyman/albiondata-client/vendor/github.com/getlantern/systray.nativeLoop (systray_windows.go:598) error_op= error_text=Unable to init instance: Unspecified error error_type=errors.Error]
ERROR systray: systray_windows.go:598 at github.com/broderickhyman/albiondata-client/vendor/github.com/getlantern/systray.nativeLoop (systray_windows.go:598)
ERROR systray: systray_windows.go:598 at github.com/broderickhyman/albiondata-client/vendor/github.com/getlantern/systray.Run (systray.go:81)
ERROR systray: systray_windows.go:598 at github.com/broderickhyman/albiondata-client/systray.Run (systray_win.go:51)
ERROR systray: systray_windows.go:598 at runtime.goexit (asm_amd64.s:2337)
ERROR systray: systray_windows.go:598 Caused by: Unspecified error
ird-party application and is in no way affiliated with Sandbox Interactive or Albion Online.
INFO[2019-10-07T15:54:55-07:00] Additional parameters can listed by calling this file with the -h parameter.

The new Blackzone auction house names are currently codes e.g. 3004, can that be adjusted?

In api/v2/stats/history result

Here a example: https://www.albion-online-data.com/api/v2/stats/history/T4_LEATHER?locations=3004&date=2-10-20&qualities=1&time-scale=24

I wrote a program that consumes the api, and noticed the quality field is always set to 0. When I check ingame, the quality of an item isn't being taken into account and a masterpiece item is shown as the same kind of item as a normal one(as shown by the max and min price of any individual item).

Hi! I've been trying to setup the albion api locally, to be able to make some changes to it, but I'm failing when setting up the deduper.

After setting up the client and having it running, when I try to execute the deduper it's not able to connect to the client.

Note that I'm a bit newbie to golang, so I may be missing something, that's why I'm asking for a better documentation on how to get everything running.

Thanks in advance, and thanks for maintain this project and sharing it to us :)

PS. I'm interested in creating some market charts, and for that I'll need information that I don't see listed anywhere, like lists of markets and products (I've seen in the api some view and stats methods, but nothing about listing contents).

Hey there!

It seems from /scripts that you are producing builds for Windows, Mac, and Linux, but I'm unable to figure out how to use any of the resources provided in the releases.

Could you provide some instructions for me please? I would be open to instructions on how to set up the Go project and build it myself as well if that's easier.

update-darwin-amd64.gz contains only a single file when unzipped with no file extension. Changing the extension to either .pkg or .app both do not work in attempting to get Mac to recognize what to do with the file. I played with those in case this file was meant to be the Mac installer.

Checked the example URL: https://www.albion-online-data.com/api/v2/stats/view/T4_BAG,T5_BAG?locations=Caerleon,Bridgewatch&qualities=2

Expecting buy data, but it's blank.

Currently everyone's window minimizes, many people don't realize it is happening. I believe it was created this way to help people always have it running but it is confusing people. Maybe make it a config setting or something.

This may not be necessary depending on what we get from Albion’s historical graphs

Batch inserts for every x number or every 30 seconds, whichever is sooner to help with mysql performance and locking issues

No logs available unfortunately.
Platform: Windows 10.

Just that, I start it, and it stays running for a while until it decides to close itself or it just closes after a few seconds, no error messages or anything, does it save a log anywhere to check?

EDIT: I've done some digging and I've found the -debug argument, and also ran it from a terminal and I got this:
Error opening adapter: The system cannot find the device specified. (20)
and I've seen that it dies when it tries to read from one of the network adapters that Docker installs, to be precise the one named "vEthernet (Default Switch)", I don't know if this identifier will help or it's a random generated one on each PC, but the device identifier that crashes it is
\Device\NPF_{4B78D377-81BB-4E0E-A302-D6362F3F1487}