infer the format of the data from the binary

The link below is a binary dump of the communication content of an investment application.

What should I do if I want to parse meaningful data (such as the Nikkei average)?
This application shows real-time price fluctuations.

I think it was sent in some format (msgpack, jsonb, etc.), but I can't tell what format it is.

I can parse it if I know what format it is...

I also tried the file command, but it didn't work.

https://gist.github.com/anonymous/81b083fce661838032de25ca774178c7

additional:

This dump is the data when displaying Nikkei futures data.
The application allows you to obtain various types of data, including stock prices, futures, FX, and overseas market indicators.
However, when switching from stock prices to futures, it takes a reasonable amount of time, so maybe only the ones currently displayed are coming.

This value is not visible from the app, but
when expressed in ascii from 0000004F to 0000005F 20180307.210053, which seems to be the time this data was sent.

tcp binary

2022-09-30 21:30

2 Answers

I think there is too little sample data or clue information to guess.
"For investment" means stock price (domestic only or foreign only)?Index only or individual stocks? Exchange rate?Virtual currency?etc

Acquire data multiple times (after a while) and make a hit from "where there is a change" or "where there is no change."
Check the dump to see if the app shows the values that can be seen by legitimate means.

2022-09-30 21:30

Most of the text is separated by 0x11.It may be some kind of general format, but I can't see the key value, so I have no choice but to imagine for myself which part of the parser is what it is.

2022-09-30 21:30

If you have any answers or tips

Popular Tags

python x 4647

android x 1593

java x 1494

javascript x 1427

c x 927

c++ x 878

ruby-on-rails x 696

php x 692

python3 x 685

html x 656