How well the POI is working?

General Discussion
#1

I guess the devs could answer … or is it too early to answer? :slight_smile:



Moved from "Bonus!!!" thread.


…
There is light positive correlations between
harvested blocks and
                        paidFees          0.466
                        sentAmounts    0.405

But that is a wrong analysis :)              The correlation is positive though the fees and amounts are negative the more negative should cause the more harvested blocks. The keyword is the "cause": the more negative fees and amounts are causing the more harvested blocks afterwards, in this case it seems to be the next day. That the correlation function cannot calculate :)  … must make some editions…


Edit:

when making Day-1 adjustment the correlations are better in that sence that they are negative (which is correct):

harvested blocks and

                            paidFees          -0.218
                            sentAmounts    -0.011

The -0.011 is though desperatively weak correlation… might cause suspicions  ???


But when sentAmounts is adjusted with the importance, then the correlation is
                    adjusted sentAmounts    -0.305

That is quite good, I guess… it is better that it is not better  8) coz otherwise POI would be too simple…


Day      Harv'ed Blks    Importance    NumbOfTXs  PaidFees        SentAmounts
21 Oct            0              0.13 %                  5          -156  NEM        -255000 NEM
22 Oct          12              0.13 %                  0                0                            0
23                  3              0.08 %                  10          -685                -409000
24                  6              0.07                      48        -174                  -84000
25                  2              0.07                        1            -4                    -3333
26                  5              0.07                        5        -125                -555000
27                  1              0.06                        6        -768                -333000
                                                                                              and 
#2

When other nodes stop harvesting the rest become more important. So your importance can raise without doing anything. Also more and more NEM get vested over time which aids the POS factor.

#3

When other nodes stop harvesting the rest become more important. So your importance can raise without doing anything. Also more and more NEM get vested over time which aids the POS factor.


Is there numbers about harvesting nodes? NEM Network Crawler looks quite the same.
Wallet is also quite the same despite the active robots.
Anyway now there is something broken:
wallet does contain the 2.7 M but
there are no transactions listed and
"NEM Infrastructure Server is not available."  tho the upper line info says "NIS synchronizing... less than 1 day behind".
Also harvester's status is Unknown.


#4


When other nodes stop harvesting the rest become more important. So your importance can raise without doing anything. Also more and more NEM get vested over time which aids the POS factor.


Is there numbers about harvesting nodes? NEM Network Crawler looks quite the same.
Wallet is also quite the same despite the active robots.
Anyway now there is something broken:
wallet does contain the 2.7 M but
there are no transactions listed and
"NEM Infrastructure Server is not available."  tho the upper line info says "NIS synchronizing... less than 1 day behind".
Also harvester's status is Unknown.


Sounds like NIS died. Can you say what your OS/memory/cpu are? If linux/mac, if you run lsof -np process_id, what do you get?
#5

When other nodes stop harvesting the rest become more important. So your importance can raise without doing anything. Also more and more NEM get vested over time which aids the POS factor.


Yeah, but your score won't change if a node stops/starts harvesting, as we are not constantly pinging all the nodes on the network from everywhere :)
#6



When other nodes stop harvesting the rest become more important. So your importance can raise without doing anything. Also more and more NEM get vested over time which aids the POS factor.


Is there numbers about harvesting nodes? NEM Network Crawler looks quite the same.
Wallet is also quite the same despite the active robots.
Anyway now there is something broken:
wallet does contain the 2.7 M but
there are no transactions listed and
"NEM Infrastructure Server is not available."  tho the upper line info says "NIS synchronizing... less than 1 day behind".
Also harvester's status is Unknown.


Sounds like NIS died. Can you say what your OS/memory/cpu are? If linux/mac, if you run lsof -np process_id, what do you get?


It was Windows 7 (8 GB mem).
It "booted" NCC automatically itself: it closed NCC or at least the wallet, so I had to open the wallet again.
Then it still continued showing those errors about 10 - 15 min. After that it was ok and the block was at the same level as BlockChainExplorer had.

#7

The POI score also depends on the actions of others, since the importances for all accounts sum to 100%.

#8

The POI score also depends on the actions of others, since the importances for all accounts sum to 100%.


yes...
Are there amounts of harvesting nodes?
NEM Network Crawler looks quite the same as few days ago.. approx. 50..60 nodes...
Wallet is also quite the same despite the received NEMs from active robots.
#9

Its not just about the number of nodes. If the numbers stays the same but a node increased its importance, yours will decrease since in sum it is always 100 %.

#10

Its not just about the number of nodes. If the numbers stays the same but a node increased its importance, yours will decrease since in sum it is always 100 %.


yea ...
now the situation is that my node is not doing anything (i.e. not sending NEMs). Still its importance has grown and getting more harvested blocks than a week ago.
Ofc the POI may look for a longer time period, but ... still interesting :)
#11

As already said the coins need to be "vested" but I don't remember the details about this process. So this can cause some kind of latency.

And since there are some performance issues with the current 0.4.12-BETA it could be that some people stopped using it and are waiting for the next release. This will increase the importance of all nodes which are still running.

There might be more reasons for side effect like this.

#12

As already said the coins need to be "vested" but I don't remember the details about this process. So this can cause some kind of latency.

And since there are some performance issues with the current 0.4.12-BETA it could be that some people stopped using it and are waiting for the next release. This will increase the importance of all nodes which are still running.

There might be more reasons for side effect like this.


What does "vested" mean?

"Are there amounts of harvesting nodes?
NEM Network Crawler looks quite the same as few days ago.. approx. 50..60 nodes..."

#13

Coins are vested if they are in your account for a specific time (which I don't remember).

Where did you get the numer of 50-60 nodes?
From here? Did you count it? http://127.0.0.1:8989/ncc/web/sigma-graph/nemgraph.html
-> That are only the nodes you are directly connected to. There are more.

Even if the number of nodes was really constant in the last time, it could also be that people stopped doing test transactions (or did less). This also decreases their importance and will therefor increase others.

#14

Coins are vested if they are in your account for a specific time (which I don't remember).

Where did you get the numer of 50-60 nodes?
From here? Did you count it? http://127.0.0.1:8989/ncc/web/sigma-graph/nemgraph.html
-> That are only the nodes you are directly connected to. There are more.

Even if the number of nodes was really constant in the last time, it could also be that people stopped doing test transactions (or did less). This also decreases their importance and will therefor increase others.


yes... that was just as an estimate from nemgraph.html... thought it would get some correlation about the node amounts. But as I have written: that is the only "knowledge"  -    Anyway that has not been used in those "correlation calculations"; it would give some direction for the explanation.

The real amount of harvesting nodes would give better explanations about the importance. Or maybe the amount of the harvested blocks is the one, which will be the most interesting item of all the NEMsters, when the real harvesting will start :)
#15

@nxkoil Can you also add receivedAmts?


Also, other people losing importance can make you more important (all sums to 100%). I have lost 0.2% importance, so that has gone out to others.

#16

@nxkoil Can you also add receivedAmts?


Also, other people losing importance can make you more important (all sums to 100%). I have lost 0.2% importance, so that has gone out to others.


Can not ... until get the installation issue ("Re: NEM Beta 0.4.17") cleared  :)
#17


@nxkoil Can you also add receivedAmts?


Also, other people losing importance can make you more important (all sums to 100%). I have lost 0.2% importance, so that has gone out to others.


Can not ... until get the installation issue ("Re: NEM Beta 0.4.17") cleared  :)


... and also would pass the responsibility of statistics to the dev team, because they have much better resources to collect "all the data".
https://forum.ournem.com/index.php?topic=2624.msg8717#msg8717
I ... and everyone ... can though help to analyze the data (from one's own point of view :) ), coz I guess it could be public ... (or will the harvesting data be public only after the launch?)

#18

Yes, we are studying the performance of POI. We did extensive analysis on the NXT transaction graph already.


You have the NEM database in your nem folder, so you could just analysis on that database if you want. That is all the data on the blockchain right there.

#19

Yes, we are studying the performance of POI. We did extensive analysis on the NXT transaction graph already.


You have the NEM database in your nem folder, so you could just analysis on that database if you want. That is all the data on the blockchain right there.


Is the database this one  \nis\data\nis4.h2.db ?
Are there any scripts/tools available for changing the database format to something more readable, eg. a textfile ?    ... haven't yet studied NEM APIs :)
#20

Is the database this one  \nis\data\nis4.h2.db ?
Are there any scripts/tools available for changing the database format to something more readable, eg. a textfile ?    ... haven't yet studied NEM APIs :)

Do you mean in general? That would kill the performance and is therfore not possible.
If you just want to be able to read whats in the db, there are tools for that.