Message boards : Number crunching : Statistics export by project
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
[AF>Le_Pommier] Jerome_C2005

Send message
Joined: 12 Jul 11
Posts: 93
Credit: 1,129,876
RAC: 7
Message 28194 - Posted: 21 Dec 2016, 21:50:43 UTC
Last modified: 21 Dec 2016, 21:52:09 UTC

Hi

would it be possible to export your user data (for boinc statistics websites) by project, like WCG, primegrid, yoyo, CSG... and other multi-apps projects ?

So a (great) site like this one could display a credit breakdown for LHC too.

Would it ? Thanks ! :)
ID: 28194 · Report as offensive     Reply Quote
Harri Liljeroos
Avatar

Send message
Joined: 28 Sep 04
Posts: 674
Credit: 43,161,705
RAC: 16,020
Message 28201 - Posted: 22 Dec 2016, 6:29:27 UTC - in response to Message 28194.  

Stats are already downloaded by BoincStats. Here is your data there: http://boincstats.com/en/stats/-1/user/detail/14946/projectList
Or are you talking about something else?
ID: 28201 · Report as offensive     Reply Quote
Profile Ray Murray
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 281
Credit: 11,859,285
RAC: 1
Message 28202 - Posted: 22 Dec 2016, 8:41:00 UTC - in response to Message 28201.  

On the site Jerome links to, some project names have a drop-down arrow which gives a further sub-project credit breakdown.
I think that's his question but, sorry, I don't know if that's maybe something Laurence or Ivan would need to look into.
I'm sure I've seen that breakdown somewhere for -dev but don't know if they're available here.
ID: 28202 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 998
Credit: 6,264,307
RAC: 71
Message 28204 - Posted: 22 Dec 2016, 10:09:03 UTC - in response to Message 28202.  

That's one for Laurence or Nils, I think. I don't know about it myself.
ID: 28204 · Report as offensive     Reply Quote
Profile Ray Murray
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 281
Credit: 11,859,285
RAC: 1
Message 28206 - Posted: 22 Dec 2016, 10:52:49 UTC

Found the per-application stats for this site here, so that breakdown is available, and something from here might help with the export.
ID: 28206 · Report as offensive     Reply Quote
[AF>Le_Pommier] Jerome_C2005

Send message
Joined: 12 Jul 11
Posts: 93
Credit: 1,129,876
RAC: 7
Message 28245 - Posted: 25 Dec 2016, 23:08:39 UTC

Thanks for the information, I have passed them to Sebastien who is the creator of the stat site I mentioned, w&s.
ID: 28245 · Report as offensive     Reply Quote
[AF>Le_Pommier] Jerome_C2005

Send message
Joined: 12 Jul 11
Posts: 93
Credit: 1,129,876
RAC: 7
Message 28287 - Posted: 28 Dec 2016, 22:42:23 UTC

Update : Sebastien says "some progress, now there is a user_work.gz available that didn't exist before, but it is empty".
ID: 28287 · Report as offensive     Reply Quote
Profile Nils Høimyr
Volunteer moderator
Project administrator
Project developer
Project tester

Send message
Joined: 15 Jul 05
Posts: 242
Credit: 5,800,306
RAC: 0
Message 28359 - Posted: 6 Jan 2017, 13:28:00 UTC

It is important that the stats site use the new URL https://lhcathome.cern.ch/lhcathome/stats.php and not the old lhcathomeclassic.cern.ch URL that is not multi-app enabled.
ID: 28359 · Report as offensive     Reply Quote
[AF>Le_Pommier] Jerome_C2005

Send message
Joined: 12 Jul 11
Posts: 93
Credit: 1,129,876
RAC: 7
Message 28431 - Posted: 11 Jan 2017, 7:08:31 UTC

Je crois qu'il y a un malentendu. L'admin du projet fait référence à la page html. Cette page est difficilement exploitable.
Les autres projets utlisent un fichier d'export xml plus facilement exploitable. Le fichier existe mais il ne contient que l'identifiant des utilisateurs. Les totaux par applications n'y sont pas.


The html page cannot be used by stat sites and the xml file used for readable stat export is almost empty (only user IDs no data).
ID: 28431 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2071
Credit: 156,178,946
RAC: 105,697
Message 28993 - Posted: 1 Mar 2017, 6:58:10 UTC

http://www.teamocuk.co.uk/LHC.php

There you can see now the whole Statistic of LHCatHome and not only Sixtrack.

Only the name is showing Sixtrack.
ID: 28993 · Report as offensive     Reply Quote
Profile Bok

Send message
Joined: 2 Sep 04
Posts: 6
Credit: 543,835
RAC: 0
Message 28996 - Posted: 1 Mar 2017, 15:11:38 UTC

Any chance you can look at the user work file and why there is no data in it?

users>
<user>
<id>1</id>
</user>
<user>
<id>2</id>
</user>
<user>
<id>3</id>
</user>
<user>
<id>4</id>
</user>
<user>
<id>6</id>
</user>
<user>
<id>9</id>
</user>
<user>
<id>10</id>
</user>


It should look more like this - from NFS project

user>
<id>1</id>
<subproject name="14e">
<workunits>98687</workunits>
<credit>3552732</credit>
<expavg_credit>2776.0015478725</expavg_credit>
</subproject>
<subproject name="15e">
<workunits>61327</workunits>
<credit>2698388</credit>
<expavg_credit>4184.6129133044</expavg_credit>
</subproject>
<subproject name="16e">
<workunits>783723</workunits>
<credit>101883990</credit>
<expavg_credit>25193.565158016</expavg_credit>
</subproject>
</user>
ID: 28996 · Report as offensive     Reply Quote
Profile Bok

Send message
Joined: 2 Sep 04
Posts: 6
Credit: 543,835
RAC: 0
Message 29836 - Posted: 5 Apr 2017, 19:34:10 UTC

bump, been a month?
ID: 29836 · Report as offensive     Reply Quote
Dirk Broer

Send message
Joined: 20 Sep 05
Posts: 31
Credit: 1,212,091
RAC: 10
Message 30145 - Posted: 1 May 2017, 19:35:13 UTC - in response to Message 29836.  
Last modified: 1 May 2017, 19:35:28 UTC

bump, been a month?


Two months by now
ID: 30145 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2071
Credit: 156,178,946
RAC: 105,697
Message 30247 - Posted: 8 May 2017, 7:50:04 UTC

This statistic show the Processors used in LHCatHome:

https://lhcathome.cern.ch/lhcathome/cpu_list.php

is it possible to expand this statistic sorted with all headers and
not only about GFLOPS/core?
ID: 30247 · Report as offensive     Reply Quote
Dirk Broer

Send message
Joined: 20 Sep 05
Posts: 31
Credit: 1,212,091
RAC: 10
Message 30705 - Posted: 9 Jun 2017, 12:08:46 UTC - in response to Message 30145.  

bump, been a month?


Two months by now


Three months and counting
ID: 30705 · Report as offensive     Reply Quote
Profile Nils Høimyr
Volunteer moderator
Project administrator
Project developer
Project tester

Send message
Joined: 15 Jul 05
Posts: 242
Credit: 5,800,306
RAC: 0
Message 30708 - Posted: 9 Jun 2017, 12:49:13 UTC
Last modified: 9 Jun 2017, 12:50:16 UTC

Sorry, the statistics export works fine with the default mechanism. I.e. files: https://lhcathome.cern.ch/lhcathome/stats/user.gz host.gz etc are exported to the statistics sites like BOINCstats.

Our site also exports the app-specific credit in user_work.gz and team_work.gz as described on the page: https://boinc.berkeley.edu/trac/wiki/XmlStats

This is the default BOINC server behaviour, that should be exploitable by statistics sites.

Otherwise you can find application-specific statistics on the page:

https://lhcathome.cern.ch/lhcathome/stats.php

Could the issue on some statistics sites be due to the fact that we now use SSL?

It also might be that the other projects you refer to have customized server code, or are on their own branches of the server code with a different behaviour, but as far as we can see, the LHC@home statistics export works like it should.
ID: 30708 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2071
Credit: 156,178,946
RAC: 105,697
Message 30709 - Posted: 9 Jun 2017, 13:03:15 UTC

The -dev Server isn't updating in boincstats.com since a few days.

Thank you for help.
ID: 30709 · Report as offensive     Reply Quote
Dirk Broer

Send message
Joined: 20 Sep 05
Posts: 31
Credit: 1,212,091
RAC: 10
Message 30719 - Posted: 10 Jun 2017, 9:16:44 UTC - in response to Message 30708.  
Last modified: 10 Jun 2017, 9:21:27 UTC

Sorry, the statistics export works fine with the default mechanism. I.e. files: https://lhcathome.cern.ch/lhcathome/stats/user.gz host.gz etc are exported to the statistics sites like BOINCstats


Have you ever checked the content of those files? There's no data in them -as Bok already mentioned three months ago.
ID: 30719 · Report as offensive     Reply Quote
Profile Nils Høimyr
Volunteer moderator
Project administrator
Project developer
Project tester

Send message
Joined: 15 Jul 05
Posts: 242
Credit: 5,800,306
RAC: 0
Message 30722 - Posted: 10 Jun 2017, 13:22:36 UTC - in response to Message 30719.  
Last modified: 10 Jun 2017, 13:45:33 UTC

The user and host files are ok, user_work has only user ids now, that is correct. Looks like a bug in the BOINC server code that should generate the statistics file.

We will investigate and see if this can be fixed at a future release and upgrade. Meanwhile, please refer to the regular statistics as well as the page on our site.
ID: 30722 · Report as offensive     Reply Quote
Dirk Broer

Send message
Joined: 20 Sep 05
Posts: 31
Credit: 1,212,091
RAC: 10
Message 30724 - Posted: 10 Jun 2017, 14:42:32 UTC - in response to Message 30722.  
Last modified: 10 Jun 2017, 14:48:43 UTC

If you have solved this, can you add the credit score per application/subproject on the account page https://lhcathome.cern.ch/lhcathome/home.php too?
ID: 30724 · Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Statistics export by project


©2024 CERN