SciLINC Update
SciLINC Update |
|
Message boards : Cafe : SciLINC Update
| Author | Message | |
|---|---|---|
Ron Parker  Forum moderator Project administrator Project developer  Joined: Mar 27, 2007 Posts: 14 ID: 1 Credit: 1,232 RAC: 13 | ||
When development of the SciLINC project began it had four primary goals. Edited for brevity, they were: 1. Increase public access to nationally significant scientific literature. Botanicus is doing a wonderful job of meeting goals 1 and 2 including processing data generated by SciLINC. The project has certainly also meet goal 4. We have learned much about grid-based, distributed, public-resource computing applications and the BOINC architecture. There are thoughts and plans for analyses down the road that will be much more computationally intensive than the original SciLINC analysis and we look forward in time to bringing these projects to you. While the amount of data that SciLINC has to analyze will increase greatly in the days ahead it does not appear that increasing the volume of information is going to improve the user experience of running the SciLINC client. It has been suggested that we repackage our data into single files instead of uploading and downloading 50 files per workunit as we currently do. This suggestion has been heeded and implemented. We had planned on doing it before SciLINC was rolled out but scheduling prevented it and the community discovered the project before we were ready to announce it. We expect that testing will show the repackaging lessens the load placed upon the core BOINC client software. But, it does not change the amount of data being transferred. The truth is that the workunits fly by so rapidly that implementing goal 3 never became realistic. When development of SciLINC began, the project lead's understanding was that from a technological and economic standpoint it makes sense to use public-resource computing in place of an internal grid computing architecture whenever less than a gigabyte of data is required per cpu-day of computation. Using the BOINC framework to transfer the data to clients, SciLINC meets this volume-of-computation guideline. However, our brief experience with the dedicated BOINC community over the last couple weeks has shown that, to the community these numbers may differ somewhat. In its original form SciLINC would have needed to transfer roughly 250MiB of compressed data in order to occupy a modern CPU for a day. This would expand to nearly 660MiB of input data. Then the client would need to upload about 44MiB of results which would compress to 17MiB. These numbers have only grown as SciLINC has been improved and made more efficient. This is not acceptable to the average BOINC user. Looking at the numbers from the perspective of someone on dial-up, if they set SciLINC to only 1% of their BOINC time, this would be roughly 15 minutes out of a day. For this 15 minutes they would have needed to download around 2.5MiB of data. This may not be a huge issue for broadband users, but if someone is on dial-up (as we have learned many BOINC fans still are) the transfer time would exceed the computation time. So, where are we now? Even if the transfer:credit ratios were acceptable to the community, we do not have enough data to realistically occupy hundred or thousands of BOINC enthusiasts for a lengthy period of time. As we have already seen on various community boards a relatively small amount of credit is earned for a comparatively large load on their system resources. Any computational and transport related improvements that have been tested have only resulted in more data needing to be transferred. As stated above, we are investigating the possibility of performing much more computationally intensive analyses in the months ahead. It is expected that these will be a much better fit for a BOINC project than the current task of text-indexing and taxonomic analysis which has a relatively low mathematical complexity. Because of this it has been decided that for now all SciLINC computation will be performed internally. When we have something with a better credit-reward ratio (and nicer screensaver) it will be made available to the community. Thank you again for your interest and support. We look forward to working with you in the future. The SciLINC Team | ||
ID: 42 | Rating: 0 | rate:  /  -  | [Reply to this post] | |
Hi, | ||
| ID: 43 | Rating: 0 | rate: / - | [Reply to this post] | |
My opinion is: | ||
| ID: 44 | Rating: 0 | rate: / - | [Reply to this post] | |
I totally agree, once you sort out the problem of uploads/downloads there is no reason to stop working with Boinc. | ||
| ID: 45 | Rating: 0 | rate: / - | [Reply to this post] | |
I agree with the comments so far. I also run 40+ BOINC projects, but when SciLINC started I gave it 80% of my resources (3 of my top CPU's). This is a very interesting project with a lot of potential, I would hate to see it disappear especially as you Ron have done a first class job so far. | ||
| ID: 46 | Rating: 0 | rate: / - | [Reply to this post] | |
One more post with the same message. | ||
| ID: 48 | Rating: 0 | rate: / - | [Reply to this post] | |
The only problem that I had with this project was that DOS'd each one of my hosts. If that problem has been fixed then let the wu's flow. | ||
| ID: 49 | Rating: 0 | rate: / - | [Reply to this post] | |
As stated above, we are investigating the possibility of performing much more computationally intensive analyses in the months ahead. It is expected that these will be a much better fit for a BOINC project than the current task of text-indexing and taxonomic analysis which has a relatively low mathematical complexity. | ||
| ID: 50 | Rating: 0 | rate: / - | [Reply to this post] | |
This is Chris Freeland, Project Manager for SciLINC, and I'm really encouraged by the "Save SciLINC" camapaign that's happening here and on other boards. Because of your feedback and suggestions we've found ways to keep SciLINC running and distributing work units to anyone who wants to help, so expect to see some work units by the weekend. | ||
| ID: 54 | Rating: 0 | rate: / - | [Reply to this post] | |
Because of your feedback and suggestions we've found ways to keep SciLINC running and distributing work units to anyone who wants to help, so expect to see some work units by the weekend. Look forward to testing out the new wu's. As Ron posted we want to keep doing more projects through BOINC and have begun some preliminary work on using BOINC for phylogenetic analysis. We'll be sure to keep you posted on progress. I'll leave this quote for one of the ATA regulars. Bring on the banana's ____________  | ||
| ID: 55 | Rating: 0 | rate: / - | [Reply to this post] | |
This is Chris Freeland, Project Manager for SciLINC, and I'm really encouraged by the "Save SciLINC" camapaign that's happening here and on other boards. Because of your feedback and suggestions we've found ways to keep SciLINC running and distributing work units to anyone who wants to help, so expect to see some work units by the weekend. Thats really great news! Cant wait to support your project more! Thanx! ____________  My NEW BOINC-Site Why people joined BOINC Synergy... | ||
| ID: 56 | Rating: 0 | rate: / - | [Reply to this post] | |
This is Chris Freeland, Project Manager for SciLINC, and I'm really encouraged by the "Save SciLINC" camapaign that's happening here and on other boards. Because of your feedback and suggestions we've found ways to keep SciLINC running and distributing work units to anyone who wants to help, so expect to see some work units by the weekend. Any news? ____________ Dublin, CA Team MacNN Avatar | ||
| ID: 60 | Rating: 0 | rate: / - | [Reply to this post] | |
This is Chris Freeland, Project Manager for SciLINC, and I'm really encouraged by the "Save SciLINC" camapaign that's happening here and on other boards. Because of your feedback and suggestions we've found ways to keep SciLINC running and distributing work units to anyone who wants to help, so expect to see some work units by the weekend. Same question here! Isnt it time for an update, please? ____________ My NEW BOINC-Site Why people joined BOINC Synergy... | ||
| ID: 67 | Rating: 0 | rate: / - | [Reply to this post] | |
Sorry folks, I wasn't receiving update messages for this thread. We'll be running again by the end of this week. | ||
| ID: 69 | Rating: 1 | rate: / - | [Reply to this post] | |
Sorry folks, I wasn't receiving update messages for this thread. We'll be running again by the end of this week. Hey, great news! Thanx! :) ____________ My NEW BOINC-Site Why people joined BOINC Synergy... | ||
| ID: 70 | Rating: 0 | rate: / - | [Reply to this post] | |
Sorry folks, I wasn't receiving update messages for this thread. We'll be running again by the end of this week. Any news? ____________ Dublin, CA Team MacNN Avatar | ||
| ID: 74 | Rating: 0 | rate: / - | [Reply to this post] | |
Message boards : Cafe : SciLINC Update
