SciLINC Update |
![]() |
Message boards : Cafe : SciLINC Update
Author | Message | |
---|---|---|
When development of the SciLINC project began it had four primary goals. Edited for brevity, they were: 1. Increase public access to nationally significant scientific literature. Botanicus is doing a wonderful job of meeting goals 1 and 2 including processing data generated by SciLINC. The project has certainly also meet goal 4. We have learned much about grid-based, distributed, public-resource computing applications and the BOINC architecture. There are thoughts and plans for analyses down the road that will be much more computationally intensive than the original SciLINC analysis and we look forward in time to bringing these projects to you. While the amount of data that SciLINC has to analyze will increase greatly in the days ahead it does not appear that increasing the volume of information is going to improve the user experience of running the SciLINC client. It has been suggested that we repackage our data into single files instead of uploading and downloading 50 files per workunit as we currently do. This suggestion has been heeded and implemented. We had planned on doing it before SciLINC was rolled out but scheduling prevented it and the community discovered the project before we were ready to announce it. We expect that testing will show the repackaging lessens the load placed upon the core BOINC client software. But, it does not change the amount of data being transferred. The truth is that the workunits fly by so rapidly that implementing goal 3 never became realistic. When development of SciLINC began, the project lead's understanding was that from a technological and economic standpoint it makes sense to use public-resource computing in place of an internal grid computing architecture whenever less than a gigabyte of data is required per cpu-day of computation. Using the BOINC framework to transfer the data to clients, SciLINC meets this volume-of-computation guideline. However, our brief experience with the dedicated BOINC community over the last couple weeks has shown that, to the community these numbers may differ somewhat. In its original form SciLINC would have needed to transfer roughly 250MiB of compressed data in order to occupy a modern CPU for a day. This would expand to nearly 660MiB of input data. Then the client would need to upload about 44MiB of results which would compress to 17MiB. These numbers have only grown as SciLINC has been improved and made more efficient. This is not acceptable to the average BOINC user. Looking at the numbers from the perspective of someone on dial-up, if they set SciLINC to only 1% of their BOINC time, this would be roughly 15 minutes out of a day. For this 15 minutes they would have needed to download around 2.5MiB of data. This may not be a huge issue for broadband users, but if someone is on dial-up (as we have learned many BOINC fans still are) the transfer time would exceed the computation time. So, where are we now? Even if the transfer:credit ratios were acceptable to the community, we do not have enough data to realistically occupy hundred or thousands of BOINC enthusiasts for a lengthy period of time. As we have already seen on various community boards a relatively small amount of credit is earned for a comparatively large load on their system resources. Any computational and transport related improvements that have been tested have only resulted in more data needing to be transferred. As stated above, we are investigating the possibility of performing much more computationally intensive analyses in the months ahead. It is expected that these will be a much better fit for a BOINC project than the current task of text-indexing and taxonomic analysis which has a relatively low mathematical complexity. Because of this it has been decided that for now all SciLINC computation will be performed internally. When we have something with a better credit-reward ratio (and nicer screensaver) it will be made available to the community. Thank you again for your interest and support. We look forward to working with you in the future. The SciLINC Team | ||
ID: 42 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Hi, | ||
ID: 43 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
My opinion is: | ||
ID: 44 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
I totally agree, once you sort out the problem of uploads/downloads there is no reason to stop working with Boinc. | ||
ID: 45 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
I agree with the comments so far. I also run 40+ BOINC projects, but when SciLINC started I gave it 80% of my resources (3 of my top CPU's). This is a very interesting project with a lot of potential, I would hate to see it disappear especially as you Ron have done a first class job so far. | ||
ID: 46 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
One more post with the same message. | ||
ID: 48 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
The only problem that I had with this project was that DOS'd each one of my hosts. If that problem has been fixed then let the wu's flow. | ||
ID: 49 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
As stated above, we are investigating the possibility of performing much more computationally intensive analyses in the months ahead. It is expected that these will be a much better fit for a BOINC project than the current task of text-indexing and taxonomic analysis which has a relatively low mathematical complexity. | ||
ID: 50 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
This is Chris Freeland, Project Manager for SciLINC, and I'm really encouraged by the "Save SciLINC" camapaign that's happening here and on other boards. Because of your feedback and suggestions we've found ways to keep SciLINC running and distributing work units to anyone who wants to help, so expect to see some work units by the weekend. | ||
ID: 54 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Because of your feedback and suggestions we've found ways to keep SciLINC running and distributing work units to anyone who wants to help, so expect to see some work units by the weekend. Look forward to testing out the new wu's. As Ron posted we want to keep doing more projects through BOINC and have begun some preliminary work on using BOINC for phylogenetic analysis. We'll be sure to keep you posted on progress. I'll leave this quote for one of the ATA regulars. Bring on the banana's ____________ ![]() | ||
ID: 55 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
This is Chris Freeland, Project Manager for SciLINC, and I'm really encouraged by the "Save SciLINC" camapaign that's happening here and on other boards. Because of your feedback and suggestions we've found ways to keep SciLINC running and distributing work units to anyone who wants to help, so expect to see some work units by the weekend. Thats really great news! Cant wait to support your project more! Thanx! ____________ ![]() My NEW BOINC-Site Why people joined BOINC Synergy... | ||
ID: 56 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
This is Chris Freeland, Project Manager for SciLINC, and I'm really encouraged by the "Save SciLINC" camapaign that's happening here and on other boards. Because of your feedback and suggestions we've found ways to keep SciLINC running and distributing work units to anyone who wants to help, so expect to see some work units by the weekend. Any news? ____________ Dublin, CA SETI.USA Stats My stuff BOINC IRC chat | ||
ID: 60 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
This is Chris Freeland, Project Manager for SciLINC, and I'm really encouraged by the "Save SciLINC" camapaign that's happening here and on other boards. Because of your feedback and suggestions we've found ways to keep SciLINC running and distributing work units to anyone who wants to help, so expect to see some work units by the weekend. Same question here! Isnt it time for an update, please? ____________ ![]() My NEW BOINC-Site Why people joined BOINC Synergy... | ||
ID: 67 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Sorry folks, I wasn't receiving update messages for this thread. We'll be running again by the end of this week. | ||
ID: 69 | Rating: 1 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Sorry folks, I wasn't receiving update messages for this thread. We'll be running again by the end of this week. Hey, great news! Thanx! :) ____________ ![]() My NEW BOINC-Site Why people joined BOINC Synergy... | ||
ID: 70 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Sorry folks, I wasn't receiving update messages for this thread. We'll be running again by the end of this week. Any news? ____________ Dublin, CA SETI.USA Stats My stuff BOINC IRC chat | ||
ID: 74 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Sorry folks, I wasn't receiving update messages for this thread. We'll be running again by the end of this week. This week or the next week? | ||
ID: 75 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
This one or next. Just have to wait ^^ | ||
ID: 76 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Seems we're running into issues getting work queued. We've resolved all the other issues, just this one hanging us up. We'll post here and send out an announcement when we're ready for you to resume running SciLINC. Thanks for your continued interest. | ||
ID: 77 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
sooooo, I guess this project is dead? the issues won? Or are there still gonna be wu's by the weekend? :o) | ||
ID: 83 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Knok knok. | ||
ID: 84 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Who's there? Despite what you might think, we are. Long story short, the project is not dead, but may change framework to successfully deliver our intended outcomes. As previously mentioned, this summer we ran internal testing and came up with some fundamental bugs with our taxonomic name matching algorithms. As we worked through those problems, we then had hardware malfunctions. Then, our main developer moved on to another gig. You know, typical problems faced by every development team. | ||
ID: 88 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
| ||
ID: 89 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
My previous comments still stand. If you can deliver wu's that won't kill my machines then go for it. ____________ Free Tibet/ Tibet Libre Team Forum ![]() ![]() | ||
ID: 90 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
I still have a host polling this project. I do hope it isn't DOS'ed if this project comes back to life. | ||
ID: 91 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
SciLINC could continue as a BOINC Project. | ||
ID: 92 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
I to hope that you can continue with the BOINC development. The latest client build (5.10.20) has done some work in reducing the impact on the host with several small files wating to u/l or d/l. There will also probably be further development in this area in the new 6.1.x versions. If you have any suggestions on changes to the server side code, now would be a great time to work with the devopers of BOINC, for they are in the process if changing a lot of the code as it is. | ||
ID: 93 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
If you're having second thoughts about using BOINC because the new algorithm won't require that much CPU, I'd say that there have been a few non CPU-intensive BOINC projects before, with at least one still alive, DepSpid. | ||
ID: 94 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Hello, | ||
ID: 95 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Up ;) | ||
ID: 96 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Who's there? Despite what you might think, we are. Long story short, the project is not dead, but may change framework to successfully deliver our intended outcomes. As previously mentioned, this summer we ran internal testing and came up with some fundamental bugs with our taxonomic name matching algorithms. As we worked through those problems, we then had hardware malfunctions. Then, our main developer moved on to another gig. You know, typical problems faced by every development team. XtremLab seems now to switch to being non cpu intensive, too. So this should not matter. I think it's worth the effort to use BOINC because you'll find a real big community with scientific interests. And you may probably also find some development help ;) | ||
ID: 98 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
For me, it all boils down to this : | ||
ID: 100 | Rating: 0 | rate: ![]() ![]() ![]() | [Reply to this post] | |
Message boards : Cafe : SciLINC Update