| 2009-12-16: MilkyWay@home - Project News: PhD Thesis |
| As I've finally finished my thesis, I've made it available for everyone here: Asynchronous Global Optimization for Massive-Scale Computing. As always, our publications and talks are also on the main page. |
|
| |
| 2009-12-16: MilkyWay@home - Project News: e-Science 2009 and Status |
| Professor Szymanski recently presented our work at the 2009 e-Science conference in Oxford, UK. I've made a link to the paper available here: Robust Asynchronous Optimization for Volunteer Computing Grids, and slides of the presentation will be available later today. On another note, I submit my PhD thesis tomorrow, so I'll be able to get back working on server and application related issues full time for the next few weeks.--Travis |
|
| |
| 2009-12-07: MilkyWay@home - Project News: CUDA Application (0.24) |
| The issue observed over the past week with work units failing under certain conditions with NVIDIA GPUs has been resolved. The newest version of the application 0.24 contains the appropriate fix and an additional 5-10% performance increase from earlier optimizations. |
|
| |
| 2009-12-03: MilkyWay@home - Project News: Servers |
| I'm aware the graphs have leveled out but I'm still watching the server to see if we're having any issues with the hard drives (which is why I haven't had the astronomers start up something new yet). I'll be updating some of the server code tonight and starting a few new searches which I think will help some of the problems with the ones we have running right now.--Travis |
|
| |
| 2009-11-30: MilkyWay@home - Project News: Good News |
| The server seems to have been running fine for the last few days, and I've heard from labstaff that the controller is fine. I think I might have fixed the problem that was causing the random crashes. Sadly, the server is still extremely overloaded, so for the time being I'm increasing the workunit size (about 4x what they were before). Hopefully this should make the webpage more responsive and work more easily available. I'm really hoping to have all the server code upgraded this week which I'm hoping will improve things even more. |
|
| |
| 2009-11-26: MilkyWay@home - Project News: Generating Work |
| I'm going to try and generate some work and see if the few changes I made server-side improve the problems we've been having. Hopefully nothing crashes. |
|
| |
| 2009-11-26: MilkyWay@home - Project News: Team Issue |
| I think I fixed the team issue, it should update on the webpage in a few minutes. Let me know if there are any other issues with it.--Travis |
|
| |
| 2009-11-26: MilkyWay@home - Project News: Server Software Changes |
| I'm making a few changes of my own which I think may help the server performance, it'll be down for a little bit.--Travis |
|
| |
| 2009-11-26: MilkyWay@home - Project News: More Hardware Problems |
| Looking at the logs, its seems that the teams table in the database crashed so we're going to have to restore it to an earlier version. Chances are this is because of the controller issue, so I'm not going to generate more work until that's fixed, because I don't want you guys losing credit due to hardware issues.--Travis |
|
| |
| 2009-11-25: MilkyWay@home - Project News: Server Back |
| The machine crashed with the new drive running. We took it out of the machine to run some diagnostics on it, and it seems to be ok so we're worried we might have a problem with the controller. We're going to try and send out more WUs and see how things go, but we may have to order a new controller if the machine crashes again.--Travis |
|
| |
| 2009-11-22: MilkyWay@home - Project News: Server Back Up |
| Looks like the new hard drive is ready to go. I've started up the daemons and work should be available. |
|
| |
| 2009-11-22: MilkyWay@home - Project News: Server Status |
| I've been on campus today trying to get to labstaff, but they haven't been around. We're upgrading our issue to get the BOINC software upgraded and the new hard drive installed, so I'm hoping we'll have everything finished and back up and running tomorrow after I meet them.--Travis |
|
| |
| 2009-11-19: MilkyWay@home - Project News: PhD Defense |
| Just wanted everyone to know that I successfulled completed my defense today, so I'll have some time to get the server upgraded and all that other great stuff. Hopefully things should be back up and running in the next couple days.--Travis |
|
| |
| 2009-11-19: MilkyWay@home - Project News: PPAM 2009 Paper |
| Another update for your reading pleasure. We finished an invited paper for the 2009 Parallel Processing and Applied Mathematics (PPAM) conference about the GPU work here at MilkyWay. We'd like to thank Andreas Przystawik and Dave Anderson for their collaboration on this. Here's a link to the paper: Accelerating the MilkyWay@Home volunteer computing project with GPUs. |
|
| |
| 2009-11-19: MilkyWay@home - Project News: PhD Defense Slides |
| I've also linked to the slides from my PhD defense if anyone would like to see them here: [ppt] [keynote] |
|
| |
| 2009-11-15: MilkyWay@home - Project News: on Harddrives |
| Just letting everyone know we ordered new hard drives for the server last week, and hopefully they will be here soon. We're hoping to have everything back up and running within the week.--Travis |
|
| |
| 2009-11-10: MilkyWay@home - Project News: Server Crash - Part 6 |
| In order to save you guys more lost credits, I don't think we'll be starting up new work until we have replacement hard drives. What I've gotten from labstaff is that the drives are running in degraded modes and hurting really bad. They're telling us the reason for the problems has been the construction around campus at RPI which has caused a lot of vibration in the computer labs which has wrecked quite a few hard drives. It seems we're not the only ones having similar issues. Hopefully we can have new hardrives in a day or two and get things back up and running.--Travis |
|
| |
| 2009-11-10: MilkyWay@home - Project News: An Apology |
| We also really want to apologize for all the recent server issues and lost credit. Hopefully you'll all still be around when we get the server back up and work flowing again. I'll post more as soon as I know about hardware orders and what's going on.--Travis |
|
| |
| 2009-11-10: MilkyWay@home - Project News: Server Crash - Part 4 |
| It looks like I'm going to have to remove all the workunits and results from the database. So if you have any running, feel free to cancel them. |
|
| |
| 2009-11-10: MilkyWay@home - Project News: Server Crash - Part 5 |
| We've restored the server from the last backup (which was this morning) so hopefully not too much credit has been lost. I still have to purge the database of all the workunits, unfortunately. We also need to order new hard drives for the server, so I'm not sure how stable things will be for the next week or so until we get them installed. But at least hopefully that explains the issues we've been having lately.--Travis |
|
| |
| 2009-11-10: MilkyWay@home - Project News: Server Crash |
| We're looking into why the server went down. Something about unrecoverable disk errors. Hopefully people haven't lost too much credit or anything like that.--Travis |
|
| |
| 2009-11-10: MilkyWay@home - Project News: Server Crash - Part 2 |
| It looks like some serious problems happened. Right now I've turned off all the BOINC daemons until we can get the database restored to a previous backup (which should hopefully bring back a bunch of credit).--Travis |
|
| |
| 2009-11-10: MilkyWay@home - Project News: Server Crash - Part 3 |
| We have a backup from this morning, but it may have been taken after all the corruption. We're going to try it out and see if it helps anything.--Travis |
|
| |
| 2009-11-07: MilkyWay@home - Project News: Servers and ATI Applications |
| There's been a lot of questions about upgrading the server and putting out server side ATI applications so here's an update about what's going on on our side:We do have versions of the ATI applications available, however here's some changes that the astronomers need to test to put in these applications so we're partially working on getting those all ready before we do a big update and put everything out for everyone.To make a long story short, the model we're crunching now (while valuable) has some problems in describing the background distribution of stars in the milky way galaxy.
What the application does is tries to separate stars which were ripped apart from other galaxies that came close to the milkyway (like the saggitarius stream, which is what our current focus is on) as well as other clusters of stars from stars that were more 'originally' in the milky way. This will let us figure out the current shape of the milky way and give us interesting information about how galaxies interact and things of that nature. So right now we've found out that how astronomers have describing the 'background' stars of the milky way really isn't very correct. I'm pretty sure Heidi and her students are working on some kind of publication dealing with this issue right now.
So to deal with that issue, they've been testing different models which should help with this in getting us even better models that deal with this problem. So currently you guys have helped us find a problem in astronomies current view of the milky way, and hopefully will help us really understand what the milky way looks like.
So while we may not be very fast in upgrading hardware, we're at least doing some astronomy here :P Computer science too - we've just submitted a paper to this year's PPAM (parallel processing and applied mathematics) conference describing the GPU work, which I should be making a link available to everyone as soon as it's accepted.
I'm sorry that the server issues go unattended for so long, but we don't have anyone really doing the networking. It's just me in my spare time (which i have none of right now while i'm finishing writing my phd thesis). Before we had Dave to work on that but he's graduated and we haven't found another undergraduate student to work on this yet. Hopefully next semester we'll have another one. We're in the process of ordering new hardware which should improve the performance of the server, but it will be a couple weeks before it gets here, and probably another week or two before we've updated all the server side code to work on multiple CPUs.--Travis |
|
| |
| 2009-11-07: MilkyWay@home - Project News: New Searches |
| Just noticed a problem with the assimilator crashing. It should be back up and running and work should start flowing again. |
|
| |
| 2009-11-04: MilkyWay@home - Project News: Large WU Sizes |
| I've started some new searches with larger sized workunits, so hopefully these will help the server strain. Let us know how they're running.--Travis |
|
| |
| 2009-11-04: MilkyWay@home - Project News: Website Slowness |
| We've been looking into the website performance and it looks like we're going to be ordering some more hardware in the next couple weeks which should improve the performance. Until then you're probably just going to have to bear with the website slowness. I'm currently trying to finish up my phd thesis (I defend in less than 2 weeks), so I probably won't be frequenting the forums very much until then.--Travis |
|
| |
| 2009-11-03: MilkyWay@home - Project News: Database Crash |
| As most of you have noticed, the Milkyway@home database crashed yesterday. It appears that the database managed to corrupt itself, then failed in a spectacular fashion. We are busy cleaning up the mess, and everything will be sorted out soon. A special thanks to the support staff for the server, as they managed to restore the database at 5am this morning.--Matthew |
|
| |
| 2009-10-23: MilkyWay@home - Project News: BOINC Workshop Slides |
| I've also made a powerpoint version of the slides from our BOINC workshop presentation here. |
|
| |
| 2009-10-22: MilkyWay@home - Project News: BOINC Workshop |
| Hello from the 5th Pan-Galactic BOINC Workshop in Barcelona! I had my presentation today so I'm making the slides available to everyone. You can download them here (sorry they're in keynote for all the Windows users out there). I'll be back next week so try not to break anything before then.--Travis |
|
| |
| 2009-10-05: MilkyWay@home - Project News: New Searches Slowing Server |
| One of our astronomers started up some searches today, but it looks like the workunit size was too small and the server couldn't keep up. We're going to start up some new searches tomorrow which should take longer to process and not make the website unusable and server unaccessible.--Travis |
|
| |
| 2009-10-02: MilkyWay@home - Project News: Server Troubles |
| Server went down last night but I've fixed the problem and everything should be up and running smoothly again.--Travis |
|
| |
| 2009-09-21: MilkyWay@home - Project News: Server Back Up |
| Things should be running again. |
|
| |
| 2009-09-21: MilkyWay@home - Project News: Validator Coming Back Up |
| Everything should be running again shortly. No one informed me about the server crash and I've been sick in bed with the flu :(--Travis |
|
| |
| 2009-09-15: MilkyWay@home - Project News: E-Science 2009 Paper Accepted |
| We've had our recent submission to the 2009 e-science conference accepted. I've made a forum post with a link to a preliminary version of the paper for everyone to read and comment on here. Thanks again for all your support in making this research possible! |
|
| |
| 2009-09-15: MilkyWay@home - Project News: Server Performance |
| I've decreased the sleep time on the feeder again (down to 1 second now), so people who were having trouble getting workunits hopefully won't any more. I'm hoping this might speed up the webpages a little as well. |
|
| |
| 2009-09-14: MilkyWay@home - Project News: WU Errors Part 2 |
| I have some idea what's causing the workunit errors right now. I've started a few new searches and upgraded our assimilator/validator so hopefully that will fix it. Let me know if you're having any issues with the *_6 workunits. |
|
| |
| 2009-09-14: MilkyWay@home - Project News: WU Errors |
| Looks like something weird happened to one of our searches over the weekend. I've made a couple changes to see if it fixed the problem. Let us know if you're still having WU errors. |
|
| |
| 2009-09-11: MilkyWay@home - Project News: WU Errors |
| There were some other errors in the WU parameter files, but I think everything should be cleaned up now. Newly generated workunits should have the correct size and credit. |
|
| |
| 2009-09-11: MilkyWay@home - Project News: Credit Reduction |
| Milkyway's credit awarded has been a bit too high for awhile now, and we're bringing it down to be in line more with other projects. We've been using a credit multiplier of 7.5 per double precision FLOP and other projects are using around 5.4 per double precision FLOP. We're reducing our multipler to this, so credit should be down around 20-30%. I know everyone hates credit reductions, but it was really needed. We also have some performance improvements for CUDA and ATI applications on the way out, so hopefully it won't be too bad. As usual, try to keep the forum flaming about the credit changes somewhat civil. |
|
| |
| 2009-09-11: MilkyWay@home - Project News: ATI Application |
| On 9/12/2009 from about noon until 2 pm EDT the ATI application will be available through BOINC in order to assist the BOINC developers with any issues relating to the new 6.10 client that will have ATI support. Please see this thread for more information. |
|
| |
| 2009-08-28: MilkyWay@home - Project News: Differential Evolution Searches |
| I've implemented a new search method, differential evolutuon, so if you are crunching workunits starting with 'de' that's what these are for. I'll be putting a forum post describing what these are doing in more detail up sometime today.--Travis |
|
| |
| 2009-08-26: MilkyWay@home - Project News: CUDA Application Released |
| The CUDA application has been released on BOINC, please see this thread for more information. The Milkyway@Home team appreciates your patience in reaching this milestone. This code has been implemented and tested on the GeForce GTX 285 donated by NVIDIA to the Milkyway@Home research team. |
|
| |
| 2009-08-21: MilkyWay@home - Project News: Server Side Upgrade |
| A little more news on the server software upgrade. We're upgrading it to put allow us to correctly recognize NVidia and ATI graphics cards, which means the applications we supply will be able to support those GPUs. |
|
| |
| 2009-08-20: MilkyWay@home - Project News: Seriver Side Software Upgrade |
| A planned BOINC server side software upgrade will take place on August 21 at 4:00pm EDT (America/New_York). |
|
| |
| 2009-08-12: MilkyWay@home - Project News: Milkyway@Home Now Accepting Donations |
| Professor Newberg has gone through all the steps to allow MilkyWay@Home to actually accept donations and has written a letter of request, which I've posted here. The letter discusses the progress we've made in both scientific computing and astronomy, as well as our current funding situation. You can directly access the page to make donations here. |
|
| |
| 2009-08-08: MilkyWay@home - Project News: Assimilator Down |
| We're having a small problem with the assimilator, it should be back up and running shortly. |
|
| |
| 2009-07-30: MilkyWay@home - Project News: CUDA App Alpha Preview |
| An alpha version of the CUDA App has been released for community preview, please see the following forum post. |
|
| |
| 2009-07-29: MilkyWay@home - Project News:d User Stats |
| Since some users are still reporting missing credit, I've re-run the stats export which should hopefully update their credit to what it should be after the restore. This might take a little while to show up correctly, but let me know if this has fixed your missing credit, if you're still missing credit. The only credit that you should be missing would be from 4am this morning til around 2pm this afternoon. |
read comments (1 comment) |
| |
| 2009-07-29: MilkyWay@home - Project News: Server Database Restored |
| We restored the server to this mornings backup. Let us know if you're still having any problems. |
|
| |
| 2009-07-29: MilkyWay@home - Project News: Server Crash |
| Looks like labstaff is in the process of restoring the lost data right now. Hopefully we didn't lose too much after the restore is done. |
|
| |
| 2009-07-29: MilkyWay@home - Project News: Server Crash |
| Our database crashed or got corrupted this morning and it's looking we lost a lot of user accounts and credits. For now if you lost your account just make a new one. We're looking into this right now and are trying to restore all that we can.--Travis |
|
| |
| 2009-07-21: MilkyWay@home - Project News: Started a Genetic Search |
| I'm testing a genetic search right now with the new verification. Let me know how things are working. Work should be flowing now |
|
| |
| 2009-07-21: MilkyWay@home - Project News: Updating Server Daemons Tonight |
| I'll be updating the server daemons tonight with better result verification and updated particle swarm and genetic searches. There will probably be some downtime while I get everything up and running correctly. We've also been examining some issues we're having with our fitness calculation, so we'll be releasing a new application and its code to deal with that as well. It also seems we're having some excessive credit issues again so things are going to have to be tweaked (have fun flaming our forums :P). |
|
| |
| 2009-06-22: MilkyWay@home - Project News: RAC minimum on the Cafe |
| Do to some rather unsavory activity in the Cafe, it now has a minimum RAC of 5 to enable posting messages.--Travis |
|
| |
| 2009-06-15: MilkyWay@home - Project News: Explanation of Milkyway@Home Astronomy Progress |
| John has made the following post in the science section. It's an in depth explanantion of the current astronomy work being done here and quite readable and easy to understand (even I can get it). I recommend it if you'd like to know a bit more about what's going on here on the astronomy end of things.--Travis |
|
| |
| 2009-06-11: MilkyWay@home - Project News: Camping! |
| Travis here. I'm going to be camping until Sunday so don't break anything while I'm gone. Hopefully Matt and John will keep the server running and filled with work for you guys :) I'm still having a few problems with the CUDA application for regular milkyway, so it'll probably be out Monday or Tuesday after I get back. |
|
| |
| 2009-06-11: MilkyWay@home - Project News: Cuda |
| I noticed a problem in the binaries and code I put on the code download page. I removed them to do some fixes, but they should be available tonight or at the latest tomorrow morning. |
|
| |
| 2009-06-11: MilkyWay@home - Project News: CUDA Code for Milkway@Home |
| Since it looks like the server is handling things fine (no work shortages), I've put out the CUDA code for milkyway@home. If this works and the server holds up we won't need milkywayGPU@home. The code can be downloaded in the usual code release directory. I've also added two CUDA binaries for intel versions of OS X, single and double precision if anyone would like to test them out. They're also in the code release directory. If anyone would like to test the code for linux and windows that would be appreciated. I've started a new forum thread about this here. |
|
| |
| 2009-06-11: MilkyWay@home - Project News: Short Workunits |
| Matts searches had the wrong sized integral so they were crunching much faster than expected. We've stopped these so there shouldn't be any new short workunits. |
|
| |
| 2009-06-11: MilkyWay@home - Project News: New Search Accuracy and Runs |
| A few more optimizations to the search process have been made, so we're running some of the old stripes again to get better fits. The new runs are ps_new_11_1, for example. |
|
| |
| 2009-06-11: MilkyWay@home - Project News: Science Sticky Thread Started |
| We have started a thread in the science forums relating to the astrophysics portion of the project for those who are interested. |
|
| |
| 2009-06-10: MilkyWay@home - Project News: Search Progess on the Main Page |
| If you look below the news, the plots describing the progress of the different searches we're running is now on the main page. They're updated every five minutes. |
|
| |
| 2009-06-10: MilkyWay@home - Project News: Nathan Cole's PhD Thesis |
| Nate finished up his PhD thesis and we've made it available here. Its also in our publications section. Thanks everyone for your help! |
|
| |
| 2009-06-09: MilkyWay@home - Project News: Power Outage and Work Availability |
| There was just a power outage which took out the server, it should be back up and running now. I also did an update to the feeder which has it running more frequently. I think this should improve the work availability. Let us know how things are working. |
|
| |
| 2009-06-09: MilkyWay@home - Project News: Visual Search Progress |
| I made a little update to the search progress forum thread. You can now see how the searches are progressing here. |
|
| |
| 2009-06-08: MilkyWay@home - Project News: 3 stream searches and the ATI GPU fix |
| We are once again attempting 3 stream searches. If you are getting errors relating to the search ps_sgr_235_3s_4 you can get a fixed version of the code here ( http://milkyway.cs.rpi.edu/milkyway/forum_thread.php?id=886#24282 ) compliments of Cluster Physik |
|
| |
| 2009-06-02: MilkyWay@home - Project News: New Searches with Sagittarius Geometry |
| Here is a post relating to the new ps_sgr_208_* runs you may have been seeing and the Sagittarius Geometry that makes them different. ( http://milkyway.cs.rpi.edu/milkyway/forum_thread.php?id=881 ) |
|
| |
| 2009-06-01: MilkyWay@home - Project News: Server Running Again |
| Looks like I fixed the problem. Things should hopefully be running smoothly again. |
|
| |
| 2009-06-01: MilkyWay@home - Project News: Broke the Server |
| I broke the server doing some updates to get our new astronomers running their new searches. It should be back up shortly. |
|
| |
| 2009-06-01: MilkyWay@home - Project News:d Minimum Sendwork Time to Increase WU Availability |
| I've increased the minimum sendwork time server side to 1 minute (this might be a bit high for some of our GPU clients so if it is let me know). I'm hoping this should increase work availability for everyone, so let me know how it works. |
|
| |
| 2009-06-01: MilkyWay@home - Project News: CUDA Application v0.05 |
| Looks like the gpu code release was missing yet another file. I've updated the v0.05 code and it really should work this time :) |
|
| |
| 2009-06-01: MilkyWay@home - Project News: CUDA Application v0.05 |
| I've updated the code to v0.05 and its in the code release directory. I've combined the linux and osx makefiles into a single makefile, which can also compile the GPU applications. I've included a new (faster) kernel with this release as well. As always, the new code is for discussion in the following forum post and I've also started a thread for makefile discussion. |
|
| |
| 2009-05-22: MilkyWay@home - Project News: CUDA -- Working Compile Script |
| I've updated v0.04 to the code release directory. This should work correctly with the compile script. The next steps on our to-do list are getting checkpointing working correctly for it (i'm pretty sure its not working), and compile time specified single or double floating point precision. In the next couple days I should get the milkyway_gpu forums up and running and some test work units available. |
|
| |
| 2009-05-22: MilkyWay@home - Project News: CUDA |
| I updated another version of the GPU code. It should have the evaluation directory now. |
|
| |
| 2009-05-21: MilkyWay@home - Project News: CUDA Release v0.02 |
| I missed a couple files in the previous release, so theres a v0.02 in the code release directory now. |
|
| |
| 2009-05-21: MilkyWay@home - Project News: CUDA Application Alpha Release |
| I've released a preliminary version of the CUDA application in the code release directory. For more detail, there's a forum post here. This should run on the same test samples, however I'm having some issues getting a working makefile/build script using both BOINC and the CUDA libraries, so if anyone has some knowledge about how to do this it would be really appreciated. |
|
| |
| 2009-05-20: MilkyWay@home - Project News: CUDA Application |
| Looks like I've finally gotten the CUDA application working. I'm in the process of cleaning up the code, and it should be available for you to play around with tonight. It's my first crack at a CUDA application, so it's a bit rough, but currently it's crunching the current stripe 82 WUs in around a minute using a GeForce 9600M GT. I'm sure there's quite a bit more optimization we can to do get it running even faster, as this is the first version and not optimized at all. Part of the reason this has taken so long was that I was doing quite a bit of testing comparing double and single precision math on the GPU. I've come up with some schemes that will allow us to use older graphics cards which don't support double precision math (like the GeForce I've been using); which should let a lot more of our users be able to use the GPU application. More news later when I post the code.--Travis |
|
| |
| 2009-05-19: MilkyWay@home - Project News: Power Outages (Continued) |
| Looks like the power is going to be out until tomorrow morning with another outage tomorrow afternoon. I'll post more information as we know about it. |
|
| |
| 2009-05-19: MilkyWay@home - Project News: Another Power Outage |
| There's another power outage today at 4PM EST, which will bring the server down again. I'll try to get it up and running right after the power comes back. |
|
| |
| 2009-05-18: MilkyWay@home - Project News: Back up and running |
| The reason we went down today a few times was that there were power outages on campus while they were doing things to the electrical system. Hopefully things should be up and running smoothly now. |
|
| |
| 2009-05-18: MilkyWay@home - Project News: Assimilator/Validator Back Up |
| Looks like the assimilator and validator is back up and working. Let us know if you have any problems. |
|
| |
| 2009-05-18: MilkyWay@home - Project News: Assimilator/Validator not working |
| I'm working on the assimilator and validator right now so hopefully I'll have them running shortly. Except a large news update this week by wednesday -- our CUDA application is almost working so it should be out by then. I'm just doing some last tests before I put out the alpha code for everyone.--Travis |
|
| |
| 2009-04-11: MilkyWay@home - Project News: GPU Project Status |
| So I've been working on making the new project specifically for GPUs. This is will alleviate the no work situation because we will be giving much longer workunits to GPU clients. However, I've discovered a bug in a python script that was made when compiling. I need labstaff to give me permission to overwrite the file, but am not sure they work on weekends. So hopefully by early next week we can have a new project up! |
|
| |
| 2009-04-08: MilkyWay@home - Project News: Possible Downtime |
| There might be some downtime this afternoon as we should be meeting with labstaff to get the MilkywayGPU@Home project up and running. I'll also be posting CPU code for the GPU application this afternoon so the people who have made the GPU application for the ATI cards can get their hands on it and modify it so it works with ATI cards. We should have the CUDA code out sometime this week. |
|
| |
| 2009-03-29: MilkyWay@home - Project News: Assimilator Running Again |
| It looks like the assimilator is working again, so work should be available shortly. |
|
| |
| 2009-03-29: MilkyWay@home - Project News: Server Back Online |
| I'm working on getting work generation working again, for some reason the last crash is causing the assimilator to not run. Hopefully we'll have it figured out tonight. |
|
| |
| 2009-03-25: MilkyWay@home - Project News: Server and Applications |
| Sorry for the recent lack of communication, but we've been working on quite a few things behind the scenes here.
First, my new laptop just came in the mail, so I'll be able to seriously start working on a CUDA version of the milkyway application. We'll be developing this for OS X, Linux and Windows.
Second, we're going to be doing a few server-side changes to how things are run, which should significantly help with workunit reporting and work availability. We'll be splitting MilkyWay@Home into two separate applications/backends, Milkyway regular and Milkyway GPU. This will allow us to keep current workunit sizes for non-GPU applications, while farming a lot more work out to the GPUs (so they need to contact the server less frequently). We'll be doing different optimization methods on the regular Milkway and the GPU Milkyway so they'll both be doing equally valid research. In the next day or two I'll be posting the code that the application will be using for the GPU version. After testing to make sure that it's working correctly we'll swap to only awarding credit to the GPU applications for GPU milkyway (that way our servers wont be as bogged down, which will mean better work availability). Also, before a credit firestorm erupts again, we have no plans to award less credit/work to the GPU applications, so you don't need to worry about that. |
|
| |
| 2009-03-11: MilkyWay@home - Project News: New Searches |
| Sorry for the lack of communication recently. I'm back from my flu so it should be a bit better now :) I started up some new searches, which should hopefully do a better job avoiding the edges of the search space which was causing some of the weird acting very long workunits. Should be starting up a few new types of searches in the next day or so as well, more on that later. |
|
| |
| 2009-02-28: MilkyWay@home - Project News: New Searches |
| I started up some new searches, these should take about twice as long to crunch (which should help server load and work availability). I've also started searches on new stripes (24, 25, and 26) which are areas of the sky we haven't looked at before, so we're real interested to see how these come out. |
|
| |
| 2009-02-27: MilkyWay@home - Project News: Reducing the WU Queue |
| I'm reducing the workunit queue to 6 per core. Increasing it to 20 seemed to make the work availability problem worse. I'm thinking that with a smaller number it will take more work requests to clear out the scheduler's work queue. This is just a temporary fix so don't get too worked up about it. Once we get the scheduler's queue increased we'll up the WU queue again. |
|
| |
| 2009-02-27: MilkyWay@home - Project News: Insta-purge is Back (Hopefully not for long) |
| I'm dropping the purge back to instant, because there are going to be a whole lot more workunits floating around in the system with the increased WU queue. If nothing bad happens I'll increases it back to 3-6 hours. |
|
| |
| 2009-02-27: MilkyWay@home - Project News: Lots ofs Today |
| I'm going to be updating the assimilator/validator today, so there might be some work shortages. I'm putting some very limited redundancy into our particle swarm search, which should hopefully fix the problem we've been seeing with outliers messing up the search direction. I'll also be putting in a few changes which should help the work availability problem: first I'm raising the workunit queue to 20 (from 12) and I'll also be increasing the minimum number of available workunits on the server. I'll be starting up a couple new searches this afternoon, and have modified the awarded credit slightly upwards, so you might see a better RAC with these. |
|
| |
| 2009-02-25: MilkyWay@home - Project News: Clients Not Receiving Work |
| I just wanted to let everyone know that we're looking into the problem people are having with not getting work from the scheduler. I'm thinking it might be that our server isn't accepting enough incoming http requests or something along those lines. Hopefully we'll have this sorted out in the next couple days. |
|
| |
| 2009-02-20: MilkyWay@home - Project News: Purge Time Increased |
| The server seems to be running fine, so I've increased the purge time from 3 to 6 hours. |
|
| |
| 2009-02-19: MilkyWay@home - Project News: Daily Quota Increased |
| We've updated our workunit quota, so people using GPU apps should be able to do a lot more crunching. |
|
| |
| 2009-02-19: MilkyWay@home - Project News: Bad Optimized Application |
| Some of the applications with the tag 'mindc_linux: 0.16' are returning invalid results. This might be due to the fact they're not using the latest checkpointing code, or for some other reason. If you're using one of these please update your application to the version compiled with the 0.18 code. I'll stop awarding credit for these tonight (Feb 19th) at midnight. |
|
| |
| 2009-02-18: MilkyWay@home - Project News: Credit for s22 and s23 Workunits |
| I just noticed that the s22 and s23 were generating the wrong amount of credit. They should be around 12-13 each, all the newly issued ones should reflect this change. |
|
| |
| 2009-02-18: MilkyWay@home - Project News: More New Stripes |
| We started up some searches for stripes 22 and 23, which are all new. These also have multiple streams AND multiple cuts, so they'll take a bit longer to crunch. Please let us know if you have any problems with these. |
|
| |
| 2009-02-18: MilkyWay@home - Project News: More credit changes |
| I think the drop to 6/9 credits was a bit much (for now), so I've upped the credits to 8/12 credits for stripes 79/82/86/20/21. I'm really gonna let this sit for awhile (promise) and see how things pan out, unless something drastic happens. |
|
| |
| 2009-02-18: MilkyWay@home - Project News: Minimum Application Version to 0.16 |
| The server won't be awarding credits to applications with a version number less than 0.16. If you're not receiving credit for your optimized application then you probably need to update it to a more recent version. There are links to valid optimized applications in our code discussion and number crunching forums. If any valid applications are having problems with this, please let me know. |
|
| |
| 2009-02-17: MilkyWay@home - Project News: No More Insta-Purge |
| I've set the purge to 3 hours now, so you should be able to look at your workunits for awhile. If it doesn't kill the server in the next few days I'll look into increasing it to 6 or 12 hours. We might even be able to get it back to a day. |
|
| |
| 2009-02-17: MilkyWay@home - Project News: Return of the Credit Reduction |
| Sorry guys, but in order to have some semblance of cross project parity in this (at the request of other projects), we had to reduce credit again. New WUs should now be generating around 6.1 credit for stripes 79, 82 and 86, and around 9.2 credit for stripes 20 and 21. Other projects have been getting requests from their users to increase credit to match ours from their users, because they felt they couldn't compete -- and this is exactly the situation we'd like to avoid. |
|
| |
| 2009-02-17: MilkyWay@home - Project News: Another Credit Reduction |
| Given some discussion about credit rates, and the fact that the standard is 1GFLOPs/day = 100 credits. 1GFLOPs/day = 100 credits would mean 79, 82 and 86 WUs would be generating ~1.4 credits, while 20 ad 21 would be generating ~2 credits per WU. I think this is too low. What I'm thinking about dropping credits to around 4-6 credit per 79, 82 and 86 WU, and 6-9 credit per 20 and 21 WU. I'm open to a bit of discussion on this because given that we're an alpha project I think our credit shouldn't be too low considering what you guys have to put up with here, however it definitely shouldn't be 10x what the supposed rate should be. |
|
| |
| 2009-02-17: MilkyWay@home - Project News: New Searches for Stripes 20 and 21 |
| I started up some searches for stripes 20 and 21, let us know how they're crunching. |
|
| |
| 2009-02-17: MilkyWay@home - Project News: Search Progress Visualization |
| We're going to be working on something that will let you guys see how the searches we're currently running are progressing, in somewhat real time. I've started a thread about this (with some preliminary images) here. Please feel free to comment with suggestions on how we can make this more interesting for you :) |
|
| |
| 2009-02-17: MilkyWay@home - Project News: Minimum Application Version Change |
| It's time to get all the older applications out there updated. As of February 17, midnight EST, we won't be awarding credit for applications flagged as v0.15 or earlier. These applications have a checkpointing problem and can frequently return invalid results to the server. So nows a good time to update to the newest optimized applications if you're using an older one. There are links to them in the number crunching and code discussion forums. |
|
| |
| 2009-02-16: MilkyWay@home - Project News: Credit Change |
| I've updated the credit rates, WUs should be generating around 12 credit each for the new searches. I've also lifted the credit limit. This is a pretty big change so there's probably going to be a bit more tweaking to be done, but I'm going to see how this goes for awhile. |
|
| |
| 2009-02-16: MilkyWay@home - Project News: Windows to v0.19 |
| Dave didn't update the version number in the code, so the windows apps are now at v0.19... Please direct all flames his way :) |
|
| |
| 2009-02-16: MilkyWay@home - Project News:d Windows Stock Application |
| The stock windows application has been updated to v0.18 as well. |
|
| |
| 2009-02-15: MilkyWay@home - Project News:d Stock Application |
| I've updated the stock application for linux and os x to v0.18. The code is in the code release directory as mw_v0.18d. This has a couple new performance improvements (thanks to our users) which has it running 30% faster, or more. This should bring our stock application (and some of the other optimized versions of it) in line with the fastest optimized apps we're seeing out there. Because of this, in the next day or so we'll have another (much loved) credit modification. I'll most likely be dropping the credit rate by about 30-50% but at the same time removing the credit limit. Due to the nature of the performance improvements, older hosts should see better performance improvements than newer ones, so for most people the credit/hr should be the same, while faster hosts might lose some credit or gain some credit depending on where they are compared to the speed limit. |
|
| |
| 2009-02-14: MilkyWay@home - Project News: Particle Swarm Searches |
| I started some new searches, these are doing particle swarm optimization (as opposed to the newton method), so let me know how the WUs are crunching. These workunits should start with 'ps' instead of 'nm'. |
|
| |
| 2009-02-13: MilkyWay@home - Project News: Application Code v0.18c Released |
| I updated the code for v0.18 again, this should fix the problem with stripe 86 and the problem where the probabilities were a little off. |
|
| |
| 2009-02-13: MilkyWay@home - Project News: Application Code v0.18b Released |
| I've upated the alpha release of the v0.18 application. It should now compile correctly. It has some changes for a small checkpointing bug and more performance improvements. I'm going to let other people try it out for a bit before I update the stock application. So if all goes well stock should upgrade to 0.18 in a couple days. After we've updated the stock application to v0.18 and we see that it's working correctly and we have optimized versions of it available, I'm going to stop awarding credit to pre 0.18 compiled applications, because we don't have any other way to get people to upgrade their optimized applications. I'll post a news item as a warning and provide links to appropriate v0.18 applications so that everyone has time to upgrade their applications before I make the switch. |
|
| |
| 2009-02-08: MilkyWay@home - Project News: Server (Tentatively) OK |
| It looks like the server has been running smoothly all day, so I think we're in the clear. Thanks for everyone putting up with the downtime and lost workunits! |
|
| |
| 2009-02-07: MilkyWay@home - Project News: More Problems |
| It looks like we're having some kind of problem with the transitioner. It's running very slowly due to the fact that something else is hammering our mysql server. I'm hoping this is just because of people returning results which aren't
in the database. We're looking into the problem to try and figure out what's wrong, so things are going to be a bit slow until we figure it out. |
read comments (1 comment) |
| |
| 2009-02-07: MilkyWay@home - Project News: Work Started |
| Work should be flowing now, let me know if you have any problems. |
|
| |
| 2009-02-07: MilkyWay@home - Project News: Server Issues |
| I'm not generating any new work tonight, because the server is being really loaded down with all the old workunits being reported. I'm hoping by morning things should die down and I'll be able to start up work generation again. Thanks
again for bearing with us through the downtime. We're trying to fix all the problems and make sure it doesn't happen again. |
|
| |
| 2009-02-06: MilkyWay@home - Project News: Server Downtime |
| Sorry about the server downtime. Our mysql database got corrupted and we had to rebuild it. Unfortunately we had to clean out the workunit and result tables to get things working again, so your best bet right now is to do a reset. I'm
still working out a few things, but work should start flowing sometime this evening. |
|
| |
| 2009-02-05: MilkyWay@home - Project News: WUs purged quicker |
| Part of the problem with our server being slow is we've been crunching quite a few workunits and it's getting bogged down. I've recompiled a modified version of the db_purge which will let me purge in increments of less than a day, so
WUs will be purged every 6 hours (instead of 24). Hopefully this should decrease the load on the database and speed things up. Once the purge catches up tonight I expect we'll see a bit of an improvement in server performance. |
read comments (12 comments) |
| |
| 2009-02-04: MilkyWay@home - Project News: New Searches |
| I've started 5 new searches for stripes 79, 82 and 86; each starts from a different set of parameters so we're seeing how close these get to each other. We should be using these for an upcoming publication, more on that later :) After
these are done we'll probably be focusing on stripes 20 and 21. |
|
| |
| 2009-02-02: MilkyWay@home - Project News: Workunit Queue Increased |
| I've increased the in-progress workunit limit from 8 to 12, so this should help a little bit in keeping your queues filled. The newton method searches we've been running are a bit less sensitive to this than the genetic searches we were
doing so hopefully the server will be able to handle the extra load. |
|
| |
| 2009-02-02: MilkyWay@home - Project News: Source Code v0.18alpha Released |
| I've released the preliminary code for v0.18. I'm still testing it but I figured I'd get it out there for more eyes to look at. There's been a few changes in the code for multiple streams and better checkpointing, so I'd like to have
some more thorough testing of it before fully releasing it to the wild. It also has new sample workunits to test on for streams 20 and 21. Hopefully this will make the transition to v0.18 a bit smoother. It can be found in the usual spot. |
|
| |
| 2009-01-28: MilkyWay@home - Project News: l38 and l39 credit |
| It was a bit low compared to what you were getting before, so I've upped it to be in line with what it was. However I think we might have to do some kind of credit adjustment because the project's awarded credit as a whole is pretty high
in comparison to the number of users. |
read comments (1 comment) |
| |
| 2009-01-28: MilkyWay@home - Project News: Weird Workunits |
| I had some issues generating some workunits today when starting up some new searches using different stripes. The formula for credit also changed a bit because the new stripes have multiple streams and the function to calculate awarded
credit needed to be changed to reflect that. A couple WUs ending with l36 might calculate very fast, and some of them might have odd credit values. The problem has been fixed though so WUs generated with l38 and l39 should work nicely, without
weird credit. |
|
| |
| 2009-01-25: MilkyWay@home - Project News: Error with v0.16 windows signature |
| It looks like Dave had a problem with the v0.16 signature file for windows, so I've resigned them and updated the windows app to v0.17. Let me know if these are working. |
|
| |
| 2009-01-25: MilkyWay@home - Project News: Stricter Error Checking Tomorrow |
| Since the v0.16 version of the application has fixed the problem with the application returning bad result, tomorrow afternoon I'll be turning back on the error checking that detects impossible results. To ensure that you will be getting
credits for all your workunits, update your optimized applications to a version compiled with v0.16. Stock users have nothing to worry about. |
|
| |
| 2009-01-25: MilkyWay@home - Project News: on v0.16 Applications |
| This is tentatively speaking, but the v0.16 apps have been running all day without any errors. So I think we've fixed the checkpointing bug! Hopefully we won't have to update the application for awhile now. :) |
|
| |
| 2009-01-25: MilkyWay@home - Project News: Another Day, Another App Version |
| I really think we've found the last error in checkpointing this time, honestly! I've released v0.16 for osx and linux, and windows should be along the way. The source is in the code release directory. |
|
| |
| 2009-01-25: MilkyWay@home - Project News: Application v0.15 Released |
| I bet another application version is just what you've all been waiting for, and here it is! (Just kidding). I've put v0.15 on the server for OSX and Linux, and as usual, Windows will be on the way when Dave gets to it. Anyways, the update
to v0.14 reduced the number of bad results from a couple in a hundred to a couple in a thousand. I'm hoping v0.15 will be the last of them. I've turned off the code that is denying credits for these bad results, because you guys are still doing
the work and it's a problem on our end. In fact if you get a bad result it helps us figure out whats going wrong. :)
The code is in the code release
directory as usual. I'd really like to thank our users (and the people making their own compiled code) for putting up with the changes this last week. Once this last issue is sorted out I think the code should remain stable for awhile as Nate
will be doing a lot of optimizations across different stripes. |
|
| |
| 2009-01-24: MilkyWay@home - Project News: Credits Part 2 |
| What it's looking like is MW is probably a bit more sensitive to floating point calculations than some other project (in fact thats almost entirely what it's doing), so the credit changes might have been a bit extreme for older
architectures. I'm upping the credit a bit to ~70% of the older level, newly generated WUs should reflect this. |
|
| |
| 2009-01-24: MilkyWay@home - Project News: Windows v0.14d |
| Dave has updated windows application to v0.14 as well. Let us know how they're performing. |
|
| |
| 2009-01-24: MilkyWay@home - Project News: Application v0.14 Released |
| I've updated the OSX and Linux apps to 0.14, and the code is in the code release directory. Dave should be updating the Windows apps when he
gets to it. These should fix the error with checkpoint which was causing apps to return invalid results. After these have a chance to get out to everyone and everything looks ok (probably Monday or Tuesday) I'll turn back on the flag
that will not award credit to widely invalid results (which was what the checkpointing error was causing). This should give everyone time to update their stock app (or a newly compiled optimized app).
On another note, this thread has more information about all the changes in v0.14. I was able to remove a multiply and divide from the inner loop of the app, as well as
some conditional statements, which resulted in a performance improvement of ~4%. |
|
| |
| 2009-01-21: MilkyWay@home - Project News: Applications Returning Bad Results |
| There's a windows application placing 'time: X' in the result where it should be have the application name and version. This application also is returning bad results, so it will not be awarded credit. I've also noticed an issue in the
Gipsel app, however I think it might be showing up in the stock app and other optimized applications (but these are less common so it's less frequent). I think it is due to the fact that checkpointing is being done incorrectly, so I'm looking
into this problem. Hopefully we'll have a code update shortly which will fix this problem. |
|
| |
| 2009-01-21: MilkyWay@home - Project News: Assimilator+Validatord |
| We've made the change to the new assimilator+validator. All newly generated WUs will not award credit for applications not compiled as per previous posts. In the next few days, we should be doing another update with automatic error
checking. As we go through this process I'll post in the news which compiled applications are generating correct results, and which are generating bad results so they can be updated before the automatic error checking comes into place. |
read comments (1 comment) |
| |
| 2009-01-21: MilkyWay@home - Project News: Tonight 11PM EST |
| The update will be tonight at 11PM EST. All WUs generated after this time will not award credit to applications not compiled with the instructions here. This is
your last chance to update your application to stock or a different recently compiled application. |
|
| |
| 2009-01-20: MilkyWay@home - Project News: Pushback |
| I'm pushing the update time until sometime tomorrow, because we'd like to have one more update to the windwos application before making the swap. It will happen sometime tomorrow so I'd get your apps updated today. |
|
| |
| 2009-01-20: MilkyWay@home - Project News: New Assimilator/Validator |
| The changes are in place for our new assimilator+validator, so this evening at 8pm EST we'll be making the change. The new assimilator+validator is stricter when it comes to checking for WU correctness. Workunits returned with
impossible results will be marked invalid and not awarded credit. Additionally, as per the previous news post, non-stock applications not compiled with the latest instructions detailed here, will not be awarded credit. Please update your application to the stock app, or a verified recently compiled app to prevent any loss of credit. The new
assimilator+validator contains changes which will allow us to automatically detect bad results, so when we have completed debugging this, credit will also not be awarded to applications which are not returning correct results. |
|
| |
| 2009-01-19: MilkyWay@home - Project News: v12 OSX/Linux Applications |
| I've recompiled these yet again -- because people still have been getting strange performance issues. I've used the exact same compilation flags and used the same code from 0.7 (with the exclusion of the code that fixed the memory leak).
They've tested fine for me, so let me know if you're having any performance issues with v12. |
|
| |
| 2009-01-19: MilkyWay@home - Project News: Code Release and Optimized Windows Apps |
| A significant number of hosts using optimized windows apps are returning bogus results. We're recommending our users return to using the stock app (until updated, correct versions of these optimized apps are released), because starting
tomorrow these optimized apps will NOT be granting any credit. I've released v11 of the source code, with compilation instructions that'll ensure that an optimized app will be granted credit in the future here. The new released code also has multiple test WUs to check the code against, so hopefully newer optimized versions will not return bogus results; they will also let us
track what applications are and aren't working so we are able to debug our searches and let users know which applications are working.
Unfortunately, the bogus windows apps are so prevalent that it's preventing us from implementing our dynamic WU checking; because the number of bad results is skewing our detection which would result in correct results being labeled as invalid.
We also have no way to update these apps automatically, unlike our own stock app on the server. This is why we've had to take such a drastic measure (not granting credit to any older optimized apps) until this situation is resolved. Again, our
users have until tomorrow to either revert to our stock app or upgrade to an application that uses the new compilation instructions and code, or risk not being granted any credit. |
|
| |
| 2009-01-18: MilkyWay@home - Project News: x86_64 OS X Application |
| We've updated the x86_64 OS X application because it still wasn't running as fast as it should be. Let us know how the new version is working. |
|
| |
| 2009-01-18: MilkyWay@home - Project News: Milkyway Code License |
| We're having a discussion about how we would like to have the milkyway code be licensed (open source of course). I was wondering if any of you had any information as to this process.
I think the thing we are most concerned about is that we want our code to be openly available for use and modification -- however if someone distributes their own binary, that code must be made available as well.
It's a little frustrating when people are releasing binaries to the general public and we have no access to the code being used to generate these binaries; so we can't put these optimizations into our own stock application so everyone can benefit
from them. It can also make debugging things a pain because we don't know exactly where our results are coming from.
I also think some of our users should be a bit concerned about this as well because they don't know exactly what they're running on their machines.
Anyways, we'd like your input and information so we can select an appropriate open source license for the milkyway code. I've made a forum post for this discussion here. |
|
| |
| 2009-01-18: MilkyWay@home - Project News: Windows Application |
| Dave updated the windows binaries with the latest code, so let us know how they're running. |
|
| |
| 2009-01-18: MilkyWay@home - Project News: App v0.10 |
| I've updated the osx and linux binaries to 0.10, because it seemed that some of the compiler flags i had used in 0.9 were causing the application to run about twice as slow. Let me know how the new ones are doing. |
|
| |
| 2009-01-17: MilkyWay@home - Project News: Home Page |
| If you didn't notice already, the home page has been updated with publications and support information, since these have been requested by our users. Enjoy!--Travis |
|
| |
| 2009-01-17: MilkyWay@home - Project News: App v0.9 |
| I've made some small changes with the compiler flags re-released the new version of the linux app. Hopefully these should run a little bit faster than 0.8. Let us know
if you have any problems with these in the forums. I also made a small change in the output file that'll let me know what WUs are being returned to the stock app, because I'm
trying to debug an issue with the search and want to know if it's coming from our stock app, our algorithm, or non-stock apps. |
|
| |
| 2009-01-16: MilkyWay@home - Project News: App version 0.8 released |
| I've updated the application to version 0.8 for linux and OS X. This should fix the memory leak issue the application was having, and has a few more performance optimizations, so
it should run a bit faster. Also the problem where a few checkpoint values were not being saved to the correct accuracy has also been fixed. The new code is in the code release directory. The windows app should be updated as soon as Dave gets to it. --Travis |
|
| |
| 2009-01-15: MilkyWay@home - Project News: Assimilator Today |
| I'll be updating the assimilator today, so work might be a little sporadic as I iron out the bugs. |
|
| |
| 2009-01-15: MilkyWay@home - Project News: Incorrect Applications |
| Part of the assimilator update allows us to track users that repeatedly return invalid results and stop awarding credit to them.
If you're using a non-stock app you might want to make sure it's returning the correct results, or you might stop getting credit from it. |
|
| |
| 2008-12-11: MilkyWay@home - Project News: Incorrect Applications |
| It's come to my attention (looking at the results that are coming in), that a few of our users are using applications that are incorrect. If you're going to compile/modify our code please check it against
the test files we've provided to make sure that it's correct. The searches we're running right now are highly sensitive to bad results, so this is pretty important. Either way I'm watching the users that are
giving back bad results, and when our validator gets updated in the next couple days these bad results will not be awarded any credit. I'm hoping this isn't malicious action on the part of these users, and rather
just a failure to double check their compiled apps. |
|
| |
| 2008-12-09: MilkyWay@home - Project News: Old Assimilator and Validator Retired |
| I've stopped the old assimilator and validator (they will be missed *sniff*). I apologize if anyone has a WU out there that hasn't still been crunched for the old
assimilator/validator, but it was holding steady at 5 workunits left in the database for the last 3-4 days, so I figured it was about time. |
|
| |
| 2008-12-09: MilkyWay@home - Project News: Paramter File Change |
| I've made a change in workunit generation that allows workunits across searches to share star files/parameter files (they weren't beforehand). The downside of this is you'll probably
be downloading new star files and parameter files because of the new change. The upside is after those star and parameter files are downloaded you won't have to download more until we start
work on different wedges. |
|
| |
| 2008-12-03: MilkyWay@home - Project News: v0.7 Application -- More Optimizations |
| [B^S] Astral Walker kindly suggested an code optimization which seems to be getting about a 10% speedup. I've updated the application again to v0.7 (at least the linux and osx
binaries). Windows should be on its way when Dave gets it on the server. I've updated the code release
directory as well. |
|
| |
| 2008-12-01: MilkyWay@home - Project News: v0.6 Windows Binary Available |
| We've put the 0.6 windows binary on the server so it should be available now. Sorry for the wait. This should fix the checkpointing problems. |
|
| |
| 2008-12-01: MilkyWay@home - Project News: v0.6 Code Release |
| There was a problem where the v0.6 code wasn't up to date. It's been fixed and the zip and tar files updated. |
|
| |
| 2008-11-30: MilkyWay@home - Project News: Milkyway v0.5 Bug |
| There was a bug in milkyway v0.5 that was causing it to crash when it started up. I've fixed it and released the code for 0.6 and am updating the binaries. |
|
| |
| 2008-11-30: MilkyWay@home - Project News: Milkyway v0.5 Code Released |
| I've released the version 0.5 code to the code release directory. Note: this is just if you want to
compile the code yourself (for example, to try and come up with your own optimizations). The new application should automatically download for you if you want to use our stock app. |
|
| |
| 2008-11-30: MilkyWay@home - Project News: Moving to new application |
| We're starting the move to only using the new application. No new workunits will be generated for the old application (however the old assimilator and validator will keep
running until all the old workunits have been processed (so you'll still get credit for those). We'll be updating with a version 0.5 tonight which will fix the checkpoint error that's
being output (it's just cosmetic). We'll also put out a binary for FreeBSD along with that. Since we've made the source code available, we'll only be supporting binaries for FreeBSD,
Linux, OS/X and Windows, so if you're using something more obscure than that you'll have to compile it yourself because we don't have regular access to those types of systems. We've had
some discussion and the new WUs should be a bit more computationally intense, which should help with the server problems we've been having. Not to mention that moving away from the old
app and it's server side daemons will also help our server load issues. |
|
| |
| 2008-11-25: MilkyWay@home - Project News: Application v0.4 Code Release |
| We've updated a bug or two in version 0.4, and also compiled with various optimization flags which should improve performance further. The code has been
released for this version as well. We've also compiled a binary for 32 bit linux, so let us know how that works. Also, if you've compiled your own version of the application, don't use
-ffast-math because this reduces the accuracy of the likelihood value we're trying to calculate. |
|
| |
| 2008-11-24: MilkyWay@home - Project News: Application v0.3 Code Release |
| I've released a newer version of the code, which has some more performance improvements. Feel free to download it and any other previous code releases here. |
|
| |
| 2008-11-22: MilkyWay@home - Project News: Application v0.2 Code Release |
| I've released the code so feel free to download it and take a look. There's some more
information about the code in the forums here. Please use the code discussion forum to post suggestions
so we can further optimize and improve the code. |
|
| |
| 2008-11-21: MilkyWay@home - Project News: WUs for New Application |
| I've started a few WUs for the new application. Please let us know if these are working. |
|
| |
| 2008-11-21: MilkyWay@home - Project News: New Application 4 |
| We've flagged the new application as a test application, so you can opt out of testing it. Default preferences are to NOT run test applications, so if you want to help us
test it you can enable this in your project preferences. |
|
| |
| 2008-11-21: MilkyWay@home - Project News: New Application 3 |
| We've fixed the problem with the application and have recompiled it for windows and OSX. I'll be starting up some workunits tonight (in the next few hours) and hopefully
they'll work ok. If the workunits don't fail, I'll start up the new assimilator.--Travis |
|
| |
| 2008-11-20: MilkyWay@home - Project News: New Application 2 |
| We've put the new version of the application up on the server, currently we only have it for windows. I'm working on compiling
the application for OSX at the moment. Afterwards I'm going to try to start a few workunits tonight and see how horribly things
crash.-Travis |
|
| |
| 2008-11-20: MilkyWay@home - Project News: New Application |
| Nate came to us with some problems in the current application code, so we've been working on fixing that. Everything is looking right (or very close to it) at the moment, so we'll be trying to
get the new application out this afternoon (around 2pm EST). |
|
| |
| 2008-11-19: MilkyWay@home - Project News: Application Optimizations 2 |
| I just implemented another round of optimizations, and now on the AMD Linux cluster it's running 8x-9x faster (almost 4 times as fast as the previous version). The machine I'm testing on is really
high end, so I'm hoping that older archiectures will get even more improvement from this. Also, we're still on schedule to put the new app on the server this afternoon and start with the new
workunits.--Travis |
|
| |
| 2008-11-18: MilkyWay@home - Project News: Application optimizations |
| I've just finished implementing a bunch of optimizations suggested by our users in the new milkyway application (we're hoping to roll it out on wednesday). On our AMD Linux cluster it's
running about 2-3x faster. I'm currently getting some numbers for OSX and Dave is working on some numbers for windows. We should be releasing the code wednesday when we put the app on our
server.--Travis |
read comments (1 comment) |
| |
| 2008-11-14: MilkyWay@home - Project News: Purging and Assimilator |
| I've had to start purging results immediately (as opposed to leaving them on the server for a day) because our server has been getting overloaded with the new faster applications out there. I
also just finished the new assimilator finally, so hopefully within the next couple days the new application will be uploaded to the server and we'll be able to begin testing the new app. Dave should
post the new code to the forum once we have things working, and after that we'll start tweaking the awarded credit so we're in line with other projects -- which i know is our users favorite thing
:D--Travis |
|
| |
| 2008-11-03: MilkyWay@home - Project News: Credit Changes |
| After some discussion, we've decided to move the credit generated per workunit back to where it was, however reduce the maximum possible credit generated per hour in half -- this should keep
our project in line with other BOINC projects, but not penalize people not running optimized apps. These changes should effect all newly generated work so it might take ahwile for everything to
propagate out.--Travis |
|
| |
| 2008-11-02: MilkyWay@home - Project News: Assimilator, Credits and Work |
| I'm bringing the assimilator down for a bit to make some updates. Unfortuantely one of those is we're lowering the credit awarded. After talking to Dave Anderson we're generating about
twice the amount of credit per work compared to SETI and that's the benchmark we're going to be using. Especially in light of new faster applications, we're reducing the credit generated by about
half to keep things in line with other projects. We'll probably doing some more adjustment (if this turns out to be too harsh), and will definitely be doing some more when the new version of the
application comes out (hopefully this week). I'm gonna start up a search with some more expensive WUs so hopefully that will help keep the server load down and work flowing better.--Travis |
|
| |
| 2008-10-06: MilkyWay@home - Project News: Inefficient Application Code Inefficiencies |
| We know that our application code is inefficient, theres no need to be offensive or highly negative about it. The vast majority of the code was written by astronomy graduate
students, not computer scientists, whose main goal was to get an application that spits out the right numbers -- not one that did so efficiently. The whole reason we've released our
source code is so that you can help us make it faster. There's only Nate and myself working on the code, and I'm working on more of the distribution and machine learning aspects, not
going through all the legacy astronomy code (theres a lot of it and most of it neither Nate nor myself have written). So please, if you find code thats inefficient, redundant or outright wrong
please let us know instead of attacking the project and what we're trying to do here. Thats what the forums are for. Please try and work with us, instead of against us and hopefully in
a few iterations we'll have an application thats running a lot more efficiently.--Travis |
|
| |
| 2008-08-19: MilkyWay@home - Project News: Validator and Awarded Credit Change |
| We've made a change to our validator which basically puts a speed limit to the amount of credit any given host can be awarded (per cpu). While this shouldn't effect
the vast majority of our users (as the speed limit is quite high), it will help prevent the project from giving out more credit than intended. |
read comments (1 comment) |
| |
| 2008-08-16: MilkyWay@home - Project News: More Deadline Changes |
| The deadline has been increased to 3 days (up from 2), mainly for computers that need to go offline for weekends. Hopefully this should work well for everyone. |
|
| |
| 2008-08-15: MilkyWay@home - Project News: Increased WU Queue and lowered deadlines |
| Due to some problems with multiple processor machines, I've increased the WU queue back to 20, but I've lowered the deadline for WUs to two days. Hopefully this
will help keep
peoples machines crunching without any downtime. We're still looking into a way to get a per-core queue and hope to have that going soon. |
|
| |
| 2008-07-30: MilkyWay@home - Project News: Reduced WU Queue |
| Due to the longer WU calculation time we've reduced the WU queue to 8 (from 20). Let us know if this causes any problems. |
|
| |
| 2008-06-18: MilkyWay@home - Project News: WU Availability |
| The server is overloaded (yet again) so while we're generating new WUs, people are grabbing them faster than they're generated.
I'm purging the database -- and going to leave it on as a daemon, so once the database is back to a managable size hopefully it will stay
there. We're also going to look into getting new hardware for a faster server to help as well. |
|
| |
| 2008-06-18: MilkyWay@home - Project News: Server Downtime |
| I'm taking down the assimilator to let the purge get the database back to running smoothly and to let the validator catch back
up as well. After the downtime hopefully there'll be better WU availability and things will be running smoothly, as we'll be running the
purge as a daemon. |
|
| |
| 2008-06-12: MilkyWay@home - Project News: Testing the Server |
| We've started a new search to test and see if the server has been fixed, let us know how things are working. |
|
| |
| 2008-06-10: MilkyWay@home - Project News: Milkyway Down |
| Hey everyone, it's Dave. We're having a great deal of trouble with the database at this point. We've been trying to create new work for you but the database keeps losing connection. This may affect the forum as well. We're working towards a fix diligently and we apologize to everyone for any time we may have wasted |
|
| |
| 2008-06-10: MilkyWay@home - Project News: Server Problems |
| Another update on the database -- we've emailed labstaff so hopefully they'll have some answers for us tomorrow (because everything we're trying to do now is either timing out or seg
faulting). Hopefully we'll have the mess fixed up soon, and new searches up and running right after that.--Travis |
|
| |
| 2008-05-29: MilkyWay@home - Project News: Server Outage |
| There have been some problems with a recent search having WUs that freeze or don't work. Currently i've shut down the server to remove the bad workunits from the database -- I'm hoping to have everything fixed sometime this
evening. |
|
| |
| 2008-03-24: MilkyWay@home - Project News: Increased Granted Credit |
| Due to many complaints that the reduction in credit was a bit too severe, we've increased the generated credit a bit. It should be around 4 credit per WU
now. Please feel free to keep complaining about credit on the forums and we'll eventually get it right. :) |
|
| |
| 2008-03-23: MilkyWay@home - Project News: Reduced Granted Credit |
| Due to the fact that the application has been highly optimized in the last few versions, most people agree that the granted credit is way too high for the
project by a factor of 3. We've scaled credit down to keep it in line with other projects, so if you notice reduced credit this is why. |
|
| |
| 2008-03-20: MilkyWay@home - Project News: Assimilatord and New Work Available |
| I've updated the assimilator to deal with some of the performance issues we've been having with it. You should see more work availability and hopefully we wont have
results piling up that aren't assimilated. I've started up a bunch of new searches and hopefully the work will keep flowing faster than before. |
|
| |
| 2008-03-20: MilkyWay@home - Project News: Forums Down for Upgrade |
| I just upgraded the BOINC server software. The database is a little shaky right now as we're trying to upgrade to PHP5 to facilitate it better. Therefore the forums will be
down until we can get PHP5 up, hopefully it won't take more than a day. However, the assimilator problem seems to be fixed with this release and hopefully so will the freezeups. |
|
| |
| 2008-03-19: MilkyWay@home - Project News: Work Generation Downtime |
| We're running a purge on the database to try and get things sped up. During this time we wont be generating any new work, but this should be completed sometime tonight and there
will be new work after that. |
|
| |
| 2008-03-15: MilkyWay@home - Project News: GECCO Paper Accepted |
| Good news everyone! The paper we submitted to the GECCO 2008 conference was accepted, this paper is all about results we've gotten using the genetic search/simplex hybrid on BOINC -- so we
couldn't have done it without you :) for more information on the conference: GECCO 2008.
Here's a link to our paper so you can all read it: An Asynchronous Hybrid Genetic-Simplex Search for Modeling the Milky Way Galaxy using Volunteer
Computing. This isn't the camera ready version, so we'll let you know when we have it updated with all our comments -- and of course acknowledgements to all of you who are doing so much to help our
research! |
|
| |
| 2008-03-07: MilkyWay@home - Project News: New windows and 32 bit linux binaries |
| We've updated the windows and 32 bit linux binaries. Hopefully this will fix the problem win2k users were having with the apps crashing. |
|
| |
| 2008-03-06: MilkyWay@home - Project News: The Application Saga Continues (Part 9) |
| We noticed a computational error in the code, so we've updated all the binaries to 1.21. This way everyone has the same version number which makes keeping track of everything better. We've also added some
optimization to more platforms so you might notice improved performance. Let us know if you're having any problems with the new binaries. We should have a 32 bit linux version soon (this was the only platform not updated
yet). |
|
| |
| 2008-03-06: MilkyWay@home - Project News: The Application Saga Continues (Part 8) |
| Linux binaries for 32 and 64 bit have been updated and optimized, let us know if you have any problems with 1.20 of these. |
|
| |
| 2008-03-05: MilkyWay@home - Project News: The Application Saga Continues (Part 7) |
| We've updated windows, ppc-apple and 32 bit linux binaries to 1.19. Let us know if these work. We should be adding some new platforms soon as well. |
|
| |
| 2008-03-04: MilkyWay@home - Project News: The Application Saga Continues (Part 6) |
| We've updated windows, ppc-apple and 32 bit linux binaries to 1.18 to address the problems people have been seeing. Please let us know if these are still causing any problems. |
|
| |
| 2008-03-04: MilkyWay@home - Project News: Applicationsd (Part 4) |
| I'm trying to roll the application back to 1.13 because 1.15 is still having problems. We'll re-update as soon as we figure out what the problem is. |
|
| |
| 2008-03-04: MilkyWay@home - Project News: Applicationsd (Part 3) |
| We've updated the applications again, hopefully these will work for everybody. Let us know if there are any problems. |
|
| |
| 2008-03-03: MilkyWay@home - Project News: Applicationsd (Part 2) |
| There was a stray printf in the code that was used to compile the binaries, which might make any of you using the 1.14 version to be seeing a bunch of computation errors. We're recompiling and signing and hope
to have a fixed version out tonight or tomorrow morning. Until then i've stopped the daemons so everyone isn't seeing a bunch of errors when they're trying to run milkyway. Sorry about the inconvenience for everyone. |
|
| |
| 2008-03-03: MilkyWay@home - Project News: Applicationsd (Part 1) |
| I've updated the applications for a few versions of the binaries, we should be adding more on wednesday. Let us know if there are any problems with the new binaries. We're hoping these should fix the progress
bug, memory leaks, and also report why windows is giving popups -- so we can fix that in the next version. |
|
| |
| 2007-12-26: MilkyWay@home - Project News: Out of Town |
| I'm going to be out of town until new years eve, so if i don't get back to any questions on the forum or email that's why. I've set up the assimilator and validator to run as daemons in the
config.xml now, so if the machine goes down and comes back up, these should start back automatically even if i'm still out of town -- so hopefully things will run smoothly while I'm gone. I hope
everyone is having a happy holidays!
--Travis |
|
| |
| 2007-12-19: MilkyWay@home - Project News: Stats Export and |
| It looks like we've found and fixed the problem with stats export and update, so as of now, stats should be updated and exported every 6 hours. |
|
| |
| 2007-12-19: MilkyWay@home - Project News: Server Crashes |
| A week or so ago, the server crashed more than a few times. It seems that there was an overloaded circuit causing these crashes, and our labstaff has fixed it so hopefully things should be running much smoother
now. |
|
| |
| 2007-12-19: MilkyWay@home - Project News: Research |
| For an update on the research front, Professor Carlos Varela presented the work for our eScience paper at the conference in Bangalore, India, last week, and I'm
glad to let you all know that it was awarded best paper (of 206 submissions and 60 acceptances, only 2 received best paper). Additionally, a paper we submitted to the 17th International Heterogeneity in Computing Workshop
(HCW 2008) was just accepted, which contains prelimiary results for the asynchronous genetic search we've been using. |
|
| |
| 2007-12-14: MilkyWay@home - Project News: Convolution Credit Issues |
| Some of the first convolution work units generated are granting an incorrect amount of credit (~4 credit), this has been fixed and now all newly created convolution work units should be granting the correct amount (~6.25 credit) |
|
| |
| 2007-12-14: MilkyWay@home - Project News: Convolution Work Units |
| I'm starting up some convolution searches, let me know how they run.
gs_50 ... gs_54 are running convolution
gs_40 ... gs_44 are running non-convolved
both are running the hybrid simplex/genetic search optimization method. I've stopped the particle swarm searches for the time being because they don't seem to be working very well and I'm trying to figure out why. We should
have some simulated annealing work units up and running next week.
the convolution workunits should take a lot longer (mabye 30+ minutes), but should grant the same amount of credit per time as unconvolved work units. let me know if anything is off. |
|
| |
| 2007-12-13: MilkyWay@home - Project News: Snowstorm and Server Issues |
| There was a rather big snowstorm here in the northeast and the server went down. The Internet still seems a bit weird, so please bear with us until everything is up and running correctly. |
|
| |
| 2007-12-12: MilkyWay@home - Project News: New Binaries (1.13) |
| We're uploading new binaries with will be able to calculate the convolution code (although they won't be doing this quite yet), please let
us know if you have any problems with the new binaries in the forums. We're hoping these should also fix some memory leak issues as well. |
|
| |
| 2007-12-11: MilkyWay@home - Project News: Research |
| Things have been a little quiet for awhile so here's an update as to what we've been working on:
1. Nate has committed the convolution code, and we've finished debugging it. Hopefully today there'll be some new binaries as soon as I can get Joe to take a look at it (unfortunately he's the only one that can sign them at the moment). The
convolution should take about 4-8x more time per work unit (which should make the people who want longer work units happy), because instead of calculating the fitness of the astronomy model against fixed star points, it calculates the fitness
against probabilistic distributions of star points (ie, instead of a star being a fixed point, it has a probability distribution in a range of space). Nate is going to make a post about what exactly is going on with this in the next couple
days.
2. The particle swarm searches seem to be running, however they're not performing nearly as well as I expected, so i'm looking into ways to optimize this.
3. I implemented a hybrid simplx/genetic search optimization and have been testing it out. The new genetic search work units you've been seeing are doing this. Where our previous genetic search reproduced parameters based on the double shot
approach (see our escience paper), these generate child parameters using the simplex method. This is interesting because instead of generating child parameters based on two parents, the simplex method can use N parents. Right now i'm testing 4
(the next batch will test 5) and i'll keep increasing to see what effect N has on the convergence rate.
4. I'm working on implementing a simulated annealing optimization, so if you start seeing work units starting with 'sa' it will be for that.
So that's what we've been up to in the last few days, thanks to everyone for continuing to crunch our numbers :)
--Travis |
|
| |
| 2007-12-05: MilkyWay@home - Project News: Forum Fixed |
| The forum problem is fixed, so continue to keep updating us about where our site is breaking :) We're looking into the
PHP problems we're getting all over the website so hopefully they will be fixed soon. |
|
| |
| 2007-12-05: MilkyWay@home - Project News: Forum Broken |
| It looks like we're having forum troubles, we're taking a look at it. |
|
| |
| 2007-12-02: MilkyWay@home - Project News: More Server Issues |
| The server locked up again, so we're taking a look into why it's doing this. Hopefully it will be sorted out shortly. |
|
| |
| 2007-11-30: MilkyWay@home - Project News: Particle Swarm Searches |
| If you've noticed that some of the workunits start with 'ps' those are for the new particle swarm
search that we just got working (genetic search starts with 'gs'). With the last update to the
binaries the resulting work units return a lot more information about what kind of search they
were run from, when they were generated and how they were generated, so we're going to be able
to really start studying whats going on in depth now.
As to what we're going to be working on while getting these new results, the plan is:
1. fix the remaining memory leaks in the astronomy code
2. Nate is going to be updating the code with the 'convolution' which will make work units a bit longer but more accurate
3. i'm going to be implementing adaptive simulated annealing and maybe parallel tempering and stochastic tunneling search methods
4. we'll be doing a lot of data analysis about the particle swarm searches and comparing those to the asynchronous genetic search
5. there's an upcoming genetic/evolutionary algorithms conference (paper submissions due by mid january) and we're hoping to submit
the results for genetic search (and particle swarm if we have enough) to that.
thanks again everyone for crunching our numbers and putting up with all the server troubles last week. :D |
|
| |
| 2007-11-30: MilkyWay@home - Project News: Server Back |
| The server totally crashed last evening, but things should be back up and running now. |
|
| |
| 2007-11-29: MilkyWay@home - Project News: Server Running |
| After a recompile and restart, the server appears to be serving work again (finally) and you should be getting the newest binaries. |
|
| |
| 2007-11-28: MilkyWay@home - Project News: Server Problems Continue |
| For some reason work isn't being uploaded, even though there are workunits available in the system and the new binaries
seem to be recognized by the server. I've sent an email off the the boinc projects list and hopefully someone will be
able to respond and help us out. We'll also be doing a reboot of the server sometime this evening in hopes that might
help things out as well. We'll keep you posted on the news and in the forums. |
|
| |
| 2007-11-28: MilkyWay@home - Project News: What We've Done So Far |
| A user posted a question on the forums asking what we've done so far, and I figured the response might be newsworthy:
We've actually already gotten some interesting results. We've crunched through 5-10 asynchronous genetic searches (AGS) for two different sizes of volumes. We're comparing this data to how the AGS converges on the Rensselaer
grid and BlueGene (results we presented in the eScience paper linked on the main page), and hope to have another publication out this month comparing Boinc, the RPI Grid and the BlueGene for the astronomy project. Before the
server issues, the project was assimilating about 2-3 workunits a second, which is comparable to the large partition of the BlueGene we have used (1024 processors). So far what we've done is pretty promising :)
Once we get the new binaries, we'll be able to test all different kinds of searches like particle swarm, simulated annealing and some others to see which work best for the astronomy application and which scale the best and are
most resistant to the heterogeneity of BOINC, just to mention a few things. Nate should also be updating the code in a week or so with the 'convolution' which makes the calculation a lot more complicated - but more accurate.
Instead of testing the astronomy model to fixed star points, it's tested against star points that are probabilistic distributions, increasing the computation by almost an order of magnitude. How that works out will be really
interesting to see :) I've talked to Nate and hopefully he'll be posting a bit more about how the convolution works and what it'll be doing.
--Travis |
|
| |
| 2007-11-28: MilkyWay@home - Project News: Credit Issues |
| Awhile back some workunits got awarded massive amounts of credit due to some benchmarking issues in boinc (ie, 200,000+ credit). While we've waiting to get
new binaries signed and uploaded, I've gone through the database and removed credit from these workunits, so our toplists should be looking the way they're
supposed to. I apologize if any users/teams lost more credit then they think they deserved (send me a message if it's a problem), but I did the best I could
with my limited knowledge of MYSQL. However, with the new validator and fixed credit scheme up and running, I think things will even themselves out once
we start crunching numbers again.
--Travis |
|
| |
| 2007-11-28: MilkyWay@home - Project News: Continuing Server Issues |
| After fixing the shared memory problem, it looks like the server isn't recognizing the new binaries. We'll be signing new ones tonight and putting them on the
server and hopefully this will fix the problem of not being able to download any work. As far as we know, there is work available, but the server doesn't think
there are correct binaries to upload for it. |
|
| |
| 2007-11-27: MilkyWay@home - Project News: Server Down Again |
| Sorry for all the errors as of late, but we've had another problem with our server. Something went wrong with the shared memory while updating the binaries and
the feeder isn't starting back up. We hope to have things working soon, and the new binaries available. |
|
| |
| 2007-11-27: MilkyWay@home - Project News: Binariesd |
| We've completed updating the binaries so we should be able to do particle swarm searches and gather a lot more information about how searches are being performed.
Hopefully these new binaries will fix some of the memory leak problems and incompatibilities with linked libraries as well. |
|
| |
| 2007-11-27: MilkyWay@home - Project News: Binaries |
| We're currently in the process of updating the binaries, so there won't be any work available for the next hour or so while we get them ready. The new binaries
will allow us start performing particle swarm optimization in addition to genetic search (as well as simulated annealing and a few others when they get implemented
server side). Additionally, we'll be able to track different statistics about how these different optimization algorithms work on such a heterogeneous environment
as BOINC, and be able to use this to perform different types of optimization. |
|
| |
| 2007-11-27: MilkyWay@home - Project News: Power Outage |
| There was a power outage this morning and I had to manually restart the BOINC demons after the machine was turned back on. Everything should be working again. |
|
| |
| 2007-11-27: MilkyWay@home - Project News: Server Problems Fixed |
| Server problem should be fixed now and work should be availble. |
|
| |
| 2007-11-26: MilkyWay@home - Project News: Server Problems |
| We've had some problems with server processes not shutting down correctly so the server needs to do a hard reboot. There might not be any work
available while this is happening. Things should be working again as soon as our labstaff gets back to us. |
|
| |
| 2007-11-26: MilkyWay@home - Project News: Validator and Credit |
| We've updated the validator which should now be granting fixed credit depending on how much work the workunit will do (determined server side). We hope this
will fix any problem with 'cheaters' or people with benchmarks that didn't run correctly being awarded way too much credit. You might notice that credit granted
might have gone down a bit -- for the current size workunits we've made that 1.0 credit. Workunit size should be starting to go up, so this should increase as well
for longer running workunits. |
|
| |
| 2007-11-25: MilkyWay@home - Project News: Server |
| Sorry about the flakyness of work availability the last few days. We've been having some problems with the server but hopefully they will all be fixed shortly. |
|
| |
| 2007-11-19: MilkyWay@home - Project News: Research |
| Here's an update about what we're currently doing (taken from the forums):
Right now we're looking into two different things:
1. The effect of the asynchronous return time of work units on the quality of the genetic searches we're running. If you'd like to read more about the asynchronous genetic
search we're running, we have some papers we sent out recently to workshops/conferences detailing the search -- but we only had results using the new BlueGene supercomputer
here at RPI, and our local RPI Grid of clusters.
The papers can be found here:
http://www.cs.rpi.edu/~deselt/desell_genetic_ppam_2007.pdf
http://www.cs.rpi.edu/~deselt/hcw2008.pdf
What we're hoping to do with this information is determine what effect a really heterogeneous computing environment has on our asynchronous genetic search, and figure out ways
to optimize the search for these types of environments.
2. The astronomy program we're running currently calculates an integral over the wedge of the sky we're modeling. Since it's not possible to actually integrate the function
we're interested in, we have to calculate the integral the old fashioned (and expensive way) of calculating a bunch of points and calculating the area between them. The next
few searches we plan on doing will calculate the integral with varying accuracy - so expect work units of varying times (probably 8 minutes to over an hour). With these results
we'll be able to figure out what effect the integral accuracy has on the rate our genetic search converges to a solution, and what effect the integral accuracy has on the
quality of the answer.
Some other things that we have in the works is that i've been working on an asynchronous particle swarm algorithm to use (as opposed to asynchronous genetic search). For a
brief overview of what particle swarm optimization is, wikipedia isn't too shabby: http://en.wikipedia.org/wiki/Particle_swarm_optimization . We'll be able to contrast and
compare these two searches, which should be interesting.
Also, we're using the results to compare doing this work on BOINC to the BlueGene supercomputer at RPI. Who knows, with enough participants in the project -- you guys might
beat out the 7th fastest supercomputer in the world! :D (see: http://www.top500.org/lists/2007/06 )
--Travis Desell |
|
| |
| 2007-11-06: MilkyWay@home - Project News: Genetic Search |
| Sorry about the lack of updates, but I have just been informed that our genetic search work generator has
been tested and works. All that is needed to be done is to update the binaries and create a system for starting new
searches. The plan is to meet tomorrow, and have this up and running to get some results. We are planning on
putting out a paper soon, so we will be looking forward to see how everything works out, and I'll try to put the
paper on here, so anyone interested can check it out. |
|
| |
| 2007-10-17: MilkyWay@home - Project News: Temporary Server Issues |
| We're in a bit of a dry spell right now as far as updates. It's been midterm period for all the developers
here, so we haven't had much time to work on this project. In addition, it appears that we are having some technical
difficulties with the server. The server was temporarily down, and some of the services did not reload properly on
reboot. We do have our genetic search implemented on MPI now, so this means we should be able to port that code over
to our BOINC server soon, so I will be working on fixing the server as well as getting that automated search up this
week. |
|
| |
| 2007-10-07: MilkyWay@home - Project News: Version 1.06: MilkyWay@home works on Windows! |
| I just released version 1.06 of the application, and this will now run on windows unlike before. In addition
to working on windows, it also correctly handles checkpointing. This means it won't crash if you suspend it and resume
it later. The only platform that has yet to upgrade to 1.06 is mac, but that should be up tomorrow. Now everyone should
be able to get some credits. I'll do my best to get some work up on the server real soon, and we should be working on
some real problems really soon! |
|
| |
| 2007-10-04: MilkyWay@home - Project News: Project Definition |
| I just wanted to let everyone know that we've got one of the project scientists checking out the boards for
now, and he has posted what exactly our project is doing. You can check it out in the MilkyWay@home Science message
board. I'll try to prod them into making a web page with all that info on there so I can put a link to it on the main
page, but at least for now you can check that out to get an idea of what we are doing. |
|
| |
| 2007-10-03: MilkyWay@home - Project News: Majors |
| I've got all the error and warning messages I see fixed on the web page, and I've submitted new versions
of the software to the server also. In addition I added some mac binaries, so if you have a mac you should be able
to compute some stuff for us now. I've fixed the errors that have to do with CPU usage and disk usage, and the
run time should be much better for the application. There still seems to be a bug in the Windows version of the
application; something to do with BOINC thinking there is a memory leak, and the app will continue running after
100%. In response to some of the requests of the users. I believe the RSS feed is working now, so you should try
it out. You should be able to attatch to the project now, you should be able to use either http://milkyway.cs.rpi.edu/
or http://milkyway.cs.rpi.edu/milkyway/. I'm gonna try to get an automated system up in the next week or two, which
means I'll have some real work up there, and it will probably last more than 3 minutes. Those workunits were only
meant for tests. Once that is done, I'll release a new version of the app and we should be good to go! |
|
| |
| 2007-10-02: MilkyWay@home - Project News: The Forums are Working... Sort of |
| It looks like the message boards are at least functional. There are still some errors to be fixed, but
at least they are useable. This means I can start getting some feedback from you guys! Also, I found the bug
in the code, so if you have gotten work and it ran really slowly and caused your computer to do some strange things
I should be able to fix those very soon. |
|
| |
| 2007-09-29: MilkyWay@home - Project News: Generals |
| I was just able to upload some binaries for windows_intelx86 platforms. I've been running some tests
on them all night, and it seems like the windows version is using significantly more disk space than the UNIX
versions. For the time being I will be increasing the bound on the disk so I can verify some results, so if
you're running windows on a 32 bit processor and you get some errors while running, this is due to these tests.
On the forum front, it appears that we have old html files on our server and I'm going to need to do some serious
updating there, so it may be a bit longer before we see the forums up. I tried to get them working yesterday and
today, and all I managed to do was break the site, so when we finially get things figured out for the forums,
you may see the page go down from time to time... but don't worry, that means we're working on it!!! Finally,
I granted all the claimed credit, so you should all be getting small amounts of credit, but credit to say the least.
I'm going to look into automating it. Things seem to be looking good right now, and once we have a genetic
search implemented I will put some major effort inot getting the forums up so I can get some feedback. Hopefully
things keep moving at this pace, and we will have a fully functional project up very soon! |
|
| |
| 2007-09-27: MilkyWay@home - Project News: New Binaries |
| I've added some new binaries and have just realeased version 1.04 of the application. I found a small
bug, but the bigger news is that we can now support four platforms. The platforms include: amd64-unknown-freebsd,
i386-unknown-freebsd, i686-pc-linux-gnu, and sparc-sun-solaris. I realize I'm missing a few key platforms, but
thats next on the schedule. I'm also going to try to get those forums up soon, so stay tuned for that... Maybe
they'll be up this weekend, who knows? Also our research group has joined with the biology department, and we
will be releasing another BOINC project soon called L1F3@home. I will have a link for their page once it's up.
We may even try to grant bonus credits if users are registered for both projects, so keep an eye out for that too. |
|
| |
| 2007-09-20: MilkyWay@home - Project News: Finally some results! |
| Today we finally were able to recieve results from a client!! Currently the only platform that has bug
free code is i686-pc-linux-gnu, but look for updates when I add new platforms, it shouldn't be too long. I will
now start developing an autonomous system for processing incoming results. That's when we will start having some
real work to do, for now we are still in testing stages. Thanks for your continuing support and patients. |
|
| |
| 2007-02-25: MilkyWay@home - Project News: News |
| Sorry for having everything so quiet but we've been working on getting everyone up to speed and a new version of the application. Right now it's looking like you can expect v1.14 on wednesday. We're just working on getting the
new windows binaries compiled (with code that should help us track down why it's giving that popup error). Additionally, I think we fixed the memory leak -- so let us know if you're still getting any of that. So hopefully we'll be able
to put the new binaries on the server without too many problems :)
On another note, we've found what we think might be a problem in how our searches are running (two of the parameters might be dependent) so we're trying a few new things on the server end to see whats going on with this. The
newer searches are using some intentionally difficult data to help us find the root of some of the problems we've been having -- so thats what you're crunching on right now. The genetic search seems to have some problems with this,
and i'm going to start up some particle swarm searches to see if they do a little better with the problem. Thanks again for all your crunching time! |
|
| |
| 2007-01-30: MilkyWay@home - Project News: UPDATE: started new searches and submitted a paper to GECCO 2008 |
| Sorry i've not been able to have as much time in the forums lately -- we had the camera ready version of the HCW paper due monday, and the GECCO paper due today,
so i've been quite busy writing and putting all the results you've given us down into the paper.
Hopefully the GECCO paper will be accepted and when it is, i'll give you all a link to it to read. The results are quite good - you're crunching as fast as the large
partition of the bluegene we have access to (1,024 processors). better yet, unlike the bluegene you're available 24/7 and we don't have to compete with other researchers
:D
The asynchronous genetic search/simplex hybrid is performing really well, and while not as fast as it's synchronous counterpart it is still quite good. The results also
show that by with some fine tuning we'll be able to improve the performance even more.
I've started up two new searches (gs_170..174 and gs_180..184) that further the results we have in the GECCO paper. They've refined the search a bit and are using more
points in the hybrid simplex operator we've been using.
I also hope to start some particle swarm searches up and running again shortly.
We've also been in the process of looking at some new undergraduates to work with our project to take care of the server and help with compiling binaries and that type of
thing, so hopefully that will also help clean up a bunch of the bugs we've been having.
cheers everybody, and thanks for continuing to work with us :D |
|
| |
| 2007-01-27: MilkyWay@home - Project News: First Results |
| We've submitted a camera ready version of our HCW paper, and due to an increased page limit, we've added the first results for running the double shot genetic search on BOINC. You can access the paper here if you'd like to
read it HCW Paper and see the results of your work. The results are interesting, as they tend to suggest that slower processors aid in the explorative functions of the
search (or the global search aspects), while faster processors aid in the exploitative aspects (or local search). This is good news because it means every computer that joins counts! We again like to thank you for all your shared
CPU cycles. |
|
| |
| 2007-01-08: MilkyWay@home - Project News: Server Outages |
| Our labstaff is going to be taking down milkyway for awhile to run some tests to see why it's been crashing so frequently. Hopefully it will be back soon running smoothly. |
|
| |
| 2007-01-07: MilkyWay@home - Project News: Server Outages |
| It looks like there have been some more power problems with the server, which is why it's been offline. We're working our labstaff to get these problems fixed. |
|
| |
| 2007-01-03: MilkyWay@home - Project News: Upload/Download Issues |
| It looks like things are running smoothly on our end, however we've had some users report that they're still having problems. Whats worked for them is a detach and reattach to the project. If you're still having
problems try giving that a shot -- if it doesn't work let me know. |
|
| |
| 2007-01-03: MilkyWay@home - Project News: Upload/Download Issues |
| While I was gone, it looks like our upload and download directory permissions got messed up -- read/write/execute were removed for anyone other than root. I'm hoping this was the reason that
you couldn't upload or download files for the workunits. Please let me know if things are working correctly now. I have the assimilator/validator running manually again so i can watch to see
if this problem happens again. |
|
| |
| 1970-01-01: MilkyWay@home - Project News: Fpops Estimate Change |
| It seems that our estimate for floating point operations was quite a bit off. I've updated our estimates so this might help some of the problem people are having not being able to download new work. |
|
| |
| 1970-01-01: MilkyWay@home - Project News: Credit Level |
| We've had a lot of performance improvements since when started with the new version of our application (v0.1), and I know this will upset some people, but even our un-optimized stock application is awarding more credit than most other
BOINC projects (even their optimized versions). So I'm reducing the awarded credit by half, which should put us in line with most BOINC projects. Feel free to complain in our forums and try to change my mind if this is too much of a change. This
should be reflected in the next set of searches we start up. |
|
| |