CERN Accelerating science

Feed aggregator

CMS Application Now Available

vLHCathome news - Fri, 07/22/2016 - 22:56
As the issues with the Theory application will probably not be fixed until after the weekend, the CMS application has been made available for everyone. Due to the slightly larger memory requirements, the the number of tasks that can be run simultaneously on a host has been reduced from 2 to 1. If for whatever reason you do not wish to run the CMS application, you can update your project specific preferences to run only the applications that you select. There will be no more tasks for Theory app until the problem has been resolved.
Categories: vLHCathome news

Theory Application job problems

vLHCathome news - Fri, 07/22/2016 - 15:10
The Theory Application looks like it is getting a batch of bad input jobs from the MCPlots server. This is causing many task errors.
We are investigating… Please be patient.
Categories: vLHCathome news

New multi-core application version 1.03

Atlas news - Mon, 07/18/2016 - 11:45
A new version of the multi-core app was released this morning which fixes the issue with the bootstrap script only setting up one core for each WU. It is recommended to abort older tasks using v1.01 if you want to take advantage of the fully working multi-core version.
Categories: Atlas news

Authentications Errors

vLHCathome news - Mon, 07/18/2016 - 11:00
The authentication service is currently down. Tasks will fail with exit status 206 EXIT_INIT_FAILURE until this is resolved. We are working to bring it back up ASP.
Categories: vLHCathome news

How can the BOINC client allocate customized CPU/Memory resources to specific applications

Atlas news - Thu, 07/14/2016 - 10:42
Some of the users might only want to give a certain ratio of their CPU/Memory to a specific application. Take the ATLAS@home Multiple core application ATLAS_MCORE for example, if you want to this app to use less than the CPU/Memory that you allow the BOINC client to use, you can do it through creating a configuration file app_config.xml in your project directory:


You can limit the MultiCore-App by using an app_config.xml.

Below is an example to limit ATLAS_MCORE to use only 4 Cores:

<app_config> <app_version> <app_name>ATLAS_MCORE</app_name> <avg_ncpus>4.000000</avg_ncpus> <plan_class>vbox_64_mt_mcore</plan_class> <cmdline>--memory_size_mb 5300</cmdline> </app_version> </app_config>

You should change these two lines to your needs:

<avg_ncpus>4.000000</avg_ncpus> <cmdline>--memory_size_mb 5300</cmdline>

Memory usage calculated by the ATLAS_MCORE app is by this formula:

memory = 1300 + (1000* NumerOfCores)

so it is 5300MB for 4 cores.


Thanks to Yeti for giving this recipe.
Categories: Atlas news

ATLAS@home releases a beta application for the multi core jobs

Atlas news - Mon, 07/11/2016 - 17:51
We have released a beta application named "ATLAS_MCORE" for the ATLAS multi-core jobs.

If you are interested in testing it on your machine, you need to allow test task in your project preference to receive jobs from this new application.

This can be enabled by login to your account on the atlasathome webpage, then click on "Your account", then click on "ATLAS@Home preferences", then check the box next to "Run test applications".

The multi-core version will check the BOINC client for both the available CPU cores(the number of CPU cores the client is configured to give to BOINC to use) and available memory size(the number of memory size the client is configured to give to BOINC to use) to decide how many cores will be allocated to one virtual machine which runs the ATLAS job.


For the ATLAS multi-core job, the relation between memory size and number of CPU cores is defined in this formula:

Total_Memory=1300MB+1000MB*Number_of_CPU_Cores

For example, a 1 core job requires 2300 MB memory, and a 2 core job requires 3300 MB memory.

The number of CPU cores which will be allocated to the virtual machine is also calculated according to this formula.
Number_of_CPU_cores=(Total_Memory-1300MB)/1000MB
The minimum number between Number_of_CPU_cores and the available CPU cores from the client is used to allocate to the virtual machine.


Currently, this test app can utilize from 2 to 8 cores of the client depending on the available CPU cores and memory size from the client.

By using multi-core jobs, we expect the runtime of jobs is close to runtime_of_single_core_job/number_of_cores, and it can significantly saves the usage of memory for clients which offers multi-cores to BOINC.
____________
Categories: Atlas news

Computation errors

vLHCathome news - Fri, 07/08/2016 - 11:28
Since we added the 64bit theory application, a number of tasks are failing with Computation Error. This is due to three reasons.

  • The need for Hardware-assisted virtualization for 64bit
  • Additional checks for issues that were not previously detected e.g. idling VMs.
  • A technology change that still requires some hardening for all the issues that we experience when running on random machines around the world.

In the past 24 hours 71.79% of hosts returned a successful task using v2619.31 but 35.38% failed tasks with 7.18% returning both successful and unsuccessful tasks. This suggests that things are working but we still have some improvements to make.

To help the situation, please could everyone periodically (no more than once per day) visit your account page and click on the Task View link in the Computing and credit section to view the results of your tasks. If you do see a computation error, click on the task to see the exit status code and the logging output.

The breakdown of failures by exit code is as follows.


  • 35.14% -1073740791
  • 27.17% 206
  • 18.84% 194
  • 6.16% 207
  • 4.35% 255
  • 3.26% -2135228415
  • 2.54% 1
  • 2.17% 203
  • 2.17% 5
  • 1.45% -186
  • 0.72% 197
  • 0.36% -2147467259
  • 0.36% -185

We will address each one of these in subsequent posts and once we have arrived at a final solution, the issue will either be fixed to stop it occurring or an entry will be added to the FAQ to explain what is going on.

Categories: vLHCathome news

CERN launches gigabit project in Kansas City

News of BOINC - Fri, 07/01/2016 - 19:57
CERN has launched the CERN+KC Gigabit Challenge, which uses gigabit optical fiber Internet connections now available in Kansas city to handle data-intensive computing problems.
Categories: BOINC news

Book about volunteer computing

News of BOINC - Thu, 06/30/2016 - 21:17
The book Community, Competition and Citizen Science by Anne Holohan documents the history of volunteer computing.
Categories: BOINC news

Disk space limit decreased to 4GB

Atlas news - Fri, 06/24/2016 - 09:30
Hi all,

To make more effective use of volunteers running ramdisks we have reduced the disk space limit from 6.5GB to 4GB. See thread here

http://atlasathome.cern.ch/forum_thread.php?id=505

We see that most tasks use at most 2.2GB so this should be safe, but please notify us of any problems related to this change.[/url]
Categories: Atlas news

Scheduler and vbox update to detect 64-bit enabled computers

vLHCathome news - Tue, 06/21/2016 - 12:56
The BOINC scheduler has been updated to detect 64 bit machines that do not have the virtualization hardware extensions enabled. Also vboxwrapper has been updated for better error handling, and vboxwrapper 26193 is now deployed for Windows and Linux for the Theory application. This setup has been tested in our dev project.

Similar updates will follow later for other applications.

Many thanks to Rom Walton for providing these changes to the BOINC code.


--The team
Categories: vLHCathome news

CERN Summer Computing Challenge - SOFTWARE STOPPED

vLHCathome news - Tue, 06/14/2016 - 12:32
The software which supported the CERN Summer Computing Challenges in 2014 and 2015, and continued to run Theory jobs with minimum support, has now been halted due to lack of developer resources for this activity.

PLEASE DO NOT RUN CHALLENGE SOFTWARE UNTIL FURTHER NOTICE AS YOUR JOBS WILL BE LOST.

Many thanks to all Challenge volunteers who have contributed to this project and helped to explore new Web and CernVM technologies. We do have plans for a new WebAPI system for running multiple vLHC jobs inside a single multi-CPU VM and will announce this in due course.
Categories: vLHCathome news

LHCb beta application published

vLHCathome news - Mon, 06/13/2016 - 15:53
A new application to simulate Beauty physics at the LHC from the LHCb experiment has now been made available for those accepting beta applications.

Like the CMS application and the 64-bit version of the Theory simulations app, the Beauty simulations require a 64 bit computer with virtualization extensions (VT-x) enabled. Please refer to the instructions in the box on VT-x on the page: http://lhcathome.web.cern.ch/join-us for more information.

Specific discussions on the Beauty simulations can be done in the forum thread dedicated to the LHCb application.

The team.
Categories: vLHCathome news

vlHC Theory Application 64bit upgrade

vLHCathome news - Mon, 06/06/2016 - 11:15
We have put the new Theory 64bit Application into production today.

Please note the following important changes:

As it is a 64bit application, you must have VT-x / AMD-V acceleration enabled:
- To check this, in your VirtualBox Manager select "Settings -> System -> Acceleration" and make sure that "Enable VT-x/AMD-V" is activated. Also make sure another hypervisor isn't installed or running like KVM or Hyper-V.

For volunteers with 32bit hardware, the legacy 32bit Theory Application will be retained for a while:
- (subject to CoPilot continuing to run on a best-effort basis, as our CoPilot support person has just left CERN).

The CoPilot job scheduler system has been replaced by Condor:
- This enables us to unify both Theory and the LHC experiment applications going forward. (Condor is already implemented in the CMS Application here).

The VM consoles for the new Theory app are:
SCREEN 1: Boot console
SCREEN 2: Job output of running job
SCREEN 3: Linux "top" output
SCREEN 4: Job ID log (Condor and MCPlots)
SCREEN 5: Job error log
SCREEN 6: Login console

The web logs for the new Theory app are:
Parent (home) directory - the standard Test4Theory graphics with links to the other logs:
MasterLog: Condor Master process log
StartLog: Condor Start Daemon log
Starterlog: Condor Starter process log
running.log: Current executing job output file
.. finished_n.log: nth completed job output file
stderr.log: Job error log
stdout.log: Job ID log (Condor and MCPlots)

The team
Categories: vLHCathome news

CMS Jobs Available Again

vLHCathome news - Sun, 06/05/2016 - 18:49
There was a fault with a server at CERN last night, which meant that we could not submit new CMS jobs, so we ran out.
However, the problem has now been fixed and CMS jobs are available again. Many thanks to the staff who worked Saturday night and Sunday to fix the problem.
Categories: vLHCathome news

WU running out shortly - more on Monday 6th

Atlas news - Sat, 06/04/2016 - 20:23
Hi all, just a heads up that we will likely run out of WU in the next few hours. We should get some more back in the system on Monday.
Categories: Atlas news

vLHC Theory Application 64bit upgrade (soon)

vLHCathome news - Mon, 05/30/2016 - 15:53
We plan to put the new Theory 64bit Application into production on June 6th. It has been tested for some time on our vLHC-dev site, and we think it is bug free. Please note the following important changes:

As it is a 64bit application, you must have VT-x / AMD-V acceleration enabled:
- To check this, in your VirtualBox Manager select "Settings -> System -> Acceleration" and make sure that "Enable VT-x/AMD-V" is activated. Also make sure another hypervisor isn't installed or running like KVM or Hyper-V.

For volunteers with 32bit hardware, the legacy 32bit Theory Application will be retained for a while:
- (subject to CoPilot continuing to run on a best-effort basis, as our CoPilot support person has just left CERN).

The CoPilot job scheduler system has been replaced by Condor:
- This enables us to unify both Theory and the LHC experiment applications going forward. (Condor is already implemented in the CMS Application here).

More details will follow next Monday when the upgrade will take place.

The team
Categories: vLHCathome news

Congratulations to T4T volunteer Igor !!!

vLHCathome news - Thu, 05/26/2016 - 15:13
The Test4Theory project announces that volunteer cruncher "Igor" has just passed 1 MILLION JOBS and 100 GIGA EVENTS.

A million thanks to you, Igor !!!

The T4T team.
Categories: vLHCathome news

WCG launches Zika drug search

News of BOINC - Tue, 05/24/2016 - 22:09
IBM World Community Grid has launched an application that searches for drugs to combat the Zika virus.
Categories: BOINC news

ATLAS@Home in CERN Bulletin

Atlas news - Wed, 05/18/2016 - 12:34
ATLAS@Home features in this week's CERN Bulletin (CERN's internal bi-weekly newspaper):

http://cds.cern.ch/journal/CERNBulletin/2016/20/News%20Articles/2151943?ln=en

Here you can read about the achievements of ATLAS@Home as well as related LHC@Home projects. Happy reading!
Categories: Atlas news

Pages

Subscribe to LHC@home aggregator