ARC v0.8

From NorduGrid
Jump to: navigation, search

Background

The last production release of the ARC 0.8 series was v0.8.3.1.

Starting with the v0.8.x series, the ARC production releases are created from multiple SVN trees and offered as source tarball bundle (binary packages are also available).

The 0.8 series of production ARC releases are distributed as a consistent single source bundle (nordugrid-arc-bundle-0.8.x.x package). The source bundle is created from the two SVN branches and contains two subpackages. In case of the 0.8.3.1 release the boundle consists of

  • nordugrid-arc-0.8.3.1 is generated from the "arc0/tags/0.8.3.1" tag
  • nordugrid-arc-nox-1.2.1 is generated from the "arc1/tags/nox-1.2.1" tag
  • arcjobtool-0.3.0 is taken from the GUI's sourceforge page


For the v0.8 release binary packages are also provided for Debian/Ubuntu and RPM-based systems through standard repositories.

Content

The "0.8.x" is the latest major production release of ARC after the 0.6 releases which started in May 2007. Besides numerous improvements, the following large changes have happened.

  • The "0.8.x" comes with a new native LDAP-based information system, a mandatory and complete replacement of the previous Globus MDS-based system. The migration instructions from Globus LDAP to native LDAP can be found here:
  • The "0.8.x" includes the A-REX component, the next generation ARC job management service (see tech document). This component is an optional replacement of the previous Grid Manager component. When A-REX is enabled it provides a backward compatible replacement of the Grid Manager. Instructions on how to enable A-REX can be found here:
  • packaging changes: now nordugrid-arc-server is a meta-package depending on nordugrid-arc-gridftp, nordugrid-arc-grid-manager and nordugrid-arc-infosys-ldap, this is to make it easier to tailor services.
  • new components from the ARC1 tree (keeping the "old" components from ARC0 tree as well):
    • new client library, new CLI (arc* commands)
    • HED
  • EXPERIMENTAL components
    • Chelonia
    • ISIS
    • ECHO
    • CHARON
    • HOPI
    • arcjobtool is a new GUI-client for job submission. (See known issues before installing)
  • obsoleted components, features:
    • The old https server and the smart storage element (SSE)
    • NinfG (was never part of the distribution, removed from SVN)
    • ARC Compat clients (compatibility with ARC v0.4.x)
    • Nordugrid ARC Logger service
    • Fireman support
    • rcutils
    • AFS support of Grid Manager
    • obsolete documentation

Source

The source bundle of the release contains subpackages which were created from the release specific tags on the two ARC SVN areas, the svn/arc0 and the svn/arc1 and any additional source packages which are part of release.

The release bundles are available from the nordugrid download area:

Binary packages

With 0.8.1.1 came a new setup of repositories for Debian and Ubuntu. Previously the component (at the end of the line) was ".", Now it is main.

Also, testing repositories are now incremental, this means that you now have to enable both stable and the testing repository if you want to run testing software, previously the testing repository was self-contained.

RPMs and debs for ARC 0.8 including all the necessary external packages are available at:

Please note that many of the grid-specific external software (e.g. globus packages) are now provided by the linux distributions.

Installation from source

The installation instructions are provided for two specific platforms: Ubuntu and CentOS. We believe the instructions are general enough to be followed on other platforms as well. The main installation steps are the usual ones:

  • Prerequisities - Provide the necessary external dependencies for ARC installation (build instructions for Grid-specific software is given)
  • Building ARC - Build and install ARC including the optional A-REX component.
  • Configuration and basic testing - Configuration notes and simple instructions on how to check whether the ARC is setup properly.

Installation from binary packages

We have two branches in our repository. We have the Stable branch which contains the latest stable version of ARC. We also have the Testing branch which during a release-cycle contains the latest tagged version (alpha, beta, release candidate). If you want more recent than that, you will have to go to our svn. The testing repositories only contains updated packages, so in order to get a full testing-installation you will need both repositories.

For server-installation install the nordugrid-arc-server package and for the client-installation install the nordugrid-arc-client package.

Debian/Ubuntu

The archives are signed by the key available at: http://download.nordugrid.org/DEB-GPG-KEY-nordugrid.asc. Download the key and then install it in your apt configuration using the command.

sudo apt-key add DEB-GPG-KEY-nordugrid.asc

You can then install the arc packages using the way you prefer: apt-get, synaptic, or ...

Debian/Ubuntu Stable repositories

With 0.8.1.1 came a new setup of repositories for Debian and Ubuntu. Previously the component (at the end of the line) was ".", Now it is main.

APT sources:

  • For Debian 4.0 (etch):
deb http://download.nordugrid.org/repos/debian/ etch main
deb-src http://download.nordugrid.org/repos/debian/ etch main
  • For Debian 5.0 (lenny):
deb http://download.nordugrid.org/repos/debian/ lenny main
deb-src http://download.nordugrid.org/repos/debian/ lenny main
  • For Ubuntu 8.04 (hardy):
deb http://download.nordugrid.org/repos/ubuntu/ hardy main
deb-src http://download.nordugrid.org/repos/ubuntu/ hardy main
  • For Ubuntu 8.10 (intrepid):
deb http://download.nordugrid.org/repos/ubuntu/ intrepid main
deb-src http://download.nordugrid.org/repos/ubuntu/ intrepid main
  • For Ubuntu 9.04 (jaunty):
deb http://download.nordugrid.org/repos/ubuntu/ jaunty main
deb-src http://download.nordugrid.org/repos/ubuntu/ jaunty main
  • For Ubuntu 9.10 (karmic):
deb http://download.nordugrid.org/repos/ubuntu/ karmic main
deb-src http://download.nordugrid.org/repos/ubuntu/ karmic main
  • For Ubuntu 10.04 (lucid):
deb http://download.nordugrid.org/repos/ubuntu/ lucid main
deb-src http://download.nordugrid.org/repos/ubuntu/ lucid main
  • For Ubuntu 10.10 (maverick):
deb http://download.nordugrid.org/repos/ubuntu/ maverick main
deb-src http://download.nordugrid.org/repos/ubuntu/ maverick main
Debian/Ubuntu Testing repositories

The testing repositories are incremental repositories that depend on the stable repositories being enabled. This is where packages are just before going into main repositories.

  • For Debian 4.0 (etch):
deb http://download.nordugrid.org/repos/debian/ etch-proposed-updates main
deb-src http://download.nordugrid.org/repos/debian/ etch-proposed-updates main
  • For Debian 5.0 (lenny):
deb http://download.nordugrid.org/repos/debian/ lenny-proposed-updates main
deb-src http://download.nordugrid.org/repos/debian/ lenny-proposed-updates main
  • For Ubuntu 8.04 (hardy):
deb http://download.nordugrid.org/repos/ubuntu/ hardy-proposed main
deb-src http://download.nordugrid.org/repos/ubuntu/ hardy-proposed main
  • For Ubuntu 8.10 (intrepid):
deb http://download.nordugrid.org/repos/ubuntu/ intrepid-proposed main
deb-src http://download.nordugrid.org/repos/ubuntu/ intrepid-proposed main
  • For Ubuntu 9.04 (jaunty):
deb http://download.nordugrid.org/repos/ubuntu/ jaunty-proposed main
deb-src http://download.nordugrid.org/repos/ubuntu/ jaunty-proposed main
  • For Ubuntu 9.10 (karmic):
deb http://download.nordugrid.org/repos/ubuntu/ karmic-proposed main
deb-src http://download.nordugrid.org/repos/ubuntu/ karmic-proposed main
  • For Ubuntu 10.04 (lucid):
deb http://download.nordugrid.org/repos/ubuntu/ lucid-proposed main
deb-src http://download.nordugrid.org/repos/ubuntu/ lucid-proposed main
  • For Ubuntu 10.10 (maverick):
deb http://download.nordugrid.org/repos/ubuntu/ maverick-proposed main
deb-src http://download.nordugrid.org/repos/ubuntu/ maverick-proposed main
Debian/Ubuntu Experimental repositories

The experimental repositories are incremental repositories that depend on the stable repositories being enabled. This is where packages are for alpha, beta and release candidate versions of the software.

  • For Debian 4.0 (etch):
deb http://download.nordugrid.org/repos/debian/ etch-experimental main
deb-src http://download.nordugrid.org/repos/debian/ etch-experimental main
  • For Debian 5.0 (lenny):
deb http://download.nordugrid.org/repos/debian/ lenny-experimental main
deb-src http://download.nordugrid.org/repos/debian/ lenny-experimental main
  • For Ubuntu 8.04 (hardy):
deb http://download.nordugrid.org/repos/ubuntu/ hardy-experimental main
deb-src http://download.nordugrid.org/repos/ubuntu/ hardy-experimental main
  • For Ubuntu 8.10 (intrepid):
deb http://download.nordugrid.org/repos/ubuntu/ intrepid-experimental main
deb-src http://download.nordugrid.org/repos/ubuntu/ intrepid-experimental main
  • For Ubuntu 9.04 (jaunty):
deb http://download.nordugrid.org/repos/ubuntu/ jaunty-experimental main
deb-src http://download.nordugrid.org/repos/ubuntu/ jaunty-experimental main
  • For Ubuntu 9.10 (karmic):
deb http://download.nordugrid.org/repos/ubuntu/ karmic-experimental main
deb-src http://download.nordugrid.org/repos/ubuntu/ karmic-experimental main
  • For Ubuntu 10.04 (lucid):
deb http://download.nordugrid.org/repos/ubuntu/ lucid-experimental main
deb-src http://download.nordugrid.org/repos/ubuntu/ lucid-experimental main
  • For Ubuntu 10.10 (maverick):
deb http://download.nordugrid.org/repos/ubuntu/ maverick-experimental main
deb-src http://download.nordugrid.org/repos/ubuntu/ maverick-experimental main


Red Hat/Fedora

After creating a file in /etc/yum.repos.d containing the repository definition you can install the packages the way you prefer: yum, package-kit, ...

Stable Yum repositories
  • Red Hat EL 4:
[arc]
name=ARC - $basearch
baseurl=http://download.nordugrid.org/repos/redhat/el4/$basearch/stable
enabled=1
gpgcheck=1
gpgkey=http://download.nordugrid.org/RPM-GPG-KEY-nordugrid
  • Red Hat EL 5:
[arc]
name=ARC - $basearch
baseurl=http://download.nordugrid.org/repos/redhat/el5/$basearch/stable
enabled=1
gpgcheck=1
gpgkey=http://download.nordugrid.org/RPM-GPG-KEY-nordugrid
  • Fedora
[arc]
name=ARC - $basearch
baseurl=http://download.nordugrid.org/repos/fedora/$releasever/$basearch/stable
enabled=1
gpgcheck=1
gpgkey=http://download.nordugrid.org/RPM-GPG-KEY-nordugrid
Testing Yum repositories

The repositories are incremental repositories requiring the stable repositories to be enabled. This is where packages are just before going in to main repositories

  • Red Hat EL 4:
[arctest]
name=ARC - $basearch - testing
baseurl=http://download.nordugrid.org/repos/redhat/el4/$basearch/testing
enabled=1
gpgcheck=1
gpgkey=http://download.nordugrid.org/RPM-GPG-KEY-nordugrid
  • Red Hat EL 5:
[arctest]
name=ARC - $basearch - testing
baseurl=http://download.nordugrid.org/repos/redhat/el5/$basearch/testing
enabled=1
gpgcheck=1
gpgkey=http://download.nordugrid.org/RPM-GPG-KEY-nordugrid
  • Fedora
[arctest]
name=ARC - $basearch - testing
baseurl=http://download.nordugrid.org/repos/fedora/$releasever/$basearch/testing
enabled=1
gpgcheck=1
gpgkey=http://download.nordugrid.org/RPM-GPG-KEY-nordugrid
Experimental Yum repositories

The repositories are incremental repositories requiring the stable repositories to be enabled. This is where packages for alpha, beta and release candidates are made available.

  • Red Hat EL 4:
[arctest]
name=ARC - $basearch - experimental
baseurl=http://download.nordugrid.org/repos/redhat/el4/$basearch/experimental
enabled=1
gpgcheck=1
gpgkey=http://download.nordugrid.org/RPM-GPG-KEY-nordugrid
  • Red Hat EL 5:
[arctest]
name=ARC - $basearch - experimental
baseurl=http://download.nordugrid.org/repos/redhat/el5/$basearch/experimental
enabled=1
gpgcheck=1
gpgkey=http://download.nordugrid.org/RPM-GPG-KEY-nordugrid
  • Fedora
[arctest]
name=ARC - $basearch - experimental
baseurl=http://download.nordugrid.org/repos/fedora/$releasever/$basearch/experimental
enabled=1
gpgcheck=1
gpgkey=http://download.nordugrid.org/RPM-GPG-KEY-nordugrid

Known Issues

Old releases