Ubuntu

From NorduGrid

Jump to: navigation, search

Ubuntu is a Linux distribution that has its roots with Debian Linux. It is still driven by volunteers but has a strong commercial backing by the company Canonical. It has an enormous amount of followers on desktop machines. Technically, however, except for the naming or versioning of a few libraries, the two distributions remain identical. The build scripts for either distribution for instance should not differ.

For the preparation of Ubuntu packages on your system please follow the instructions given for Debian. Some reports claim that the very same binaries are functional on both (strongly related) platforms.

Contents

Quick start

Repositories

Note:  In addition to ARC itself, a number of Globus packages is needed to enable the Globus Securty Infrastructure (GSI) and the popular GridFTP file transfer protocol. VOMS is needed for Virtual Organisation management, and LFC is needed for data indexing.

Globus packages are accepted by Debian and hence Ubuntu distributions, and are available for Karmic and later releases. For earlier Ubuntu versions, and for ARC packages, use the NorduGrid repositories.

There are two branches in the repository:

  • Stable branch contains the latest stable version of ARC
  • Testing branch during a release-cycle contains the latest tagged version (alpha, beta, release candidate). If you want more recent than that, you will have to check the code out of our SVN. The testing repositories only contains updated packages, so in order to get a full testing-installation you will need both repositories.

For server-installation install the nordugrid-arc-server package and for the client-installation install the nordugrid-arc-client package.

The archives are signed by the key available at: 

 http://download.nordugrid.org/DEB-GPG-KEY-nordugrid.asc.

Download the key and then install it in your apt configuration using the command: 

sudo apt-key add DEB-GPG-KEY-nordugrid.asc

Stable repositories are located at: 

deb http://download.nordugrid.org/repos/ubuntu/ lucid main
deb-src http://download.nordugrid.org/repos/ubuntu/ lucid main

Testing repositories are: 

deb http://download.nordugrid.org/repos/ubuntu/ lucid testing
deb-src http://download.nordugrid.org/repos/ubuntu/ lucid testing

Replace lucid with intrepid, dapper, gutsy, hardy, jaunty or karmic as appropriate.

These two lines should appear in your /etc/apt/sources.list file, either by directly editing it or by using your favorite package management tool.

When using command line tools, remember to run the following after adding these new repositories: 

sudo apt-get update

Client installation

First, install Globus certificate utilities, you are very likely to need them to create proxies and work with certificates when needed: 

  sudo apt-get install globus-gsi-cert-utils-progs
  sudo apt-get install globus-proxy-utils

Note:  Pay attention to dashes instead of the old Globus-style underscores in package names

Then you'd need keys of potentially relevant Certification Authorities (CAs); a simple approach is to install all of them by using 

  sudo apt-get install ca-*

This is however not recommended from the security perspective, and security-conscious people must install necessary certificates one by one.

One can also install CA keys from the original IGTF repository, see section #Installing CA keys from IGTF repository


Then install ARC client itself, which will pull in other necessary packages: 

  sudo apt-get install nordugrid-arc-client


Installing CA keys from IGTF repository 

  wget http://dist.eugridpma.info/distribution/current/igtf-policy-installation-bundle-1.36.tar.gz
  tar xvzf igtf-policy-installation-bundle-1.36.tar.gz
  cd igtf-policy-installation-bundle-1.36
  ./configure --with-profile=classic
  sudo make install

You may need to browse to that repository first and find out what is the most recent version number, instead of 1.36

Build on vanilla Globus

Originally from NDGF Technical Wiki

This section describes how to install ARC on a Ubuntu (6.06, 7.10 and 8.04 currently tested) from sources.

Prerequisites

Starting with Ubuntu 7.10 the default sh is dash, not bash as it used to be. Some of the ARC scripts have not been modified to explicitly use bash even if the use bash specific features, the same also applies for of the packages needed by ARC. The easy fix is to make bash the default sh by running 

cd /bin
sudo ln -sf bash sh

Required packages

The following are required to build ARC from an SVN snapshot:

  • build-essential
  • cvs (for reasons unknown is needed by autotools)
  • automake1.9
  • libtool
  • pkg-config
  • autoconf
  • gettext
  • autotools-dev
  • m4
  • python-dev - needed if you want arclib pythonbindings, also needed for LFC
  • libxml2-dev
  • libldap2-dev
  • libexpat1-dev - needed for VOMS
  • doxygen - needed for VOMS documentation and installing CGSI-gSOAP
  • docbook, docbook-utils - needed for VOMS documentation
  • libmysqlclient15-dev - needed for Logger (12 on 6.06)
  • alien (for converting rpm to tgz)
  • flex, bison (for building gsoap)
  • uuid-dev
  • swig - needed by lfc
  • gsoap - for *32 bit* 7.10 and newer, 6.06 or *64 bit* you need to use the special NorduGrid version
  • wget - for downloading stuff from the commandline
  • libssl-dev - for compiling VOMS


At runtime we need:

  • libxml-dom-perl
  • libcrypt-ssleay-perl - needed for VOMS
  • libnet-ldap-perl (might only aply to Gutsy, needed by nordugridmap)

Some environment variables used throughout this guide

  • ARC_LOCATION, where NorduGrid ARC is to be installed
  • GLOBUS_LOCATION, ditto for Globus
  • VOMS_LOCATION, ditto for VOMS
  • GSOAP_LOCATION, ditto for GSoap (only needed on 6.06)
  • LFC_LOCATION, ditto for LFC

Building needed external software

  • GSOAP (only needed on 6.06 or if building on a pre intrepid 64 bit, new Ubuntu releases ships with a newer gsoap)
  • Globus
  • VOMS
  • LFC

Building ARC

Download the tar ball with source from [1] and unpack it somewhere.

For arc1 branch you can also export the code from SVN, and execute autogen.sh instead of bootstrap. Many of the above build dependencies need to be installed even if you don't plan to use Globus: most notably, libxml2-dev and libssl-dev.

We use rpath for hardcoding the location of libraries into ARC - beware that this implies that one cannot relocate the external software that ARC depends on (the adavantage is that we avoid problems with setting $LD_LIBRARY_PATH correctly). The use of $LD_LIBRARY_PATH here is only needed for building ARC (the build process invokes gsoap2cpp). 

export CFLAGS="-Wl,-rpath=$GLOBUS_LOCATION/lib,-rpath=$LFC_LOCATION/lib"
export CXXFLAGS=$CFLAGS
export C_INCLUDE_PATH=
export CPLUS_INCLUDE_PATH=

Note:  on 6.06 or up to and including hardy on 64 bit (because gsoap is not compiled with -fPIC) you need to do the following: 

export CFLAGS="-Wl,-rpath=$GLOBUS_LOCATION/lib,-rpath=$LFC_LOCATION/lib,-rpath=$GSOAP_LOCATION/lib"
export LD_LIBRARY_PATH=$GSOAP_LOCATION/lib

Now lets configure and build ARC.

In order for ARC to find the globus installation, the following environment variables may have to be set 

export GPT_FLAVOR_CONFIGURATION=$GLOBUS_LOCATION/sbin/gpt-flavor-configuration
export GPT_QUERY=$GLOBUS_LOCATION/sbin/gpt-query
export GLOBUS_MAKEFILE_HEADER=$GLOBUS_LOCATION/bin/globus-makefile-header



./bootstrap
./configure --prefix=$ARC_LOCATION --with-globus-location=$GLOBUS_LOCATION\
  --with-voms-location=$VOMS_LOCATION --with-lfc-location=$LFC_LOCATION
make

Note:  on 6.06 or on 64 bit you need to add GSOAP_LOCATION to the configure line: 

./configure --prefix=$ARC_LOCATION --with-globus-location=$GLOBUS_LOCATION\
  --with-voms-location=$VOMS_LOCATION --with-lfc-location=$LFC_LOCATION\
  --with-gsoap-location=$GSOAP_LOCATION


The default install sets up config-files in /etc and it is done the following way 

make install

If you just want to install the binaries (for example to test it out as a normal user), then run: 

make install-exec
cd $ARC_SRC/arclib/arc
make install-arcincludeHEADERS

if you want to have arclib-python bindings then run these commands too 

cd $ARC_SRC/arclib
make install-pythonPYTHON
make install-pythonLTLIBRARIES

If you want to build only the new client from arc1 branch, do: 

 ./autogen.sh
 ./configure --disable-a-rex-service --disable-isi-service --disable-charon-service --disable-compiler-service --disable-hopi-service --disable-paul-service --disable-sched-service --disable-storage-service --disable-java
 make install

Additional steps needed for ARC 0.6

The following steps are required for ARC 0.6 and should be carried out before running configure. For ARC 0.6.0.3 and onwards they should not be necessary anymore

Go to the directory where the source ended up. Modify ./grid-manager/globus_makefile.mk.pre 

Comment line 11 and 15

Modify ./grid-manager/datamove/globus_makefile.mk.pre 

Comment line 5 and 7

Modify ./cli/Makefile.am

If you are building on x86_64 you need to change this to: \-lglobus_rls_client_gcc64dbgpthr 

 Add to arccli_LDADD
  -lglobus_rls_client_gcc32dbgpthr

Add GridFTP2 support 

 wget http://www.cs.aau.dk/~kleist/arc-0.6.0-enabled-gridftp2.patch
 patch -p1 < arc-0.6.0-enabled-gridftp2.patch
Retrieved from "http://wiki.nordugrid.org/index.php/Ubuntu"
Personal tools