Testing for update EMI 1.0.1rc4

Organization of testing

Infrastructure

ARC-EMI testbed EGIIS (running ARC 1.0.0), which can be accessible over

ldapsearch -h arc-emi.grid.upjs.sk -p 2135 -x -b 'mds-vo-name=ARC-EMI,o=grid' -s base giisregistrationstatus

The grid-monitor is at http://arc-emi.grid.upjs.sk/gridmonitor/ EGIIS using 1.0.1rc4 code. and it is accessible over

ldapsearch -h testbed-emi1.grid.upjs.sk -p 2135 -x -b 'mds-vo-name=ARC-EMI-1.0.1,o=grid' -s base giisregistrationstatus

its grid-monitor is running at http://testbed-emi1.grid.upjs.sk/gridmonitor/loadmon.php

CE ARC1: rc1.grid.upjs.sk:50000/arex (1.0.1rc4 running, without patch)

CE ARC0: rc0.grid.upjs.sk (1.0.1rc4 I cannot submit job LDAP problem, I need to apply patch)

Communication ports

Port no.	Type	Component
localhost, 127.0.0.1	local	BDII
443
2135-2137		LDAP, BDII
2811		GridFtp
9000-9300 or 9000-11000		GridFtp
15001-15003		Torque
50000	Type	AREX
60000	Type

Availability of testers during 20.7-21.7.2011

http://doodle.com/4de6fic66hz7rrr7

List of testers

ARC CORE

Marek, Anders, Zsombor

ARC CE

Marek, Anders, Samir, Adrian, Florido

ARC CLIENT

Marek, Anders, Jozef, Salman, Mattias, Jon, Martin Skou, Eva

ARC INFO

Marek, Anders, Adrian, Mattias, Florido

ARC GridFtp

Anders, Marek, Mattias, Salman, Jon

Relevant documents

How to report the results

Tester writes test report. The test report has unique structure

-Description of problem (for example description of bug with link to bugzilla)
-Test scenario (all details needed to reproduce test)
-Infrastructure used to perform test (for example testbed with specification of software)
-Expected results
-Output of test (for example stdout, stderr)
-Comments and proposals (should be used as feedback for developers) 
-The final decision PASSED/FAILED

Test report must be copied in the Test report for EMI comp[onents (wiki) Follow structure of reports recommendation is to keep order of items (for example regression tests bug 1, 2 , 7)

Notes

Regression testing:

If bug is successfully verified change status in bugzilla  to VERIFIED, then provide information about the result in the initial table in the wiki

1.0.1rc4

1.0.1rc4 (Revision 22257)

Priority tasks -actual status

Deploiment tests

Testing deployment of ARC Information System components is priority

The ARC packages (including rc1 of ARC 1.0.1 release) intended for the upcoming EMI-1 update release are now available from the official testing repo

http://emisoft.web.cern.ch/emisoft/dist/EMI/testing/1/sl5/

the corresponding repo file is this

https://twiki.cern.ch/twiki/pub/EMI/EMI1Updates/testing.repo

The ETICS configurations used for producing the packages are under emi-arc_R_1_0_1_4 subsystem configuration in emi/arc ETICS subsystem.

The specific tags used in configuration are:

arc1/tags/1.0.1rc4
arc0/tags/compat_1.0.0
doc/tags/1.0.1
packaging/fedora/nordugrid-arc-meta/tags/1.0.1

Deploiment tests - Marek

EGIIS

Observations:

DEPLOYMENT SUCCESSFUL

The config file I used for EGIIS was:

[common]
hostname="testbed-emi1.grid.upjs.sk"
x509_user_key="/etc/grid-security/hostkey.pem"
x509_user_cert="/etc/grid-security/hostcert.pem"
x509_cert_dir="/etc/grid-security/certificates"
[infosys]
overwrite_config="yes"
oldconfsuffix=".oldconfig"
hostname="testbed-emi1.grid.upjs.sk"
port="2135"
debug="1"
slapd_loglevel="1"
slapd_hostnamebind="*"
threads="128"
timelimit="1800"
registrationlog="/var/log/arc/inforegistration.log"
providerlog="/var/log/arc/infoprovider.log"
provider_loglevel="2"
limit_core="0"
limit_nofile=""
user="root"
infosys_compat=enable
infosys_nordugrid=enable
infosys_glue12=disable
infosys_glue2_ldap=disable
bdii_location="/usr"
bdii_tmp_dir="/var/tmp/bdii"
bdii_var_dir="/var/run/bdii"
bdii_log_dir="/var/log/bdii"
bdii_cmd="/etc/init.d/bdii"
bdii_update_cmd="/usr/sbin/bdii-update"
[infosys/index/ARC-EMI-1.0.1]
name="ARC-EMI-1.0.1"
allowreg=* 
[infosys/glue12]
resource_location="Kosice, Slovakia"
resource_latitude="0"
resource_longitude="0"
cpu_scaling_reference_si00=2400
processor_other_description='Cores=3,Benchmark=9.8-HEP-SPEC06'

the EGIIS service installed with RC of 1.0.1 packages is available from testbed-emi1.grid.upjs.sk and can be used for registering any cluster (until we are done with testing). Its grid-monitor is located at http://testbed-emi1.grid.upjs.sk/gridmonitor/loadmon.php

Compute-Element

DEPLOYMENT SUCCESSFUL after applying patch suggested by Daniel (the pid problem), the CA packages have not been installed but because the metapackage version has not been updated to 1.0.1, will be fixed with next build.

The configuration used was following:

[common]
pbs_bin_path="/usr/local/bin"
pbs_log_path="/var/spool/torque/server_logs"
hostname="testbed-emi4.grid.upjs.sk"
lrms="pbs"
globus_tcp_port_range="9000,11000"
x509_user_key="/etc/grid-security/hostkey.pem"
x509_user_cert="/etc/grid-security/hostcert.pem"
x509_cert_dir="/etc/grid-security/certificates"
gridmap="/etc/grid-security/grid-mapfile"
[vo]
id="vo_1"
vo="ARC_Community"
source="http://www.nordugrid.org/community.dn"
source="http://vls.grid.upjs.sk/comunity.dn"
source="http://vls.grid.upjs.sk/demo-dn-list.dn"
source="http://www.knowarc.eu/knowarc.dn"
source="vomss://arthur.hep.lu.se:8443/voms/knowarc.eu?/knowarc.eu"
source="vomss://emitestbed07.cnaf.infn.it:8443/voms/testers.eu-emi.eu?/testers.eu-emi.eu"
mapped_unixid="gridtest"
require_issuerdn="no"
[group/users]
name="users"
vo="ARC_Community"
[grid-manager]
controldir="/var/spool/nordugrid/jobstatus"
sessiondir="/scratch/grid"
#sessiondir="/mnt/storage"
scratchdir="/scratch/scratch"
runtimedir="/SOFTWARE/runtime"
cachedir="/scratch/cache"
user="root"
mail="grid.support@somewhere.org"
joblog="/tmp/gm-jobs.log"
securetransfer="no"
debug="5"
[gridftpd]
debug="3"
logfile="/var/log/gridftpd.log"
logsize="100000 2"
pidfile="/var/run/gridftpd.pid"
port="2811"
pluginpath="/usr/lib64/arc"
encryption="no"
allowunknown="no"
maxconnections="200"
#unixmap="nobody:nobody all"
unixmap="gridtest:gridtest all"
[gridftpd/filedir]
plugin="fileplugin.so"
path="/unixacl"
mount="/scratch/tests"
dir="/ nouser read cd dirlist delete create *:* 664:664 mkdir *:* 775:775"
[gridftpd/jobs]
path="/jobs"
plugin="jobplugin.so"
allownew="yes"
[httpsd]
user="root"
debug="2"
logfile="/var/log/httpsd.log"
logsize="100000 2"
pidfile="/var/run/httpsd.pid"
gsiport="8000"
sslport="8001"
#plugin="/opt/nordugrid/lib/se.so"
[se/filedir]
name="filedir"
assigned_storage="filedir"
alias="KE-testbed-emi4-unixacl"
comment="Under test"
type="gridftp"
[infosys]
overwrite_config="yes"
oldconfsuffix=".oldconfig"
hostname="testbed-emi4.grid.upjs.sk"
port="2135"
debug="2"
slapd_loglevel="3"
slapd_hostnamebind="*"
threads="128"
timelimit="1800"
registrationlog="/var/log/inforegistration.log"
providerlog="/var/log/infoprovider.log"
provider_loglevel="3"
limit_core="0"
limit_nofile=""
user="root"
infosys_nordugrid=enable
infosys_glue12=disable
infosys_glue2_ldap=enable
bdii_location="/usr"
bdii_tmp_dir="/var/tmp/bdii"
bdii_var_dir="/var/run/bdii"
bdii_log_dir="/var/log/bdii"
bdii_cmd="/etc/init.d/bdii"
bdii_update_cmd="/usr/sbin/bdii-update"
[cluster]
cluster_alias="testbed-emi4-UPJS"
cluster_location="SK-04001-Kosice"
cluster_owner="UPJS"
clustersupport="marek.kocan@upjs.sk"
lrmsconfig="single job per processor"
homogeneity="True"
architecture="adotf"
nodecpu="AMD64 Processor @ 3500+ MHz"
opsys="SL5 64bit"
nodememory="1024"
middleware="from SVN"
nodeaccess="inbound"
nodeaccess="outbound"
dedicated_node_string="AMD"
gm_mount_point="/jobs"
gm_port="2811"
cachetime="30"
timelimit="30"
sizelimit="10"
[infosys/glue12]
resource_location="Kosice, Slovakia"
resource_latitude="0"
resource_longitude="0"
[infosys/cluster/registration/ARC-EMI-1.0.1]
targethostname="testbed-emi1.grid.upjs.sk"
targetport="2135"
targetsuffix="mds-vo-name=ARC-EMI-1.0.1,o=grid"
regperiod="60"
registranthostname="testbed-emi4.grid.upjs.sk"
registrantport="2135"
[queue/gridlong]
name="gridlong"
homogeneity="True"
scheduling_policy="FIFO"
comment="gridlong"
queue_node_string="AMD"
totalcpus="1"
cachetime="30"
timelimit="30"
sizelimit="5000"
[infosys/se/filedir/registration/sefiledirARC-EMI-1.0.1]
targethostname="testbed-emi1.grid.upjs.sk"
targetport="2135"
targetsuffix="mds-vo-name=ARC-EMI-1.0.1,o=grid"
regperiod="180"

Summary Table

Description	Component	Tester	Result
clean	CORE	Marek	PASSED
upgrade	CORE	Marek	PASSED
clean	CE	Marek	PASSED (patch for bddi-update had to be used)
clean	CE	Jozef	PASSED
upgrade	CE	Marek	PASSED
clean	CLIENT	Jozef	PASSED
update	CLIENT	Jozef	PASSED
clean	INFO	Florido, Marek	PASSED
upgrade	INFO	Florido, Marek	PASSED but doesn't check for the new BDII version

Static Code Analysis

Sloccount

cpp:         142284 (74.48%)
perl:         18564 (9.72%)
php:          14347 (7.51%)
python:       10611 (5.55%)
sh:            4378 (2.29%)
ansic:          802 (0.42%)
java:            63 (0.03%)

The complete results of SLOC count for entire ARC code can be found here:(http://testbed1.grid.upjs.sk/static_code_analysis/nordugrid-arc-1.0.1rc4.sloccount)

CCCC metrics

Metric	Tag	Overall	Per Module
Number of modules	NOM	943
Lines of Code	LOC	110409	117.083
McCabe's Cyclomatic Number	MVG	32558	34.526
Lines of Comment	COM	12925	13.706
LOC/COM	L_C	8.542
MVG/COM	M_C	2.519
Information Flow measure ( inclusive )	IF4	663492	703.597
Information Flow measure ( visible )	IF4v	662760	702.821
Information Flow measure ( concrete )	IF4c	3739	3.965
Lines of Code rejected by parser	REJ	3319

The complete results for CCCC for entire ARC code can be found at http://testbed1.grid.upjs.sk/static_code_analysis/nordugrid-arc-1.0.1rc4.cccc/

Regresion Tests

List of bugs to test (grouped based on priority)/regression testing

BLOCKER

bug	description	component	tester	result
2236	Uploaders hangs	CE	Marek	PASSED
2436	YUM repository configuration is wrong	CLIENT	Marek	CLOSED long time ago
2475	XRSLParserTest fails on some 64bit platforms: RHEL 4+5, SL5, Fedora 5+6	CLIENT	Marek	PASSED (tested for CentOS5 32bit, SL5 64bit, SL6 64bit)
2482	looping downloader	CLIENT	Marek	PASSED
2450	GGUS-Ticket-ID: #72340 EMI1 ARC CE 1.0.0 wrong user mapping	Client	Eva, Jozef	PASSED (arctest), FAILED(ngtest)

CRITICAL

bug	description	component	tester	result
2301	Uploaders from WS ARC segfault while trying to upload to SRM:// URLs	CE	Jozef	n/a
2472	Period and Time not usable with python for missing methods to get values	CLIENT	Jozef	n/a
2474	renew credentials does not work with arc1 server	CE	Jozef	PASSED
2487	Infosystem thrashes the contents of /var/lock/subsys/ when started	INFO	Florido	CLOSED,PASSED
2392	Repositories for ARC 11.05 need to be created
2423	arctest can not find targets, reports bogus error	CLIENT	Eva, Jozef	PASSED (arctest), FAILED(ngtest)
2442	ARC incompatible with CERN voms server	CORE	Florido	n/a
2491	2.6 python bindings for RH5
2516	WARNING: Failed to create ldif generator script for infosys and iptables issue	INFO	Jozef	PASSED

MAJOR

bug	description	component	tester	result
1887	arcstat -a very inefficient	Client	Gabor	PASSED
1979	Configuration issues when running a split GFS / GM setup	Info		n/a
2266	Problem building the nordugrid-arc-1.0.0b1 tarball that was generated in ETICS (swig compatibility)	Client	Gabor	FAILED, Still open with this source (http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RC4/sl5/tgz/nordugrid-arc-doc-1.0.0.tar.gz)
2449	ARC 11.05 parsing voms attributes	CE		n/a
2452	ARClib's DownloadDirectory aborts with: globus_list_rest: Assertion `head != 0' failed.	Client		n/a
2463	argget report failure in downloading jobs from ARC0 sites	Client	Gabor	PASSED

normal

bug	description	component	tester	result
2148	"User tools (arccp/rm/ls) should uri encode their arguments before using them"
2219	"Segmentation faults in DataStagingDelivery"
2288	"More informative errors in arcstat when a site is down"	Client	Gabor	PASSED
2291	"No pointer to Windows, Mac packages downloads"
2365	"Job submission failed, no more possible targets however server is health"
2370	"multiple arched processes are spawned"
2388	"Logrotate and gridftp and A-REX"
2405	"gridftp dmc is not using anonymous as the default for plain ftp."
2411	"Only SLURM 2.2.1 supported, not newer version."
2418	"Repository for Ubuntu 11.04"
2420	"arcproxy manpage errors"
2425	"Timeout for user uploadable files is too long"
2427	"gm-kick is called by scan-SLURM-job but it is not installed in {$basedir}"
2429	"ldapsearch should escape parentheses"
2430	"ARC shouldn't request a gsiftp URL when it isn't configured to use one"
2431	"ARC should release the TURL after transfer failure"
2434	"No man page - nordugridmap"	CE	Florido	PASSED
2435	"No man page - arc-infoindex-relay & arc-infoindex-server"	INFO	Florido	VERIFIED/PASSED
2441	"Unable to configure ARC to build with external LCMAPS headers"
2445	"A-REX crashes when using WS-interface"
2453	"arcclean reporting failure at server site"
2455	"arc1 fails to compile with recent libxml2 and xmlsec"
2456	"seg fault from gridftpd when submitting job"
2458	"arcls fails to list files on dcache gridftp server"
2470	"URLs with spaces cannot be cached"
2493	"ngrm command line options descriptions differ"
2494	"jobs get stuck in EXECUTED when resumed after failing in uploading output files"
2496	"Wrong metapackage name in server installation instructions"
2499	"ARC build problems"
2407	"No check for Python.h is made in ./configure, but the python bindings are built"
2412	"Downloading fails from ARC gridftpd 0.8.1 site when using cache."
2454	"Debian and Ubuntu repo examples have testing instead of experimental"
2403	"arc.conf.template refers to arc server but is in package nordugrid-arc-client"
2461	"GGUS-Ticket-ID: #71248 EMI1: arc-ce documentation issues"
1291	"ability to use srm over https through url option"
2015	"merged standalone to contain both new and old client tools"
2076	"Distribution of binary release packages needs improvements"